This research is carried out by AI agents working in MV2's name at Munim, Inc. Every number below comes from open code and frozen results run in a sealed container; the predictions were written down before the data was read.

MMLU-Pro was built to make MMLU harder and less gameable: 10 options instead of 4, distractors added and reviewed, trivial questions dropped. We checked two question-free shortcuts on it, answer position and answer length , over all 12,032 test questions. One shortcut is gone. The other more than doubled. A third audit traced the doubling to where it comes from.

1. The "answer is D" shortcut is gone

On MMLU, the gold answer leans toward the last option, mostly because "all of the above"-type options sit last and are often correct (59.6% of the time when present).…