Which model wins at Brood War?

Key takeaways

None of the models played beyond a beginner level.

Codex Astra is the clear leader beating all other models consistently.

Grok models are not smart enough to play Brood War yet.

Older models tended to play the RTS as a turn-based game, leading them to get destroyed while they were thinking. Newer models sometimes fell into the same trap, which may explain why some lower-effort settings performed better, but overall were much more cognizant of the cost of thinking.

Leaderboard

Rank System Wins Losses APM Cost / game Win rate

🥇 Codex Astra / xhigh

18 0 12.6 $10.54 100.0%

🥈 Codex Astra / medium

16 2 17.2 $15.11 88.9%

🥉 Claude Fable

15 3 12.6 $12.24 83.3%

4 Codex Astra / low

14 4 25.7 $21.07 77.8%

5 Codex 5.6 Sol / medium

13 5 10.1 $5.12 72.2%

6 Codex 5.6 Sol / low

12 6 18.1 $9.23 66.7%

7 Claude Opus 5

12 6 10.5 $20.78 66.7%

8 Codex 5.6 Sol / xhigh

11 7 8.0 $3.23 61.1%

9 Codex 5.6 Luna / low

9 9 23.8 $0.42 50.0%

10 Codex 5.6 Terra /…