Menu

Post image 1
Post image 2
Post image 3
Post image 4
1 / 4
0

Brood War Bench

Hacker News·about 3 hours ago
#hzzfgq33
Reading 0:00
15s threshold

Which model wins at Brood War? Key takeaways None of the models played beyond a beginner level. Codex Astra is the clear leader beating all other models consistently. Grok models are not smart enough to play Brood War yet. Older models tended to play the RTS as a turn-based game, leading them to get destroyed while they were thinking. Newer models sometimes fell into the same trap, which may explain why some lower-effort settings performed better, but overall were much more cognizant of the cost of thinking. Leaderboard Rank System Wins Losses APM Cost / game Win rate 🥇 Codex Astra / xhigh 18 0 12.6 $10.54 100.0% 🥈 Codex Astra / medium 16 2 17.2 $15.11 88.9% 🥉 Claude Fable 15 3 12.6 $12.24 83.3% 4 Codex Astra / low 14 4 25.7 $21.07 77.8% 5 Codex 5.6 Sol / medium 13 5 10.1 $5.12 72.2% 6 Codex 5.6 Sol / low 12 6 18.1 $9.23 66.7% 7 Claude Opus 5 12 6 10.5 $20.78 66.7% 8 Codex 5.6 Sol / xhigh 11 7 8.0 $3.23 61.1% 9 Codex 5.6 Luna / low 9 9 23.8 $0.42 50.0% 10 Codex 5.6 Terra / xhigh 9 9 15.8 $2.10 50.0% Brood…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More