My agent can beat a platformer it has never seen.
Flash is my open source agent for the terminal and the browser. One of its tools, play_realtime , lets the model write a tiny reflex : a JavaScript function that runs every single frame inside the page, reads the canvas pixels, and presses keys. The model can't think 60 times a second, so it writes the thing that can.
To test it, Flash ships with Flash Dash : a little level built like a rhythm runner. A square runs right on its own. Spikes kill. Blue blocks are solid. An orange pad launches you. A cyan ring gives you a second jump in mid-air. Then a gate turns you into a ship you fly between pillars.
The reference reflex beats it on the first try, from the pixels alone, in 21.11 seconds .
That's a solved problem. So I asked a better one:
Can the agent find what the level never tells it?
Glitches that help
Every speedrunner knows the feeling: the game has a crack in it, and if you find it, you skip half a level. Nobody explains these.…