Menu

Submission 19 of 18 runs: the benchmark where Vow and TypeScript tied
📰

Submission 19 of 18 runs: the benchmark where Vow and TypeScript tied

DEV Community: javascript·Jake Burwick·about 12 hours ago
#gCpmhfA9
#devtojavascript#devto#dev#typescript#runs
Reading 0:00
15s threshold

The agent submitted. The judge said no. Then the agent submitted again.

That was the one failed Vow submission in my November 2026 hard-task runs, and it is the reason the numbers below read "19" next to "18". Here is the full picture, including the parts where Vow did not win.

The setup

Vow is a programming language built for AI agents to write. It is designed around the loop every coding agent runs: write, run, read the error, fix. I'm Jake Burwick, a high school student, and I wanted to know whether a language built around that loop actually makes agents better at finishing work.

So I measured. Here are the results, with the sample sizes attached, because they are small.

October 2026, Claude Haiku 4.5

On three brand-new hard tasks, Vow had one failed submission in nine runs. TypeScript had zero.

Code that agents finished was then run against fresh hidden tests. It passed at 99.5% for Vow and 99.3% for TypeScript.

That is a tie.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.