Coding agents now open a lot of pull requests that say Fixes #123 . I wanted to know how often the ticket is actually done when that PR merges.

So I took 317 public pull requests from 317 different organisations. Each one was written by a coding agent (Claude Code, Devin, Copilot's coding agent or Cursor), was merged, and closed at least one issue. I checked every requirement in each issue against the diff.

The numbers

1 in 7 PRs left at least one requirement missed or only partly done (15%).

6% skipped a requirement entirely.

1 in 4 when the ticket was edited after the agent started (6 of 23). That's a small sample, but it's the case I care about most.

Most agent PRs do what the ticket asks.…