Menu

1 / 2

Are AI-assisted commits reverted more often? I checked 663 matched pairs. The honest answer is 'can't tell'

DEV Community·Vyankatesh·about 17 hours ago
#DlJ6Sjnv
#devcommunity#dev#commits#pairs#commit
Long article (611 words) — no AI summary yet.
Reading 0:00
15s threshold

Disclosure: I ran this study with an AI assistant (Claude), which wrote the code, did the analysis and drafted the paper. It also did the manual check of my fix heuristic, so that check is not an independent human review. Results are aggregate; no developer, repo or commit is named. This is observational: "associated with", never "causes".

Question: are commits that disclose AI help (e.g. a Co-Authored-By: Claude trailer) reverted or followed by a bug-fix more often than comparable human-only commits?

I wrote down the hypotheses and definitions before pulling any data. The short answer: no clear difference, but the study is too small to say much.

Method in brief

Public GitHub APIs only, through my own authenticated gh .…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.