Menu

1 / 7

My AI agent says "all fixed." 3 times out of 4, it never measured the before.

DEV Community: productivity·Haul·6 days ago
#B1iEYVoh
#devtoproductivity#devto#dev#skill#agent
Reading 0:00
15s threshold

GitHub: https://github.com/ESeungJun/fix-proposal

"All fixed." I've heard that from my AI agent, opened the app, and found the same margin more times than I'd like. (I wrote this with help from Claude and checked every number myself.)

I do most of my work with Claude Code now, and the agent often finds problems on its own. It says something like "this is also broken, want me to fix it?" And almost every time, my reply is the same question: "So what goes wrong if we leave it, and what gets better if we fix it?" When it says it fixed something, I ask: "Really? How did you check?" I got tired of asking, so I made a skill for it.

The result first

Same situation, same model (Haiku). The agent has fixed a search box and is reporting whether its promise, "requests drop from 12 to 1", came true.

Without the skill, it admitted the count only dropped to 2. Then it added "if typing doesn't pause, it drops to 1", which it never measured.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.