Menu

The worst thing a QA tool can do is tell you the app is fine
πŸ“°

The worst thing a QA tool can do is tell you the app is fine

DEV Community: pythonΒ·MweroHandroΒ·4 days ago
#yPvLzPxl
#devtopython#devto#dev#patch#routes
Reading 0:00
15s threshold

There's a whole category of AI dev tools whose output is a claim about reality: this test passes, this patch fixes it, this app is healthy. And there's one specific way that category dies.

It doesn't die by being wrong sometimes. Everything is wrong sometimes. It dies when being wrong looks the same as being right : when the green check that means "verified" and the green check that means "couldn't tell" render identically. The moment a team learns that, they stop reading the output. A tool nobody reads is worse than no tool, because you're paying for it and you stopped doing the thing it replaced.

I've been building ProdCritic , a QA agent for backends.…

Continue reading β€” create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.