Previous posts: v2 — hallucination detection + A/B testing
The most common question I got after v2 was this:
"The hallucination score spiked. Now what?"
TraceMind told you that something broke. It didn't tell you why . And it definitely didn't help you fix it.
That gap is what v3 closes.
If TraceMind is useful to you, a ⭐ on GitHub helps others find it.
GitHub: https://github.com/Aayush-engineer/TraceMind
What's new
Three things shipped in v3:
EvalAgent — a ReAct agent that diagnoses quality regressions
Response Control Hooks — block or retry hallucinated responses automatically
Prompt Version Registry — track which prompt is deployed where
The EvalAgent
This is the main feature. When quality drops, instead of staring at a dashboard, you ask the agent:
"Why is quality dropping on the support dataset?"
Enter fullscreen mode
Exit fullscreen mode
The agent runs a loop:
THINK → What do I need to know? ACT → Use a tool to get it OBSERVE → What did the tool show?…