Evidence‑First Generation & Citations

Diagnosis Table

Symptom Likely Cause Immediate Mitigation

Model hallucinates a numeric policy limit Claim generated without attached source metadata Enforce claim‑to‑evidence mapping in the generation step

UI shows only a confidence score UI layer decoupled from retrieval‑metadata Bind “show source” widget directly to stored evidence

Auditors cannot trace a recommendation Immutable citation metadata not persisted Persist timestamp, doc‑ID, version, and excerpt together with response

Live regulatory numbers are stale Numeric values retrieved from static docs Delegate live values to a deterministic API (Live‑Value Service)

Regression test failures after model update Evidence bundle generated differently post‑update Freeze evidence‑generation logic; run regression suite before releasing

Decision Diagram

flowchart TD A["Start: User request"] B["Retrieve context"] C["Generate claim"] D["Attach evidence metadata"] E["Validate citation correctness"] F["Return response…