Most of this year I have been writing one complaint: when a cheaper model answers in place of the one you asked for, nothing in the output tells you.
On 2 November, Anthropic's Frontier Red Team, with cryptographers from EPFL, StarkWare and MIT, published the first practical answer: was this reply produced by the model the invoice names?
Their system, FlashProve, attaches a cryptographic proof to model output. A provider commits to a specific set of weights once. Each proof is about 19 MB for a 1,024-token request, checks in seconds on an ordinary CPU, and according to their post the verifier "does not have to trust the prover." Generation runs at around 110 tokens per second on a single H100, which they measure at 70 to 95 times the compute of simply serving the request with vLLM.
That is a real advance, and it is the first time the answer has been mathematical rather than statistical. My own checks are the statistical kind: fingerprint token-by-token reasoning, compare to reference models.…