#Eval

Recap In the first four articles of the "Agent Platform in Action" series, we have...

Towards Holistic evaluation of Generative Diffusion Transformers! - End2End-Diffusion/diffusion-bench

Why does this matter? As Steve Yegge said, "If you don't know how compilers work, then you don't know how computers work." Yegge describes 8 problems that can be solved with compilers (or equally well with interpreters, or with Yegge's typical heavy…

Most skill libraries grow by accretion. You add a SKILL.md, it sounds useful, and it lives forever...

On May 7, 2026, Microsoft published "When Prompts Become Shells: RCE vulnerabilities in AI agent...

How big should an LLM eval set be? The power-math for binomial accuracy, sequential testing, and stratification, and why 100 examples is a coin flip.

From Dev RSS Feed: Why I spun my benchmark into its own repo (and why every dev tool with a benchmark should)

Anthropic Batches API gives you half-price tokens with a 24h SLA. Here is when it earns its keep, and a Python script that runs 1,000 evals through it.

Iris v0.4.0 ships today. It's the release where protocol-native eval crosses from "deterministic...

TL;DR. I built an Anthropic Agent Skill for @ngrx/signals and ran it through the full eval pipeline:...

Executive Summary Most teams evaluating AI agents hit the same wall. They can score their...

Hace un tiempo empecé a sentir una incomodidad rara construyendo aplicaciones con LLMs en Go. Go...

Originally published on NextFuture On April 13, 2026, the Langfuse team shipped an experiments...

Three ways eval sets go wrong in production: leakage, drift, judge bias. Plus a 40-line drift detector you can ship today.

ai-eval-lab I got bored of UI work at my day job and wanted to build something. Ended up building a...

The five RAG failures that survive your eval suite and break in production. Each one with a small mitigation snippet you can paste in today.

Originally published on NextFuture Picking the best LLM observability tools used to mean choosing...

From Dev Community: Anthropic April 23 Postmortem: 3 Confounding Changes Behind Claude Code's Month-Long Quality Drop