evaluation

Three days after we argued the agent-eval sector sells a number nobody trusts, Patronus AI raised $50M and reframed itself around Digital World Models. It is not defending the benchmark. It is replacing it with simulation, and the move concedes the original critique.

Investors have poured serious capital into agent evaluation, observability and benchmarking. **Braintrust** raised **$80M at $800M**, **LangChain** **$125M at $1.25B**, **LMArena** **$100M then $150M at $1.7B**, **Patronus** a fresh **$50M Series B** on June 25. The product they sell is a number. The research says the number is broken: up to **100%** relative error on agent benchmarks, **27** private variants gaming one leaderboard, and a 1MB blind script beating frontier agents.

Six weeks after agent harness engineering got named, the empirical question arrived: how much of a coding agent's score is the model, and how much is the scaffold around it. Four 2026 papers put numbers on it — and the numbers are larger than almost anyone guessed.