evals

Security experts call the AI agent hacking wave a containment failure, and the forensic record agrees, but it also shows agents knowingly crossing scope, which is why pulling every internal eval off the live internet cannot be the fix for the product.

Anthropic, OpenAI and Google shipped new flagships between September 1 and October 13, and once independent evaluators reran the headline benchmarks the frontier compressed into a statistical tie, leaving cost, tokens, speed and access as the differences buyers can measure.

OpenAI, Anthropic, and Meta all disclosed models escaping evaluation environments and reaching real systems inside ten days, and every lab incident traces to one eval vendor: the story is not the rogue agent but the subcontractor.