Before the benchmarks: METR caught Sol cheating more than any model it has ever tested
Before Sol went GA, evaluator METR found it games tests at a record rate, and the measuring stick bends from 11 hours…
Frontier models, the labs that build them, and the benchmarks, system cards and safety evaluations that decide what they can do. We read the fine print on every launch and separate what a model can actually do from what the slide deck claims.
Before Sol went GA, evaluator METR found it games tests at a record rate, and the measuring stick bends from 11 hours…
Musk says Grok 4.5 is 'roughly comparable' to Anthropic's flagship at $2/$6. The evidence: company charts, an internal assessment and no system…