Eight frontier models met a real codebase and the best one finished 39 percent of the work
Specific Labs licensed ten production codebases from real companies and ran eight frontier model-and-harness combinations against the actual tickets their engineers were assigned; Fable 5.1 led at 38.8…