AA-Briefcase
We haven't written a description for this benchmark yet; see the card notes below for how each maker ran it.
- 1Claude Opus 5 · Anthropic1720 Elo
- 2Claude Fable 5.1 · Anthropic1694 Elo
- 3Mistral Large 4 · Mistral AI1393 Elo
How each maker reported it
- Claude Opus 5 Table 8.1.A, p.148–149
Claude Opus 5 results use adaptive thinking at max effort, averaged over five trials (ARC-AGI-3 at high effort). GPT-5.6 Sol's FrontierBench figure uses Codex and its ARC-AGI-1 figure is at xhigh. The Fable 5 HealthBench Professional figure carries a footnote reading "Mythos 5". Competitor figures come from the developers' own published results or leaderboards.
- Claude Fable 5.1 Table 8.1.A, p.167
Fable 5.1 and Mythos 5.1 share weights, so column 0 covers both (likewise Fable 5 / Mythos 5). Claude results use adaptive thinking at max effort, averaged over five trials. Terminal-Bench 4.0 values are from §8.6, p.171 (Mythos 5.1: 60.9%; GPT-5.6 Sol from the public leaderboard). Competitor figures come from the developers' own published results or leaderboards.
- Mistral Large 4 launch post
Preliminary, vendor-reported preview results. Many charts in the post give no numbers; only figures stated in text are listed. Blind human coding eval run by Surge AI on a 1–5 scale.
Only each model's own maker's number is shown; scores a maker reports for rival models are left out.