aiaimodel.cards
← All benchmarks

AA-Briefcase v1.1

We haven't written a description for this benchmark yet; see the card notes below for how each maker ran it.

  1. 1Claude Opus 5.5 · Anthropic
    1822 Elo
  2. 2Claude Sonnet 5.5 · Anthropic
    1811 Elo
  3. 3Claude Haiku 5.5 · Anthropic
    1578 Elo

How each maker reported it

  • Claude Opus 5.5 Table 8.1.A, p.174

    Claude results use adaptive thinking at max effort, averaged over five trials (Terminal-Bench 4.0 at xhigh). Competitor figures come from the developers' own published results.

  • Claude Sonnet 5.5 Table 8.1.A, p.109

    Claude results use adaptive thinking at max effort with default sampling, averaged over five trials. Competitor figures come from the developers' own published system cards or leaderboards.

  • Claude Haiku 5.5 Table 8.1.A, p.111

    Haiku 5.5 results use adaptive thinking at max effort with default sampling, averaged over five trials. FrontierCode is shown at max effort (Sonnet 5.5 scores 52.1 at xhigh). OSWorld is the offline subset; GPT-6 Luna was run by Anthropic on the same tasks. Other competitor figures come from the developers' own published results.

Only each model's own maker's number is shown; scores a maker reports for rival models are left out.