aiaimodel.cards
← All benchmarks

SWE-Marathon v1.1

We haven't written a description for this benchmark yet; see the card notes below for how each maker ran it.

  1. 1Grok 4.7 · xAI
    46.0%

How each maker reported it

  • Grok 4.7 §2–6, p.5–16

    Grok 4.7 at xhigh effort except DeepSWE, SWE-Marathon, CADGenBench and CyberGym (high). Grok 4.6 at high except FrontierSWE, EEBench and HealthBench (xhigh). Most results come from third-party evaluators, each running its own harness; competitor results use max effort (CADGenBench GPT-5.6 Sol at xhigh). CyberGym is run without production safeguards.

Only each model's own maker's number is shown; scores a maker reports for rival models are left out.