ARC-AGI-3: how the games were actually played

Official scores on ARC-AGI-3’s public set top out at 100%, and just two harnesses reach it: corteza and ARC’s own provider adapter. That number hides most of what happened. ARC’s RHAE metric caps each level at 115% and each game at 100%, so past a point, saving more actions stops changing the score.

This table keeps the official score next to what it hides: the per-level efficiency scores, those scores without the game cap, and the raw action counts. Every value is reconstructed from the recorded games and checked against the published scorecards. corteza is our R-native agent harness; the rows put it beside ARC’s own provider adapter, Prime Agent, and ARC’s reference harness across the same 25 public games and 183 levels.

Use the buttons to switch views: Official is ARC’s score, Mean levels drops the game cap, Mean uncapped removes the 115 level cap too, and Actions counts interactions where fewer wins. Expand any game to see its levels.

Game and level scores by harness and model
GameLvBasePrimeopus-5-xhighcortezaopus-5-xhighcortezaopus-5-maxcortezaastra-maxARC adapterastra-maxARC adapterastra-xhighARC adapterastra-highARC adapterastra-mediumARC adapterastra-lowARC adapterastra-noneHumanARC baseline
Total183
8
9
6
6
6
6
7
7
10
8
7
6
6
8
8
8
6
8
6
9
7
6
9
7
9
Row best115 cap100–11485–9950–841–490 unfinished— not completed in recording

Each level scores min(115, 100 × (baseline / actions)²). The 115 cap is reached at about 6.75% fewer actions than the baseline. RESETs after the initial observation count as actions. The Actions view shows counts for levels and sums for completed games; unfinished levels and games show —. Green backgrounds mark the best displayed value across visible columns, including ties; fewer actions wins in the actions view. Uniform rows have no winner background. “Hide uniform rows” removes rows whose displayed values are identical across the visible columns and shows all remaining levels with their game labels.

Official: min(100 × Σ(1..k) / Σ(1..N), Σ(i × sᵢ) / Σ(1..N)), where k levels are complete out of N. Keep level scores up to 115 before applying the completion cap. Mean levels: those capped level scores weighted by level number, Σ(i × sᵢ) / Σ(1..N) — the Official score without the completion cap. Mean uncapped: each level shows 100 × (baseline / actions)², without a cap; game rows weight their levels by level number the same way, and the Total averages the games. Higher wins. The ratio already normalizes levels to the human baseline: equal actions score 100; half as many actions score 400. Dividing scores by 100 would only change the scale. Totals weight games equally, not individual levels across games. Actions: counts at every level, summed for each game and for the top Total. Fewer actions wins throughout. Incomplete games and runs show — rather than a partial sum. Uncompleted levels contribute 0 to scores. Score totals average all 25 games; action totals sum them. Totals do not change when rows are filtered. Column ordering follows the Total row, with fewest actions first in Actions.

Sources, validation, and replay provenance

Published scorecards: Prime · Opus max · Opus xhigh · Astra replay. The Astra card is a replay of recorded actions selected from astra-arc-04 (21 games) and astra-arc-05 (4 games); it is a combined-campaign result. Selection takes the most completed levels per game and keeps the earlier campaign on ties. It does not select individual levels or choose by score.

Opus and Astra are independently reconstructed from local traces and checked against their published cards, including completed-level action counts, level scores, game scores, and totals. Prime is reconstructed from published per-level action counts. ARC adapter columns are reconstructed from published recordings; their exact official scorecards have not been independently matched.

Human / ARC baseline uses the published per-level human action counts from ARC’s game catalog, checked against the source scorecards. Its scores are 100 by definition. It is a reference column, not a separately measured human run.

Download score validation · Download per-game trace provenance · Download source scorecards. Static snapshot generated 2026-09-22 10:03 CDT.

GameSource campaignLevelsActionsTrace SHA-256 prefix
AR25astra-arc-048255134ed3bbf429d847
BP35astra-arc-0493684d72b20eb6b111b8
CD82astra-arc-0561042c3160af95fa96ac
CN04astra-arc-0461898a30914bd3e311b5
DC22astra-arc-046444ef7fddfcb7be30ec
FT09astra-arc-056768e8768e3244485c0
G50Tastra-arc-04729816754e8672317550
KA59astra-arc-047295e972c605f60ed196
LF52astra-arc-0410702efe0a7c7fbb47572
LP85astra-arc-0488814019de046783202
LS20astra-arc-047403ca462434a1dc671a
M0R0astra-arc-046199248c3e41b981e89a
R11Lastra-arc-046709bc8ccaa8ca05efe
RE86astra-arc-048535496c251cee418f9d
S5I5astra-arc-048274063e1437d2802d6a
SB26astra-arc-04812456d09841bcfec3a4
SC25astra-arc-046138e6b9d8433d22ba10
SK48astra-arc-04835066da9155e80dbcaa
SP80astra-arc-046111075877758f77ec28
SU15astra-arc-0598980d8e1f8ad46f161
TN36astra-arc-05713629dc421cd89a161a
TR87astra-arc-0461325ef51514eb562318
TU93astra-arc-0492133438dcaed5e6bb48
VC33astra-arc-04720146fd09b254b2d3a0
WA30astra-arc-049578e5f7a8ea65ee6009