AI Model Capability Comparison

ML engineering

Only models released within the past year are shown. Only benchmarks covering at least 3 of these models are shown. Unknown release dates are excluded; historical data is retained.

MysteryMechanismHidden mechanism inference

— means no published score for this candidate in this source, not zero.10/11 recent-year models have scores

No.ModelCost / TestCost per testInput costInput price per million tokensOutput costOutput price per million tokensDurationReported test duration
1OpenAIGPT-6 AstraGPT-6 Astra53.15$1.56$10$508.15 min
2AnthropicClaude Opus 5.5Claude Opus 5.549.55$4.62$4$2019.63 min
3AnthropicClaude Sonnet 5.5Claude Sonnet 5.549.1$3.45$2$1023.5 min
4AnthropicClaude Fable 5.1Claude Fable 5.147.75$5.63$10$5017.68 min
5OpenAIGPT-6.1 SolGPT-6.1 Sol46.4$0.28$2$107.28 min
6Google DeepMindGemini 4 ArgonGemini 4 Argon45.49$4.59$4$2024.92 min
7AnthropicClaude Opus 5Claude Opus 537.39$3.28$5$2516.88 min
8AnthropicClaude Haiku 5.5Claude Haiku 5.535.13$0.54$0.1$0.513.42 min
9OpenAIGPT-6 SolGPT-6 Sol30.18$0.46$2$106.22 min
10OpenAIGPT-6 LunaGPT-6 Luna19.37$0.03$0.1$0.56.02 min

Vals.ai benchmarks

Source: Vals.ai ↗ · Updated 2026-10-19

MysteryMechanism · Updated 2026-10-12

PandaNpc Updated Oct 21, 2026, 06:01 UTC

Source: Epoch AI, CC BY 4.0 · Vals.ai · Artificial Analysis (artificialanalysis.ai)

Column guide

No.
Display order only. Sorting changes this number; it is not a published capability rank.
Model
The evaluated model name and its provider icon. A dash in a score column means no published score is available here, not a zero.
Score
Tests discovering hidden mathematical mechanisms through experiments with limited feedback. Evaluation methodology ↗
Cost / Test
Cost per test · USD
Input cost
Input price per million tokens · USD / 1M tokens
Output cost
Output price per million tokens · USD / 1M tokens
Duration
Reported test duration · s / min
Vals.ai
Costs and times are reported by Vals for this benchmark, not universal model prices or latency. CUA-bench estimated API cost covers evaluation usage and is a lower-bound estimate, not cost per task; time per action is an average, not a median. An asterisk marks launch-day prompt-cache behavior that increased cache-write costs. Missing values are unpublished, not zero.