AI Model Capability Comparison
ML engineering
Only models released within the past year are shown. Only benchmarks covering at least 3 of these models are shown. Unknown release dates are excluded; historical data is retained.
ProgramBenchProgramming benchmark
— means no published score for this candidate in this source, not zero.10/11 recent-year models have scores
| No. | Model | Cost / TestCost per test | Input costInput price per million tokens | Output costOutput price per million tokens | DurationReported test duration | |
|---|---|---|---|---|---|---|
| 1 |  Claude Opus 5.5Claude Opus 5.5 | 18.5 | $68.05 | $4 | $20 | 144 min |
| 2 | Claude Fable 5.1Claude Fable 5.1 | 7 | $58.52 | $10 | $50 | 147 min |
| 3 | Claude Sonnet 5.5Claude Sonnet 5.5 | 6.5 | $35.86 | $2 | $10 | 127 min |
| 4 |  GPT-6 AstraGPT-6 Astra | 5.5 | $11.57 | $10 | $50 | 27.03 min |
| 5 | GPT-6.1 SolGPT-6.1 Sol | 3 | $2.87 | $2 | $10 | 70 min |
| 6 | Claude Opus 5Claude Opus 5 | 3 | $60.29 | $5 | $25 | 175 min |
| 7 |  Gemini 4 ArgonGemini 4 Argon | 2.5 | $17.66 | $4 | $20 | 71 min |
| 8 | Claude Haiku 5.5Claude Haiku 5.5 | 2.5 | $6.83 | $0.1 | $0.5 | 73 min |
| 9 | GPT-6 SolGPT-6 Sol | 2 | $11.67 | $2 | $10 | 46.18 min |
| 10 | GPT-6 LunaGPT-6 Luna | 0.5 | $0.18 | $0.1 | $0.5 | 28.92 min |
PandaNpc Updated Oct 21, 2026, 06:01 UTC
Source: Epoch AI, CC BY 4.0 · Vals.ai · Artificial Analysis (artificialanalysis.ai)
Column guide
- No.
- Display order only. Sorting changes this number; it is not a published capability rank.
- Model
- The evaluated model name and its provider icon. A dash in a score column means no published score is available here, not a zero.
- Score
- Tests reconstructing programs from scratch to match required behavior. Evaluation methodology ↗
- Cost / Test
- Cost per test · USD
- Input cost
- Input price per million tokens · USD / 1M tokens
- Output cost
- Output price per million tokens · USD / 1M tokens
- Duration
- Reported test duration · s / min
- Vals.ai
- Costs and times are reported by Vals for this benchmark, not universal model prices or latency. CUA-bench estimated API cost covers evaluation usage and is a lower-bound estimate, not cost per task; time per action is an average, not a median. An asterisk marks launch-day prompt-cache behavior that increased cache-write costs. Missing values are unpublished, not zero.