Benchmark-uri deschise

Fiecare benchmark. Fiecare model. Publice.

Cum se compară codai pe benchmark-urile pe care piața le citează cu adevărat. Cifrele noastre vin din rulări prin gateway — pe același drum pe care îl parcurg cererile tale. Fiecare bloc este etichetat: harness oficial, proxy, suită internă sau scoruri de referință publicate, pe care nu le-am rulat noi.

Benchmark-uri publice: 17
Rulări finalizate: 298
Cheltuit pe transparență: $2332.00

Ultima actualizare · 27 sept. 2026

Aceste rezultate au fost actualizate ultima dată pe 27 sept. 2026, acum mai bine de 14 zile. Modelele lansate între timp pot lipsi din tabele.

Frontiera Pareto

Cost vs acuratețe, fiecare model pe fiecare benchmark

Fiecare punct este un rezultat (model × benchmark). Stânga-sus este zona țintă: acuratețe mare, cost mic. Punctele de pe frontiera punctată sunt nedominate — nimic nu le bate pe ambele axe simultan.

codai
alte modele
Frontiera Pareto (cel mai mic cost la fiecare nivel de acuratețe)

Agentic

Terminal-Bench 2.1 (official, k=5)oficial

89 de sarcini

The official Terminal-Bench 2.1 dataset (89 tasks) run with the harbor harness, terminus-2 agent on model codai, 5 attempts per task (445 trials), 2026-08-02/03. Score = mean reward over tasks; errored trials count as failures. Competitor rows are published leaderboard or system-card entries (source and date in each row).

Model	Succes	$ / sarcină	$ / succes	Sarcini
`GPT-6 Astra (Codex)`cel mai bun	87.4%	—	—	89/89
`Fable 5 (Claude Code)`	83.8%	—	—	89/89
`GPT-5.5 (Codex)`	83.2%	—	—	89/89
`Fable 5 (Terminus 2)`	80.5%	—	—	89/89
`claude-sonnet-5`	80.4%	—	—	89/89
`Grok 4.5 (Cursor CLI)`	79.3%	—	—	89/89
`codai`router	71.0%	$2.2742	$3.2025	445/445

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routercel mai bun	91.2%	$0.0672	$0.0737	102/102
`claude-fable-5-1`	86.3%	$0.0960	$0.1112	102/102

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routercel mai bun	100.0%	$0.2764	$0.2764	2/2
`claude-opus-4-8`	100.0%	$0.2595	$0.2595	2/2
`codai,claude-opus-4-8`	100.0%	$0.2681	$0.2681	2/2

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routercel mai bun	100.0%	$0.0038	$0.0038	10/10
`gemini-3.1-pro-preview`	100.0%	$0.0040	$0.0040	10/10
`gemini-3.1-flash-lite`	100.0%	$0.0003	$0.0003	10/10
`gemini-3.6-flash`	100.0%	$0.0026	$0.0026	10/10
`claude-opus-4-8`	100.0%	$0.0121	$0.0121	10/10
`codai,claude-opus-4-8`	100.0%	$0.0189	$0.0189	10/10

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routerfixat	71.4%	$0.7285	$1.0199	7/7
`codai,claude-opus-4-8`cel mai bun	85.7%	$0.0734	$0.0857	7/7
`claude-fable-5`	71.4%	$0.4405	$0.6167	7/7
`claude-opus-4-8`	71.4%	$0.0552	$0.0773	7/7
`claude-haiku-4-5`	71.4%	$0.0244	$0.0341	7/7
`claude-sonnet-4-6`	57.1%	$0.0669	$0.1170	7/7

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routerfixat	73.2%	$0.6095	$0.8326	500/500
`claude-sonnet-5`cel mai bun	85.2%	—	—	500/500
`20251205_sonar-foundation-agent_claude-opus-4-5`	79.2%	—	—	500/500
`20251215_livesweagent_claude-opus-4-5`	79.2%	—	—	500/500
`20250928_trae_doubao_seed_code`	78.8%	—	—	500/500
`OpenHands + Claude Opus 4.5`	77.6%	—	—	500/500

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routerfixat	61.8%	$0.4031	$0.6527	34/225
`gpt-5 (high)`cel mai bun	88.0%	$0.1293	$0.1469	225/225
`gpt-5 (medium)`	86.7%	$0.0786	$0.0907	225/225
`claude-opus-4-7`	85.3%	$0.0273	$0.0320	34/225
`o3-pro (high)`	84.9%	$0.6503	$0.7661	225/225
`gemini-2.5-pro-preview-06-05 (32k think)`	83.1%	$0.2217	$0.2667	225/225

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routerfixat	96.3%	$0.0089	$0.0092	164/164
`codai,claude-opus-4-8`cel mai bun	97.0%	$0.0107	$0.0111	164/164
`claude-opus-4-8`	96.3%	$0.0122	$0.0127	164/164
`claude-haiku-4-5`	95.1%	$0.0111	$0.0116	164/164
`claude-sonnet-4-7`	94.5%	$0.0013	$0.0013	164/164
`claude-opus-4-7`	93.9%	$0.0013	$0.0013	164/164

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routercel mai bun	41.0%	$0.2881	$0.7028	100/100
`claude-opus-4-7`	40.0%	$0.1638	$0.4096	100/100
`claude-sonnet-4-6`	29.0%	$0.2451	$0.8451	100/100
`claude-haiku-4-5`	19.0%	$0.0272	$0.1432	100/100
`gpt-5-mini`	11.0%	$0.1577	$1.4339	100/100

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routercel mai bun	93.3%	$0.0413	$0.0442	60/60
`claude-opus-4-8`	91.7%	$0.0326	$0.0356	60/60
`codai,claude-opus-4-8`	90.0%	$0.0260	$0.0289	60/60

Model	Succes	$ / sarcină	$ / succes	Sarcini
`claude-opus-4-8`cel mai bun	100.0%	$0.0312	$0.0312	20/20
`codai,claude-opus-4-8`	100.0%	$0.0330	$0.0330	20/20
`claude-sonnet-4-6`	100.0%	$0.1140	$0.1140	20/20
`codai`router	95.0%	$0.0360	$0.0378	20/20
`claude-haiku-4-5`	95.0%	$0.0211	$0.0223	20/20

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routerfixat	81.5%	$0.0055	$0.0068	200/12032
`codai,claude-opus-4-8`cel mai bun	82.0%	$0.0062	$0.0076	200/12032
`claude-opus-4-8`	79.0%	$0.0079	$0.0100	200/12032
`gpt-5-mini`	75.5%	$0.0102	$0.0135	200/200
`claude-haiku-4-5`	65.5%	$0.0101	$0.0155	200/12032
`claude-opus-4-7`	62.0%	$0.0004	$0.0007	200/200

Model	Succes	$ / sarcină	$ / succes	Sarcini
`codai`routerfixat	98.0%	$0.0374	$0.0382	100/100
`claude-opus-4-7`cel mai bun	99.0%	$0.0164	$0.0166	100/100
`claude-opus-4-8`	98.0%	$0.0232	$0.0237	100/100
`claude-haiku-4-5`	96.0%	$0.0099	$0.0103	100/100
`claude-sonnet-4-6`	96.0%	$0.0146	$0.0152	100/100
`gpt-5-mini`	80.0%	$0.0340	$0.0424	100/100

Model	Succes	$ / sarcină	$ / succes	Sarcini
`claude-opus-4-8`cel mai bun	100.0%	$0.0312	$0.0312	20/20
`codai,claude-opus-4-8`	100.0%	$0.0330	$0.0330	20/20
`claude-sonnet-4-6`	100.0%	$0.1140	$0.1140	20/20
`codai`router	95.0%	$0.0360	$0.0378	20/20
`claude-haiku-4-5`	95.0%	$0.0211	$0.0223	20/20

Model	Succes	$ / sarcină	$ / succes	Sarcini
`gemini-3.6-flash`cel mai bun	100.0%	$0.0449	$0.0449	10/10
`codai,claude-opus-4-8`	100.0%	$0.5520	$0.5520	10/10
`claude-opus-4-8`	100.0%	$0.4434	$0.4434	10/10
`codai`router	70.0%	$0.0598	$0.0854	10/10

Fiecare benchmark. Fiecare model. Publice.

Benchmark-uri publice

Agentic

Programare

Raționament

Română

Cum păstrăm cifrele oneste

Benchmark-uri publice

Agentic

Programare

Raționament

Română

Cum păstrăm cifrele oneste