SShogo Bench

Claude Opus 4.8 vs Gemini 3.7 Flash

Claude Opus 4.8 leads Gemini 3.7 Flash by 0.6 points on the Shogo Agent Index, but their ranges overlap, so treat it as close. Claude Opus 4.8 wins 9 and Gemini 3.7 Flash wins 10 of 19 shared benchmarks. Gemini 3.7 Flash is cheaper for agent workloads.

Add more models to this comparison →

Pillars

PillarClaude Opus 4.8Gemini 3.7 Flash
Agentic coding6361
Long-horizon autonomy6664
Knowledge-work agents4348
Computer use4743
Security & context learning5553

Shared benchmarks

BenchmarkClaude Opus 4.8Gemini 3.7 Flash
APEX-Agentsindex48.9%67.8%
DeepSWEindex59.0%65.5%
Remote Labor Indexindex8.3%5.0%
ARC-AGI92.5%95.5%
ARC-AGI-272.1%84.6%
Chess Puzzles52.0%66.0%
CritPt20.9%14.3%
DTBench94.9%96.8%
FrontierCode46.5%43.6%
FrontierMath Tier 456.1%36.6%
FrontierMath Tiers 1-380.0%71.6%
GPQA Diamond91.0%94.8%
LMCA57.5%50.4%
MirrorCode65.6%41.1%
OTIS Mock AIME98.3%97.2%
ProofBench69.0%58.0%
SciCode53.5%59.8%
SimpleQA Verified53.0%69.2%
WebDev Arena15591587

Specs and price

Claude Opus 4.8Gemini 3.7 Flash
Agent Index56.3 (#20)55.7 (#23)
Agent $/M$2.31$0.35
Input / output $/M$5.00 / $25.00$0.75 / $3.75
Context1M1M
ReleasedMay 28, 2026Aug 13, 2026
WeightsClosedClosed
API hosts66

Don’t pick one. Route.

Shogo can run Claude Opus 4.8 and Gemini 3.7 Flash side by side and send each step of an agent to the one that’s cheaper for it.

Try both in Shogo