SShogo Bench

Claude Haiku 5.5 vs Gemini 3.7 Flash

Claude Haiku 5.5 leads Gemini 3.7 Flash by 1.8 points on the Shogo Agent Index, but their ranges overlap, so treat it as close. Claude Haiku 5.5 wins 9 and Gemini 3.7 Flash wins 8 of 17 shared benchmarks. Claude Haiku 5.5 is cheaper for agent workloads.

Add more models to this comparison →

Pillars

PillarClaude Haiku 5.5Gemini 3.7 Flash
Agentic coding6761
Long-horizon autonomy6264
Knowledge-work agents4648
Computer use4743
Security & context learning5553

Shared benchmarks

BenchmarkClaude Haiku 5.5Gemini 3.7 Flash
APEX-Agentsindex56.1%67.8%
FrontierSWEindex43.8%20.3%
ARC-AGI89.0%95.5%
ARC-AGI-261.3%84.6%
Chess Puzzles55.0%66.0%
CritPt22.6%14.3%
DTBench95.0%96.8%
FrontierCode46.4%43.6%
FrontierMath Tier 446.3%36.6%
FrontierMath Tiers 1-375.1%71.6%
GPQA Diamond89.6%94.8%
LMCA51.1%50.4%
MirrorCode78.9%41.1%
OTIS Mock AIME98.9%97.2%
ProofBench89.0%58.0%
SciCode55.0%59.8%
SimpleQA Verified23.8%69.2%

Specs and price

Claude Haiku 5.5Gemini 3.7 Flash
Agent Index57.5 (#18)55.7 (#23)
Agent $/M$0.050$0.35
Input / output $/M$0.10 / $0.50$0.75 / $3.75
Context1M1M
ReleasedOct 7, 2026Aug 13, 2026
WeightsClosedClosed
API hosts56

Don’t pick one. Route.

Shogo can run Claude Haiku 5.5 and Gemini 3.7 Flash side by side and send each step of an agent to the one that’s cheaper for it.

Try both in Shogo