SShogo Bench

Gemini 3.8 Flash vs Grok 4.5

Gemini 3.8 Flash leads Grok 4.5 by 6.8 points on the Shogo Agent Index, but their ranges overlap, so treat it as close. Gemini 3.8 Flash wins 17 and Grok 4.5 wins 3 of 20 shared benchmarks. Gemini 3.8 Flash is cheaper for agent workloads.

Add more models to this comparison →

Pillars

PillarGemini 3.8 FlashGrok 4.5
Agentic coding6354
Long-horizon autonomy6459
Knowledge-work agents4742
Computer use4436
Security & context learning5348

Shared benchmarks

BenchmarkGemini 3.8 FlashGrok 4.5
APEX-Agentsindex64.3%56.2%
DeepSWEindex73.8%53.8%
Vending-Bench 2index$5,094$3,887
ARC-AGI98.5%87.2%
ARC-AGI-289.2%52.6%
Chess Puzzles58.0%35.0%
CritPt18.3%15.4%
DTBench95.7%96.5%
FrontierCode41.2%42.4%
FrontierMath Tier 422.0%24.4%
FrontierMath Tiers 1-368.4%57.2%
GPQA Diamond95.4%93.4%
LMCA52.9%45.2%
MirrorCode38.9%32.2%
OTIS Mock AIME98.9%97.8%
ProofBench48.0%31.0%
SciCode56.6%55.0%
SimpleBench82.4%70.0%
SimpleQA Verified69.7%48.3%
WebDev Arena15681555

Specs and price

Gemini 3.8 FlashGrok 4.5
Agent Index56.2 (#21)49.4 (#36)
Agent $/M$0.35$0.81
Input / output $/M$0.75 / $3.75$2.00 / $6.00
Context1M500K
ReleasedSep 2, 2026Jul 8, 2026
WeightsClosedClosed
API hosts64

Don’t pick one. Route.

Shogo can run Gemini 3.8 Flash and Grok 4.5 side by side and send each step of an agent to the one that’s cheaper for it.

Try both in Shogo