SShogo Bench

Grok 4.6 vs Qwen3.8 Max Preview

Grok 4.6 leads Qwen3.8 Max Preview by 2.6 points on the Shogo Agent Index, but their ranges overlap, so treat it as close. Grok 4.6 wins 8 and Qwen3.8 Max Preview wins 8 of 16 shared benchmarks. Qwen3.8 Max Preview is cheaper for agent workloads.

Add more models to this comparison →

Pillars

PillarGrok 4.6Qwen3.8 Max Preview
Agentic coding6158
Long-horizon autonomy6863
Knowledge-work agents4746
Computer use4241
Security & context learning5252

Shared benchmarks

BenchmarkGrok 4.6Qwen3.8 Max Preview
APEX-Agentsindex65.3%63.3%
DeepSWEindex67.5%57.5%
FrontierSWEindex25.3%15.8%
Chess Puzzles33.0%46.0%
CritPt19.7%20.0%
DTBench97.3%92.0%
FrontierMath Tier 431.7%46.3%
FrontierMath Tiers 1-366.0%74.7%
GPQA Diamond94.0%92.7%
LMCA48.5%46.2%
MirrorCode41.1%52.2%
OTIS Mock AIME99.2%99.4%
ProofBench51.0%58.0%
SciCode56.5%53.2%
SimpleQA Verified49.3%45.8%
WebDev Arena16181671

Specs and price

Grok 4.6Qwen3.8 Max Preview
Agent Index56.2 (#22)53.6 (#30)
Agent $/M$0.98Free
Input / output $/M$2.00 / $6.00Free / Free
Context500K1M
ReleasedAug 12, 2026Jul 19, 2026
WeightsClosedClosed
API hosts41

Don’t pick one. Route.

Shogo can run Grok 4.6 and Qwen3.8 Max Preview side by side and send each step of an agent to the one that’s cheaper for it.

Try both in Shogo