SShogo Bench

GLM-5.1

Strong GLM coding model for agentic engineering, terminals, and repository generation

Shogo Agent Index

Estimated#52 of 92
42.5range 32.6–52.4 · 22% of weight measured
Agentic coding
43
23% measured
Long-horizon autonomy
59
30% measured
Knowledge-work agents
34
32% measured
Computer use
29
estimated
Security & context learning
42
estimated

Price

Input
$0.90/M
Output
$3.59/M
Cache read
$0.19/M
3:1 blend
$1.57/M
Agent-effective
$0.46/M

Cheapest host for agents: Chutes at $0.34/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verified74.2%8%source
Terminal-Bench 2.0est.8%predicted 56
DeepSWEest.6%predicted 37
FrontierSWEest.5%predicted 9
CursorBenchest.4%predicted 32
GSO-Benchest.4%predicted 18
METR Time Horizonsest.10%predicted 71
Vending-Bench 2$5,6346%source
PostTrainBenchest.4%predicted 21
APEX-Agents40.9%8%source
GDPvalest.7%predicted 40
Remote Labor Indexest.5%predicted 2
DeepResearch Benchest.5%predicted 47
OSWorld 2.0est.6%predicted 5
OSWorldest.4%predicted 64
Cybenchest.5%predicted 64
CL-benchest.5%predicted 19

Other benchmarks

BenchmarkCategoryScoreSource
Chess PuzzlesReasoning20.0%source
CritPtReasoning4.6%source
ExploitBenchSecurity & context18.1%source
FrontierMath Tiers 1-3Math36.8%source
GPQA DiamondReasoning89.9%source
OTIS Mock AIMEMath93.3%source
ProofBenchMath22.2%source
SciCodeCoding44.8%source
SimpleBenchReasoning55.1%source
SimpleQA VerifiedKnowledge34.0%source
WebDev ArenaCoding1508source

API hosts

Live prices and uptime for every host serving GLM-5.1 via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
Chutes$0.90$2.90$0.090$0.34100.0%fp8
StreamLake$0.97$3.04$0.18$0.43100.0%fp8
AtlasCloud$1.26$3.96$0.23$0.56100.0%fp8
Alibaba$1.33$4.18$0.25$0.5999.0%fp8
Baidu$1.40$4.40$0.26$0.62100.0%fp8
GMICloud$1.40$4.40$0.26$0.62—fp8
Novita$1.38$4.40$0.26$0.62100.0%fp8
Venice$1.40$4.40$0.26$0.6297.5%fp8
Z.AI$1.40$4.40$0.26$0.6299.7%fp8
SiliconFlow$1.19$3.74$0.60$0.8399.9%fp8