SShogo Bench

GPT-4.1 mini

Affordable GPT-4.1 lane for fast coding help and structured extraction

Shogo Agent Index

Unranked

Not ranked yet: 0 agentic benchmarks measured, and we need at least 2 plus an overall capability score. It will be ranked as results are published.

Agentic coding
17
estimated
Long-horizon autonomy
27
estimated
Knowledge-work agents
16
estimated
Computer use
6
estimated
Security & context learning
15
estimated

Price

Input
$0.36/M
Output
$1.45/M
Cache read
$0.091/M
3:1 blend
$0.64/M
Agent-effective
$0.19/M

Cheapest host for agents: Azure at $0.21/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verifiedest.8%predicted 49
Terminal-Bench 2.0est.8%predicted 8
DeepSWEest.6%predicted 9
FrontierSWEest.5%predicted 1
CursorBenchest.4%predicted 17
GSO-Benchest.4%predicted 2
METR Time Horizonsest.10%predicted 49
Vending-Bench 2est.6%predicted 2
PostTrainBenchest.4%predicted 11
APEX-Agentsest.8%predicted 10
GDPvalest.7%predicted 16
Remote Labor Indexest.5%predicted 0
DeepResearch Benchest.5%predicted 41
OSWorld 2.0est.6%predicted 0
OSWorldest.4%predicted 14
Cybenchest.5%predicted 19
CL-benchest.5%predicted 12

Other benchmarks

BenchmarkCategoryScoreSource
Aider PolyglotCoding32.4%source
ARC-AGIReasoning3.5%source
ARC-AGI-2Reasoning0.0%source
Chess PuzzlesReasoning1.0%source
CritPtReasoning0.0%source
DTBenchKnowledge68.8%source
Fiction.LiveBenchLong context44.4%source
FrontierMath Tiers 1-3Math6.7%source
GPQA DiamondReasoning65.8%source
LMCAKnowledge21.1%source
MATH Level 5Math87.3%source
OTIS Mock AIMEMath44.7%source
SciCodeCoding40.4%source
SimpleQA VerifiedKnowledge12.7%source

API hosts

Live prices and uptime for every host serving GPT-4.1 mini via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
Azure$0.40$1.60$0.10$0.21100.0%—
OpenAI$0.40$1.60$0.10$0.21100.0%—