SShogo Bench

Qwen3.8 27B

Dense 27B vision-language model for coding, agent tasks, and image and video understanding

Shogo Agent Index

Unranked

Not ranked yet: 1 agentic benchmark measured, and we need at least 2 plus an overall capability score. It will be ranked as results are published.

Agentic coding
47
estimated
Long-horizon autonomy
52
estimated
Knowledge-work agents
37
32% measured
Computer use
32
estimated
Security & context learning
45
estimated

Price

Input
$0.45/M
Output
$3.60/M
Cache read
$0.45/M
3:1 blend
$1.24/M
Agent-effective
$0.60/M

Cheapest host for agents: Chutes at $0.070/M.

Agent-effective = 20 input tokens per output token, 85% cache hits. Why.

Agentic benchmarks

BenchmarkScoreNormalisedIndex weightHarness / source
SWE-bench Verifiedest.8%predicted 75
Terminal-Bench 2.0est.8%predicted 64
DeepSWEest.6%predicted 43
FrontierSWEest.5%predicted 12
CursorBenchest.4%predicted 35
GSO-Benchest.4%predicted 22
METR Time Horizonsest.10%predicted 73
Vending-Bench 2est.6%predicted 38
PostTrainBenchest.4%predicted 23
APEX-Agents47.5%8%source
GDPvalest.7%predicted 43
Remote Labor Indexest.5%predicted 3
DeepResearch Benchest.5%predicted 47
OSWorld 2.0est.6%predicted 7
OSWorldest.4%predicted 70
Cybenchest.5%predicted 69
CL-benchest.5%predicted 21

Other benchmarks

BenchmarkCategoryScoreSource
ARC-AGIReasoning87.5%source
ARC-AGI-2Reasoning42.4%source
CritPtReasoning5.4%source
DTBenchKnowledge88.0%source
GeoBenchMultimodal38.0%source
LMCAKnowledge41.4%source
ProofBenchMath16.0%source
SciCodeCoding46.6%source
SimpleBenchReasoning60.2%source
WebDev ArenaCoding1593source

API hosts

Live prices and uptime for every host serving Qwen3.8 27B via OpenRouter.

HostInputOutputCache readAgent $/MUptime 24hQuant
Chutes$0.039$1.25$0.004$0.07097.6%fp8
Near AI$0.040$1.35$0.018$0.08099.9%fp8
Darkbloom$0.035$1.50$0.018$0.090100.0%fp4
StreamLake$0.17$1.05$0.035$0.10100.0%—
Ionstream$0.040$1.95$0.020$0.1199.5%fp8
Mancer 2$0.13$1.50$0.030$0.1198.6%fp8
Modal$0.040$2.30$0.020$0.13100.0%—
DeepInfra$0.15$1.88$0.037$0.1499.3%fp8
DekaLLM$0.040$2.50$0.020$0.1499.9%—
Tenstorrent$0.15$1.60$0.050$0.1499.9%fp8
Wafer$0.060$2.20$0.059$0.16100.0%fp8
AkashML$0.23$1.98$0.050$0.1798.5%fp8
Parasail$0.24$2.20$0.050$0.18100.0%fp8
Reka$0.15$2.50$0.050$0.18100.0%fp8
ModelRun$0.20$2.50$0.090$0.22100.0%fp4
Alibaba$0.42$2.55$0.085$0.25100.0%—
SiliconFlow$0.42$2.55$0.085$0.2597.8%fp8
Cloudflare$0.45$3.20$0.050$0.26100.0%—
PrimeIntellect$0.45$3.20$0.050$0.26100.0%fp8
Novita$0.42$3.00$0.085$0.27100.0%—
Nebius$0.45$3.00$0.10$0.29100.0%fp4
CoreWeave$0.40$3.00$0.15$0.3299.4%fp8
GMICloud$0.45$3.20$0.25$0.42100.0%fp8
Venice$0.45$3.20—$0.58100.0%fp8
Cerebras$0.99$1.49$0.99$1.0199.9%fp16