~ same prompt, different LLM — every model gets the same brief in Blender, you judge the render ~
Google / Gemini 3.8 Flash / thinking:medium has entered the arena NEW!
B-BENCH — RUN LOG neogeo / eindhoven — node 03
INTERNAL — NOT FOR RELEASE
163 RUNS — 24 TASKS — 26 CONTESTANTS
163Runs
$55.86Total cost
$0.34Mean cost
451sMean time
26Mean calls
RUNDATETASKPROMPTCONTESTANTSTATUSDONECOSTTIMECALLSVOTES W-L-T
r1 · 2026-09-072026-09-07robotic-armv3Google / Gemini 3.8 Flash / thinking:mediumok✗$0.04104s—1-24-0
r1 · 2026-09-072026-09-07cabin-pondv1Google / Gemini 3.8 Flash / thinking:mediumok✗$0.06126s—0-0-0
r1 · 2026-09-072026-09-07abandoned-villagev1Google / Gemini 3.8 Flash / thinking:mediumok✗$0.05122s—0-0-0
r1 · 2026-09-072026-09-07spectral-scannerv1OpenAI / GPT 5.6 Lunaok✗$0.01104s—0-0-0
r1 · 2026-09-072026-09-07robotic-armv3OpenAI / GPT 6 Astra / thinking:mediumok✓$0.93357s1020-4-0
r1 · 2026-09-072026-09-07cabin-pondv1OpenAI / GPT 6 Astra / thinking:mediumok✓$1.54432s1624-0-1
r1 · 2026-09-062026-09-06reaction-diffusion-relicv3OpenAI / GPT 6 Astra / thinking:mediumok✗$0.74579s—26-0-0
r1 · 2026-09-062026-09-06plaster-bustv2OpenAI / GPT 6 Astra / thinking:mediumok✗$0.69290s—15-1-0
r1 · 2026-09-062026-09-06worn-bootv2OpenAI / GPT 6 Astra / thinking:mediumok✗$0.66277s—25-0-0
r1 · 2026-09-062026-09-06spaceshipv3OpenAI / GPT 6 Astra / thinking:mediumok✗$0.70441s—24-1-1
r1 · 2026-09-062026-09-06light-through-glassv2OpenAI / GPT 6 Astra / thinking:mediumok✗$0.48336s—24-0-0
r1 · 2026-09-062026-09-06camp-lanternv1OpenAI / GPT 6 Astra / thinking:mediumok✗$0.33195s—24-1-0
r2 · 2026-09-062026-09-06ravensthwaite-terminalv3OpenAI / GPT 6 Astra / thinking:maxok✗$2.971747s—24-0-0
r1 · 2026-09-052026-09-05abandoned-villagev1Anthropic / Claude Fable 5.1 / thinking:mediumok✓$2.951368s—9-16-1
r1 · 2026-09-052026-09-05space-cowboy-duelv2OpenAI / GPT 6 Astra / thinking:mediumok✗$0.99495s—23-0-0
r1 · 2026-09-052026-09-05shrine-vending-machinev2OpenAI / GPT 6 Astra / thinking:mediumok✗$0.65277s—20-2-3
r1 · 2026-09-052026-09-05corgi-beach-ballv2OpenAI / GPT 6 Astra / thinking:mediumok✗$0.57260s—19-2-2
r1 · 2026-09-052026-09-05cg-still-lifev2OpenAI / GPT 6 Astra / thinking:mediumok✗$0.57296s—20-5-0
r1 · 2026-09-052026-09-05robotic-armv3OpenAI / GPT 6 Astra / thinking:mediumok✗$0.52198s—23-1-2
r1 · 2026-09-052026-09-05goldfishv1OpenAI / GPT 6 Astra / thinking:mediumok✗$0.51198s—20-4-2
r1 · 2026-09-052026-09-05cabin-pondv1OpenAI / GPT 6 Astra / thinking:mediumok✗$0.57333s—26-0-0
r1 · 2026-09-052026-09-05abandoned-villagev1OpenAI / GPT 6 Astra / thinking:mediumok✗$0.67598s—24-1-1
r2 · 2026-08-252026-08-25goldfishv1Ox Alpha / thinking:lowmodel_error✗$0.001035s130-0-0
r1 · 2026-08-252026-08-25goldfishv1Ox Alpha / thinking:lowmodel_error✗$0.00785s220-0-0
r1 · 2026-08-252026-08-25cabin-pondv1Ox Alpha / thinking:maxok✗$0.001905s201-20-0
r1 · 2026-07-312026-07-31worn-bootv2OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.04524s1314-9-0
r1 · 2026-07-312026-07-31wave-gridv1OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.042174s330-0-0
r1 · 2026-07-312026-07-31spaceshipv3OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.04677s319-12-2
r1 · 2026-07-312026-07-31space-cowboy-duelv2OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.07827s2910-11-0
r1 · 2026-07-312026-07-31smoke-cubev1OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.0093s35-0-18
r1 · 2026-07-312026-07-31shrine-vending-machinev2OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.04565s342-20-3
r1 · 2026-07-312026-07-31robotic-armv3OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.02494s1211-14-0
r1 · 2026-07-312026-07-31red-ballv1OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.01271s86-4-14
r1 · 2026-07-312026-07-31reaction-diffusion-relicv3OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.04818s1711-12-0
r1 · 2026-07-312026-07-31ramen-samuraiv2OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.09972s335-9-0
r1 · 2026-07-312026-07-31punched-cubev1OpenAI / GPT 5.6 Luna / thinking:maxok✗$0.01263s100-22-2
r1 · 2026-07-312026-07-31plaster-bustv2OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.04610s2013-2-1
r1 · 2026-07-312026-07-31param-towerv1OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.042245s4617-2-0
r1 · 2026-07-312026-07-31light-through-glassv2OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.06838s4711-8-1
r1 · 2026-07-312026-07-31goldfishv1OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.03427s2123-0-0
r1 · 2026-07-312026-07-31cg-still-lifev2OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.05581s3021-3-1
r1 · 2026-07-312026-07-31camp-lanternv1OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.03367s270-0-0
r1 · 2026-07-312026-07-31abandoned-villagev1OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.02299s1523-2-0
r1 · 2026-07-312026-07-31cabin-pondv1DeepSeek / Deepseek V4 Flash 0731 / thinking:maxok✗$0.051866s752-17-0
r1 · 2026-07-312026-07-31red-ballv1DeepSeek / Deepseek V4 Flash 0731 / thinking:maxok✓$0.01404s—4-6-14
r2 · 2026-07-312026-07-31robotic-armv3DeepSeek / Deepseek V4 Flash 0731 / thinking:maxok✗$0.01554s—0-0-0
r2 · 2026-07-312026-07-31goldfishv1DeepSeek / Deepseek V4 Flash 0731 / thinking:maxok✗$0.01492s—0-0-0
r2 · 2026-07-312026-07-31cabin-pondv1DeepSeek / Deepseek V4 Flash 0731 / thinking:maxok✗$0.01295s—0-0-0
r2 · 2026-07-312026-07-31abandoned-villagev1DeepSeek / Deepseek V4 Flash 0731 / thinking:maxok✗$0.02567s—0-17-0
r1 · 2026-07-272026-07-27robotic-armv3Anthropic / Claude Fable 5 / thinking:mediumok✓$1.17342s—4-18-0
r1 · 2026-07-262026-07-26cabin-pondv1OpenAI / GPT 5.6 Sol / thinking:mediumok✓$0.36158s818-7-0
r1 · 2026-07-262026-07-26robotic-armv3OpenAI / GPT 5.6 Sol / thinking:mediumok✗$0.26178s—15-9-1
r1 · 2026-07-262026-07-26cabin-pondv1Anthropic / Opus 5 / thinking:mediumok✗$4.971881s7421-4-0
r1 · 2026-07-262026-07-26robotic-armv3Anthropic / Opus 5 / thinking:mediumok✓$1.13590s—18-3-4
r1 · 2026-07-262026-07-26goldfishv1Anthropic / Opus 5 / thinking:mediumok✓$0.91490s—15-6-4
r1 · 2026-07-262026-07-26cabin-pondv1Anthropic / Opus 5 / thinking:mediumok✓$0.80852s—4-18-3
r1 · 2026-07-262026-07-26abandoned-villagev1Anthropic / Opus 5 / thinking:mediumok✓$1.07543s—23-3-0
r1 · 2026-07-212026-07-21camp-lanternv1Google / Gemini 3.6 Flash / thinking:mediumok✗$0.19133s—0-0-0
r1 · 2026-07-212026-07-21abandoned-villagev1Google / Gemini 3.6 Flash / thinking:mediumok✗$0.20152s—8-13-0
r1 · 2026-07-192026-07-19goldfishv1OpenAI / GPT 5.6 Sol / thinking:maxok✓$1.39943s—21-2-2
r1 · 2026-07-192026-07-19cg-still-lifev2OpenAI / GPT 5.6 Sol / thinking:maxok✓$1.84980s—22-4-0
r1 · 2026-07-192026-07-19camp-lanternv1OpenAI / GPT 5.6 Sol / thinking:maxok✓$1.50842s—16-6-3
r1 · 2026-07-192026-07-19abandoned-villagev1OpenAI / GPT 5.6 Sol / thinking:maxok✗$1.431041s—14-7-0
r1 · 2026-07-192026-07-19worn-bootv2Google / Gemma 4 31b Itok✓$0.00129s—1-0-0
r1 · 2026-07-192026-07-19ravensthwaite-terminalv3Google / Gemma 4 31b Itok✓$0.00286s—0-0-0
r1 · 2026-07-192026-07-19plaster-bustv2Google / Gemma 4 31b Itok✓$0.0071s—6-8-0
r1 · 2026-07-192026-07-19light-through-glassv2Google / Gemma 4 31b Itok✗$0.00253s—5-18-0
r1 · 2026-07-192026-07-19cg-still-lifev2Google / Gemma 4 31b Itok✗$0.00173s—1-19-0
r1 · 2026-07-192026-07-19camp-lanternv1Google / Gemma 4 31b Itok✗$0.00152s—0-25-1
r1 · 2026-07-192026-07-19abandoned-villagev1Google / Gemma 4 31b Itok✓$0.00120s—1-1-0
r1 · 2026-07-192026-07-19worn-bootv2Google / Gemini 3.5 Flash / thinking:mediumok✗$0.29211s—0-1-0
r1 · 2026-07-192026-07-19ravensthwaite-terminalv3Google / Gemini 3.5 Flash / thinking:mediumok✗$0.16147s—0-1-0
r1 · 2026-07-192026-07-19plaster-bustv2Google / Gemini 3.5 Flash / thinking:mediumok✗$0.22174s—0-1-0
r1 · 2026-07-192026-07-19light-through-glassv2Google / Gemini 3.5 Flash / thinking:mediumok✗$0.26179s—0-22-0
r1 · 2026-07-192026-07-19goldfishv1Google / Gemini 3.5 Flash / thinking:mediumok✗$0.23150s—0-2-0
r1 · 2026-07-192026-07-19corgi-beach-ballv2Google / Gemini 3.5 Flash / thinking:mediumok✗$0.16145s—0-1-0
r1 · 2026-07-192026-07-19camp-lanternv1Google / Gemini 3.5 Flash / thinking:mediumok✗$0.22170s—7-17-1
r1 · 2026-07-192026-07-19abandoned-villagev1Google / Gemini 3.5 Flash / thinking:mediumok✗$0.24151s—0-1-0
r1 · 2026-07-192026-07-19worn-bootv2DeepSeek / Deepseek V4 Flashok✗$0.00167s—0-20-0
r1 · 2026-07-192026-07-19ravensthwaite-terminalv3DeepSeek / Deepseek V4 Flashok✗$0.00392s—0-1-0
r1 · 2026-07-192026-07-19plaster-bustv2DeepSeek / Deepseek V4 Flashok✗$0.00111s—0-9-0
r1 · 2026-07-192026-07-19light-through-glassv2DeepSeek / Deepseek V4 Flashok✗$0.00216s—0-0-0
r1 · 2026-07-192026-07-19goldfishv1DeepSeek / Deepseek V4 Flashok✗$0.00129s—0-22-0
r1 · 2026-07-192026-07-19cg-still-lifev2DeepSeek / Deepseek V4 Flashok✗$0.00122s—0-18-0
r1 · 2026-07-192026-07-19camp-lanternv1DeepSeek / Deepseek V4 Flashok✓$0.01449s—9-14-2
r1 · 2026-07-192026-07-19abandoned-villagev1DeepSeek / Deepseek V4 Flashok✗$0.00125s—1-19-0
r1 · 2026-07-192026-07-19worn-bootv2Anthropic / Sonnet 5 / thinking:lowok✓$0.11129s—4-16-0
r1 · 2026-07-192026-07-19plaster-bustv2Anthropic / Sonnet 5 / thinking:lowok✗$0.12158s—1-10-0
r1 · 2026-07-192026-07-19light-through-glassv2Anthropic / Sonnet 5 / thinking:lowok✗$0.10109s—0-2-0
r1 · 2026-07-192026-07-19goldfishv1Anthropic / Sonnet 5 / thinking:lowok✗$0.0797s—2-20-0
r1 · 2026-07-192026-07-19cg-still-lifev2Anthropic / Sonnet 5 / thinking:lowok✗$0.08100s—0-2-0
r1 · 2026-07-192026-07-19camp-lanternv1Anthropic / Sonnet 5 / thinking:lowok✗$0.0482s—0-3-0
r1 · 2026-07-192026-07-19abandoned-villagev1Anthropic / Sonnet 5 / thinking:lowok✓$0.08161s—8-11-0
r1 · 2026-07-172026-07-17worn-bootv2OpenAI / GPT 5.6 Lunaok✗$0.0376s—12-10-0
r1 · 2026-07-172026-07-17text-assemblyv1OpenAI / GPT 5.6 Lunaok✗$0.04300s—0-0-0
r1 · 2026-07-172026-07-17spaceshipv3OpenAI / GPT 5.6 Lunaok✗$0.0386s—2-22-1
r1 · 2026-07-172026-07-17space-cowboy-duelv2OpenAI / GPT 5.6 Lunaok✗$0.0480s—0-22-0
r1 · 2026-07-172026-07-17smoke-cubev1OpenAI / GPT 5.6 Lunaok✗$0.0153s—1-8-12
r1 · 2026-07-172026-07-17shrine-vending-machinev2OpenAI / GPT 5.6 Lunaok✗$0.0370s—0-0-0
r1 · 2026-07-172026-07-17reaction-diffusion-relicv3OpenAI / GPT 5.6 Lunaok✗$0.0479s—0-25-0
r1 · 2026-07-172026-07-17ravensthwaite-terminalv3OpenAI / GPT 5.6 Lunaok✗$0.0383s—2-24-0
r1 · 2026-07-172026-07-17ramen-samuraiv2OpenAI / GPT 5.6 Lunaok✗$0.0479s—9-5-0
r1 · 2026-07-172026-07-17punched-cubev1OpenAI / GPT 5.6 Lunaok✓$0.0271s—22-0-2
r1 · 2026-07-172026-07-17param-towerv1OpenAI / GPT 5.6 Lunaok✗$0.0373s—2-17-0
r1 · 2026-07-172026-07-17light-through-glassv2OpenAI / GPT 5.6 Lunaok✗$0.0485s—19-6-0
r1 · 2026-07-172026-07-17corgi-beach-ballv2OpenAI / GPT 5.6 Lunaok✓$0.0367s—5-19-2
r1 · 2026-07-172026-07-17cg-still-lifev2OpenAI / GPT 5.6 Lunaok✗$0.0474s—15-11-0
r1 · 2026-07-172026-07-17camp-lanternv1OpenAI / GPT 5.6 Lunaok✗$0.0266s—18-6-1
r1 · 2026-07-172026-07-17cabin-pondv1OpenAI / GPT 5.6 Lunaok✗$0.0370s—7-15-3
r1 · 2026-07-172026-07-17abandoned-villagev1OpenAI / GPT 5.6 Lunaok✗$0.0369s—0-2-0
r1 · 2026-07-172026-07-17robotic-armv3OpenAI / GPT 5.6 Lunaok✓$0.0394s31-20-0
r1 · 2026-07-172026-07-17robotic-armv3Moonshot AI / Kimi K3 / thinking:maxok✓$0.892222s—12-8-1
r1 · 2026-07-172026-07-17robotic-armv3OpenAI / GPT 5.6 Lunaok✗$0.0389s—10-14-0
r1 · 2026-07-172026-07-17cg-still-lifev2Anthropic / Sonnet 5ok✗$1.122050s780-24-0
r1 · 2026-07-172026-07-17cg-still-lifev2Moonshot AI / Kimi K3 / thinking:maxmodel_error✗$0.671628s110-0-0
r1 · 2026-07-172026-07-17cg-still-lifev2OpenAI / GPT 5.6 Terraok✓$0.10102s614-10-2
r1 · 2026-07-172026-07-17cg-still-lifev2OpenAI / GPT 5.6 Solok✓$0.41190s818-6-2
r1 · 2026-07-172026-07-17cg-still-lifev2OpenAI / GPT 5.6 Lunaok✓$0.0491s511-13-0
r1 · 2026-07-172026-07-17cg-still-lifev2Z.AI / GLM 5.2model_error✗$0.561821s700-0-0
r2 · 2026-07-172026-07-17plaster-bustv2OpenAI / GPT 5.6 Lunaok✗$0.0364s—0-1-0
r1 · 2026-07-172026-07-17plaster-bustv2OpenAI / GPT 5.6 Lunaok✓$0.0593s517-5-0
r1 · 2026-07-162026-07-16cabin-pondv1OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.25307s920-5-1
r1 · 2026-07-162026-07-16goldfishv1OpenAI / GPT 5.6 Lunaok✗$0.0376s—13-13-0
r1 · 2026-07-162026-07-16cabin-pondv1Moonshot AI / Kimi K3 / thinking:maxmodel_error✗—1185s—0-0-0
r1 · 2026-07-162026-07-16plaster-bustv2Anthropic / Sonnet 5ok✗$0.981903s720-19-0
r1 · 2026-07-162026-07-16plaster-bustv2OpenAI / GPT 5.6 Lunaok✓$0.04101s59-5-1
r1 · 2026-07-162026-07-16light-through-glassv2OpenAI / GPT 5.6 Lunaok✓$0.0697s69-12-1
r1 · 2026-07-162026-07-16goldfishv1OpenAI / GPT 5.6 Lunaok✓$0.04106s51-25-0
r1 · 2026-07-162026-07-16curl-flowv1OpenAI / GPT 5.6 Lunaok✓$0.05641s60-0-0
r1 · 2026-07-162026-07-16cg-still-lifev2OpenAI / GPT 5.6 Lunaok✓$0.05115s58-14-3
r1 · 2026-07-162026-07-16camp-lanternv1OpenAI / GPT 5.6 Lunaok✓$0.0497s515-6-1
r2 · 2026-07-162026-07-16corgi-beach-ballv2OpenAI / GPT 5.6 Lunaok✓$0.04129s519-2-1
r1 · 2026-07-152026-07-15corgi-beach-ballv2OpenAI / GPT 5.6 Luna / thinking:maxok✓$0.28350s1618-3-1
r1 · 2026-07-152026-07-15corgi-beach-ballv2OpenAI / GPT 5.6 Solok✓$0.45196s1018-0-1
r1 · 2026-07-152026-07-15corgi-beach-ballv2OpenAI / GPT 5.6 Lunaok✓$0.0382s417-4-0
r1 · 2026-07-152026-07-15abandoned-villagev1OpenAI / GPT 5.6 Lunaok✓$0.05103s513-8-0
r1 · 2026-07-152026-07-15corgi-beach-ballv1Z.AI / GLM 5.2ok✗$1.001836s911-14-0
r1 · 2026-07-152026-07-15camp-lanternv1Z.AI / GLM 5.2ok✓$0.17511s3511-11-1
r1 · 2026-07-152026-07-15abandoned-villagev1Z.AI / GLM 5.2ok✓$0.18703s2915-3-0
r1 · 2026-07-152026-07-15corgi-beach-ballv1Google / Gemma 4 31b Itok✓$0.03377s62-15-0
r1 · 2026-07-152026-07-15camp-lanternv1Google / Gemma 4 31b Itok✓$0.03277s82-17-1
r1 · 2026-07-152026-07-15abandoned-villagev1Google / Gemma 4 31b Itok✓$0.04148s91-13-0
r1 · 2026-07-152026-07-15corgi-beach-ballv1Google / Gemini 3.5 Flash / thinking:mediumok✓$2.02709s527-5-0
r1 · 2026-07-152026-07-15camp-lanternv1Google / Gemini 3.5 Flash / thinking:mediumok✗$0.74282s3322-3-1
r1 · 2026-07-152026-07-15abandoned-villagev1Google / Gemini 3.5 Flash / thinking:mediumok✓$2.08562s3116-5-0
r1 · 2026-07-152026-07-15corgi-beach-ballv1Google / Gemini 3.1 Flash Liteok✓$0.0186s100-16-0
r1 · 2026-07-152026-07-15camp-lanternv1Google / Gemini 3.1 Flash Liteok✓$0.02114s150-21-0
r1 · 2026-07-152026-07-15abandoned-villagev1Google / Gemini 3.1 Flash Liteok✓$0.0291s123-12-0
r1 · 2026-07-152026-07-15corgi-beach-ballv1DeepSeek / Deepseek V4 Prook✓$0.201488s585-11-0
r1 · 2026-07-152026-07-15camp-lanternv1DeepSeek / Deepseek V4 Prook✓$0.06491s3319-5-0
r1 · 2026-07-152026-07-15abandoned-villagev1DeepSeek / Deepseek V4 Prook✓$0.15790s402-7-1
r1 · 2026-07-152026-07-15corgi-beach-ballv1DeepSeek / Deepseek V4 Flashok✓$0.201175s745-8-0
r1 · 2026-07-152026-07-15camp-lanternv1DeepSeek / Deepseek V4 Flashok✓$0.07585s4911-9-0
r1 · 2026-07-152026-07-15abandoned-villagev1DeepSeek / Deepseek V4 Flashok✓$0.03521s291-14-0
r1 · 2026-07-152026-07-15corgi-beach-ballv1Anthropic / Haiku 4.5 / thinking:xhighok✓$0.771114s970-16-1
r1 · 2026-07-152026-07-15camp-lanternv1Anthropic / Haiku 4.5 / thinking:xhighok✗$0.28391s604-14-0
r1 · 2026-07-152026-07-15abandoned-villagev1Anthropic / Haiku 4.5 / thinking:xhighok✓$0.20352s343-10-1
r1 · 2026-07-152026-07-15smoke-cubev1OpenAI / GPT 5.6 Lunaok✓$0.0243s45-3-16
r1 · 2026-07-142026-07-14cabin-pondv1Anthropic / Sonnet 5 / thinking:lowok✓$0.34294s380-15-0
r1 · 2026-07-142026-07-14cabin-pondv1Z.AI / GLM 5.2ok✓$0.09303s161-17-0
r1 · 2026-07-142026-07-14cabin-pondv1OpenAI / GPT 5.6 Terraok✓$0.1162s514-12-0
r1 · 2026-07-142026-07-14cabin-pondv1Anthropic / Sonnet 5ok✗$2.48467s5011-13-0
r1 · 2026-07-142026-07-14cabin-pondv1OpenAI / GPT 5.6 Lunaok✓$0.0438s59-15-0
ARCHIVE — 27 RETIRED RUNS (superseded prompt versions — excluded from ranks & voting)
RUNDATETASKCONTESTANTSTATUSREASON
r1 · 2026-07-172026-07-17red-ballOpenAI / GPT 5.6 LunaokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-162026-07-16red-ballMoonshot AI / Kimi K3 / thinking:maxokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15robotic-armZ.AI / GLM 5.2abortedARCHIVEDaborted mid-run (v2 wave, no metrics)
r1 · 2026-07-152026-07-15robotic-armGoogle / Gemma 4 31b ItokARCHIVEDprompt v2 — superseded by v3
r1 · 2026-07-152026-07-15robotic-armGoogle / Gemini 3.5 Flash / thinking:mediumokARCHIVEDprompt v2 — superseded by v3
r1 · 2026-07-152026-07-15robotic-armGoogle / Gemini 3.1 Flash LiteokARCHIVEDprompt v2 — superseded by v3
r1 · 2026-07-152026-07-15robotic-armDeepSeek / Deepseek V4 ProokARCHIVEDprompt v2 — superseded by v3
r1 · 2026-07-152026-07-15robotic-armDeepSeek / Deepseek V4 FlashokARCHIVEDprompt v2 — superseded by v3
r1 · 2026-07-152026-07-15robotic-armAnthropic / Haiku 4.5 / thinking:xhighokARCHIVEDprompt v2 — superseded by v3
r1 · 2026-07-152026-07-15red-ballAnthropic / Sonnet 5 / thinking:lowokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballAnthropic / Sonnet 5 / thinking:highokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballAnthropic / Sonnet 5okARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballAnthropic / Sonnet 5okARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballOpenAI / GPT 5.6 TerraokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballOpenAI / GPT 5.6 SolokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballOpenAI / GPT 5.6 Luna / thinking:maxokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballOpenAI / GPT 5.6 LunaokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballOpenAI / GPT 5.6 LunaokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballZ.AI / GLM 5.2okARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballGoogle / Gemma 4 31b ItokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballGoogle / Gemini 3.5 Flash / thinking:mediumokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballGoogle / Gemini 3.1 Flash LiteokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballDeepSeek / Deepseek V4 ProokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballDeepSeek / Deepseek V4 FlashokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballAnthropic / Opus 4.8 / thinking:mediumokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballAnthropic / Haiku 4.5 / thinking:xhighokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
r1 · 2026-07-152026-07-15red-ballAnthropic / Claude Fable 5 / thinking:mediumokARCHIVEDsmoke-test scene — capability sanity check, not part of the benchmark
> select a run to inspect
Votes cast on this bench: 001671 · 163 runs · 26 contestants
Best viewed with Netscape Navigator 4.07 at 800×600 · real runs, live ratings