~ same prompt, different LLM — every model gets the same brief in Blender, you judge the render ~
Google / Gemini 3.8 Flash / thinking:medium has entered the arena NEW!
LeaderboardGalleryVoteRunsTasks
RankContestantRatingVotesRunsDone %Success %Avg $Avg callsAvg time
1OpenAI / GPT 6 Astra / thinking:mediumcompare →1875241100100$1.5416432s
2Anthropic / Opus 5 / thinking:mediumcompare →17412410100$4.97741881s
3OpenAI / GPT 5.6 Luna / thinking:maxcompare →1676251100100$0.259307s
4OpenAI / GPT 5.6 Sol / thinking:mediumcompare →1664241100100$0.368158s
5OpenAI / GPT 5.6 Terracompare →1535241100100$0.11562s
6Anthropic / Sonnet 5compare →14992410100$2.4850467s
7OpenAI / GPT 5.6 Lunacompare →1405241100100$0.04538s
8Ox Alpha / thinking:maxcompare →13251710100$0.00201905s
9DeepSeek / Deepseek V4 Flash 0731 / thinking:maxcompare →13031910100$0.05751866s
10Z.AI / GLM 5.2compare →1248181100100$0.0916303s
11Anthropic / Sonnet 5 / thinking:lowcompare →1229151100100$0.3438294s
provMoonshot AI / Kimi K3 / thinking:maxcompare →—0100——1185s

Model comparison

each point is a model (Full, cabin-pond) — hover for exact values
AnthropicDeepSeekMoonshot AIOpenAIOtherZ.AI unrated
11321342155217621972$0.025$0.102$0.425$1.77$7.36Bradley–Terry ratingMean cost per task (USD, log scale)
1 model without cost data omitted.

By dimension

separate Bradley–Terry fits from lens rounds + chip verdicts
Lighting
provOpenAI / GPT 5.6 Luna / thinking:max1595
provOpenAI / GPT 5.6 Terra1405
Composition
provOpenAI / GPT 5.6 Luna / thinking:max1595
provOpenAI / GPT 5.6 Terra1405
Modeling
provOpenAI / GPT 5.6 Luna / thinking:max1595
provOpenAI / GPT 5.6 Terra1405
Materials
provOpenAI / GPT 5.6 Luna / thinking:max1595
provOpenAI / GPT 5.6 Terra1405
Render
provOpenAI / GPT 5.6 Luna / thinking:max1595
provOpenAI / GPT 5.6 Terra1405
Adherence
provOpenAI / GPT 5.6 Luna / thinking:max1500
provOpenAI / GPT 5.6 Terra1500

Modes compared

each contestant's ratings across run modes (mixed ladder)
ContestantFullOne-shot3D-only
DeepSeek / Deepseek V4 Flash 0731 / thinking:max1248——
Google / Gemini 3.8 Flash / thinking:medium———
Z.AI / GLM 5.21195——
OpenAI / GPT 5.6 Luna13521553—
OpenAI / GPT 5.6 Luna / thinking:max1623——
OpenAI / GPT 5.6 Sol / thinking:medium1615——
OpenAI / GPT 5.6 Terra1468——
OpenAI / GPT 6 Astra / thinking:medium18242012—
Moonshot AI / Kimi K3 / thinking:max———
Anthropic / Opus 5 / thinking:medium16891507—
Ox Alpha / thinking:max1291——
Anthropic / Sonnet 51448——
Anthropic / Sonnet 5 / thinking:low1174——
Vote A/BGalleryRunsbradley-terry fit over 119 decisive votes
Votes cast on this bench: 001671 · 163 runs · 26 contestants
Best viewed with Netscape Navigator 4.07 at 800×600 · real runs, live ratings