~ same prompt, different LLM — every model gets the same brief in Blender, you judge the render ~
Google / Gemini 3.8 Flash / thinking:medium has entered the arena NEW!
LeaderboardGalleryVoteRunsTasks
RankContestantRatingVotesRunsDone %Success %Avg $Avg callsAvg time
1OpenAI / GPT 6 Astra / thinking:mediumcompare →1995412100100$1.2313394s
2Anthropic / Opus 5 / thinking:mediumcompare →18602410100$4.97741881s
3OpenAI / GPT 5.6 Luna / thinking:maxcompare →18131692095100$0.0623685s
4OpenAI / GPT 5.6 Solcompare →1776412100100$0.439193s
5OpenAI / GPT 5.6 Sol / thinking:mediumcompare →1770241100100$0.368158s
6OpenAI / GPT 5.6 Terracompare →1662462100100$0.10682s
7OpenAI / GPT 5.6 Lunacompare →160520512100100$0.045137s
8Google / Gemini 3.5 Flash / thinking:mediumcompare →159056367100$1.6139517s
9Anthropic / Sonnet 5compare →14146230100$1.53671473s
10DeepSeek / Deepseek V4 Procompare →1408473100100$0.1444923s
11Ox Alpha / thinking:maxcompare →14061710100$0.00201905s
12Z.AI / GLM 5.2compare →14037256080$0.40481035s
13DeepSeek / Deepseek V4 Flash 0731 / thinking:maxcompare →13801910100$0.05751866s
14Anthropic / Sonnet 5 / thinking:lowcompare →1337151100100$0.3438294s
15DeepSeek / Deepseek V4 Flashcompare →1252473100100$0.1051761s
16Anthropic / Haiku 4.5 / thinking:xhighcompare →120246367100$0.4264619s
17Google / Gemma 4 31b Itcompare →1096473100100$0.038267s
18Google / Gemini 3.1 Flash Litecompare →1031483100100$0.021297s
provOx Alpha / thinking:lowcompare →—0200$0.0018910s
provMoonshot AI / Kimi K3 / thinking:maxcompare →—0200$0.67111406s

Model comparison

each point is a model (Full, all scenes) — hover for exact values
AnthropicDeepSeekGoogleMoonshot AIOpenAIOtherZ.AI unrated
8861200151318262140$0.011$0.055$0.288$1.50$7.83Bradley–Terry ratingUNRATED — no decisive votes yetMean cost per task (USD, log scale)

By dimension

separate Bradley–Terry fits from lens rounds + chip verdicts
Lighting
provOpenAI / GPT 5.6 Sol1739
provOpenAI / GPT 5.6 Luna / thinking:max1548
provOpenAI / GPT 5.6 Terra1357
provOpenAI / GPT 5.6 Luna1357
Composition
provOpenAI / GPT 5.6 Sol1739
provOpenAI / GPT 5.6 Luna / thinking:max1548
provOpenAI / GPT 5.6 Terra1357
provOpenAI / GPT 5.6 Luna1357
Modeling
provOpenAI / GPT 5.6 Luna / thinking:max1643
provOpenAI / GPT 5.6 Terra1452
provOpenAI / GPT 5.6 Sol1452
provOpenAI / GPT 5.6 Luna1452
Materials
provOpenAI / GPT 5.6 Luna / thinking:max1595
provOpenAI / GPT 5.6 Sol1595
provOpenAI / GPT 5.6 Terra1405
provOpenAI / GPT 5.6 Luna1405
Render
provOpenAI / GPT 5.6 Sol1739
provOpenAI / GPT 5.6 Luna / thinking:max1548
provOpenAI / GPT 5.6 Terra1357
provOpenAI / GPT 5.6 Luna1357
Adherence
provOpenAI / GPT 5.6 Luna / thinking:max1548
provOpenAI / GPT 5.6 Terra1548
provOpenAI / GPT 5.6 Sol1548
provOpenAI / GPT 5.6 Luna1357

Modes compared

each contestant's ratings across run modes (mixed ladder)
ContestantFullOne-shot3D-only
Anthropic / Claude Fable 5.1 / thinking:medium—1688—
Anthropic / Claude Fable 5 / thinking:medium—1523—
DeepSeek / Deepseek V4 Flash12121217—
DeepSeek / Deepseek V4 Flash 0731 / thinking:max12671460—
DeepSeek / Deepseek V4 Pro1365——
Google / Gemini 3.1 Flash Lite1026——
Google / Gemini 3.5 Flash / thinking:medium15131175—
Google / Gemini 3.6 Flash / thinking:medium—1538—
Google / Gemini 3.8 Flash / thinking:medium—1432—
Google / Gemma 4 31b It10861260—
Z.AI / GLM 5.21334——
OpenAI / GPT 5.6 Luna150815841520
OpenAI / GPT 5.6 Luna / thinking:max1663——
OpenAI / GPT 5.6 Sol1670——
OpenAI / GPT 5.6 Sol / thinking:max—1786—
OpenAI / GPT 5.6 Sol / thinking:medium16771732—
OpenAI / GPT 5.6 Terra1537——
OpenAI / GPT 6 Astra / thinking:max—2260—
OpenAI / GPT 6 Astra / thinking:medium18661999—
Anthropic / Haiku 4.5 / thinking:xhigh1162——
Moonshot AI / Kimi K3 / thinking:max—1714—
Anthropic / Opus 5 / thinking:medium17611763—
Ox Alpha / thinking:low———
Ox Alpha / thinking:max1317——
Anthropic / Sonnet 51301——
Anthropic / Sonnet 5 / thinking:low12321351—
Vote A/BGalleryRunsbradley-terry fit over 513 decisive votes
Votes cast on this bench: 001671 · 163 runs · 26 contestants
Best viewed with Netscape Navigator 4.07 at 800×600 · real runs, live ratings