# Архив пеликанов на велосипедах

Интерфейс переведён на русский. Названия, описания, запросы и документы авторов сохранены на языке источника или в английской версии архива.
HF / OPENENV · REFERENCE ONLY
Scoring reference
An independent HuggingFace / OpenEnv scoring reference, excluded from the main timeline, collection and case total.
Upstream outputs, not a Pelican Map ranking
An independent HuggingFace / OpenEnv scoring reference, excluded from the main timeline, collection and case total.
Publisher
Sergio Paniego (@sergiopaniego)
Dataset
HuggingFace pelican-svg-drawings ↗
Environment
pelican-svg-env ↗
·
OpenEnv code ↗
License
Apache-2.0
·
Attribution
Fixed prompt
generate an SVG of a pelican riding a bicycle
Publication / run date
2026-07-29 / Not separately published; publication is not the run date
Pinned revision
548f58a232c4aadf05f4798c2d69b8bd95e4b502
Model labels follow the source and are not independently authenticated. Providers and sampling conditions differ; scores come from the upstream judge, not a Pelican Bicycle Archive capability assessment. 139 main-task rows, 138 viewable images and one failed row.
Upstream outputs, not a Pelican Map ranking · Alphabetical by model; failed rows remain in the denominator
Source model label
n
Mean reward
structure
semantic
Qwen/Qwen3.6-27B
20
0.870
1.000
0.800
claude-fable-5
20
0.844
1.000
0.760
claude-opus-5
20
0.868
1.000
0.797
gpt-5.6-sol
20
0.959
1.000
0.938
moonshotai/Kimi-K3
19
0.884
0.947
0.849
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4
20
0.814
0.986
0.722
zai-org/GLM-5.2
20
0.878
1.000
0.812
Task catalogue: 30 prompts (29 non-main tasks) →
·
JSON
Expand original samples by model
Search samples below
Model label
All models
Qwen/Qwen3.6-27B
claude-fable-5
claude-opus-5
gpt-5.6-sol
moonshotai/Kimi-K3
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4
zai-org/GLM-5.2
Поиск
Сбросить
139 rows · excluded from case count
Expand all
Collapse all
Qwen/Qwen3.6-27B
20 rows · 20 images
＋
Model summary and representative images →
Qwen__Qwen3.6-27B__pelican_bicycle__000
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on a road under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on a road under a sunny sky with clouds.",
  "latency": 96.22,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__000.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__000.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__001
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle under a blue sky with clouds and a sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 1,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a blue sky with clouds and a sun.",
  "latency": 68.88,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__001.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__001.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__002
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle while holding an orange basket in its beak, with a blue sky, sun, and clouds in the background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 2,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle while holding an orange basket in its beak, with a blue sky, sun, and clouds in the background.",
  "latency": 58.97,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__002.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__002.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 3,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a blue sky with clouds.",
  "latency": 104.52,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__003.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__003.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__004
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle on a road with clouds in the sky.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 4,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle on a road with clouds in the sky.",
  "latency": 68.36,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__004.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__004.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__005
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 5,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.",
  "latency": 72.08,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__005.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__005.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__006
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon stork is riding a red and black bicycle on a green road with a blue sky background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 6,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red and black bicycle on a green road with a blue sky background.",
  "latency": 116.07,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__006.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__006.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__007
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle under a sunny blue sky with clouds and grass below.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 7,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny blue sky with clouds and grass below.",
  "latency": 133.14,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__007.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__007.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__008
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird is riding a red bicycle with a basket on its back under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 8,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle with a basket on its back under a sunny sky with clouds.",
  "latency": 123.31,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__008.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__008.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__009
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 9,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.",
  "latency": 65.49,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__009.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__009.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__010
Upstream outputs, not a Pelican Map ranking · reward 0.454
A cartoon stork is riding a red bicycle under a sunny sky with clouds and grass below.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 10,
  "reward": 0.45381944444444444,
  "structure_score": 1.0,
  "semantic_score": 0.1597222222222222,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with clouds and grass below.",
  "latency": 120.04,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__010.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__010.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__011
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon stork is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 11,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle.",
  "latency": 105.54,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__011.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__011.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__012
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle on grass under a blue sky with clouds and a sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 12,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle on grass under a blue sky with clouds and a sun.",
  "latency": 97.27,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__012.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__012.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__013
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on a road under a blue sky with clouds and a sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 13,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on a road under a blue sky with clouds and a sun.",
  "latency": 62.11,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__013.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__013.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__014
Upstream outputs, not a Pelican Map ranking · reward 0.964
A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 14,
  "reward": 0.9638888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.9444444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.",
  "latency": 153.52,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__014.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__014.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__015
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle against a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 15,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle against a blue sky with clouds.",
  "latency": 147.49,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__015.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__015.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__016
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle under a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 16,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a blue sky with clouds.",
  "latency": 74.38,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__016.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__016.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__017
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle on a green ground with a blue sky and clouds in the background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 17,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle on a green ground with a blue sky and clouds in the background.",
  "latency": 114.38,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__017.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__017.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__018
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a red bicycle on grass under a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 18,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle on grass under a blue sky with clouds.",
  "latency": 63.14,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__018.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__018.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__019
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a red bicycle on a green line.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "Qwen/Qwen3.6-27B",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 19,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle on a green line.",
  "latency": 125.1,
  "svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__019.svg",
  "png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__019.png"
}
claude-fable-5
20 rows · 20 images
＋
Model summary and representative images →
claude-fable-5__pelican_bicycle__000
Upstream outputs, not a Pelican Map ranking · reward 0.801
A cartoon duck is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 24.25,
  "svg": "svg/claude-fable-5__pelican_bicycle__000.svg",
  "png": "png/claude-fable-5__pelican_bicycle__000.png"
}
claude-fable-5__pelican_bicycle__001
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a red bicycle under a yellow sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 1,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle under a yellow sun.",
  "latency": 22.41,
  "svg": "svg/claude-fable-5__pelican_bicycle__001.svg",
  "png": "png/claude-fable-5__pelican_bicycle__001.png"
}
claude-fable-5__pelican_bicycle__002
Upstream outputs, not a Pelican Map ranking · reward 0.883
A cartoon bird is riding a red bicycle while holding a yellow object in its beak.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 2,
  "reward": 0.8826388888888889,
  "structure_score": 1.0,
  "semantic_score": 0.8194444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle while holding a yellow object in its beak.",
  "latency": 23.06,
  "svg": "svg/claude-fable-5__pelican_bicycle__002.svg",
  "png": "png/claude-fable-5__pelican_bicycle__002.png"
}
claude-fable-5__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a red bicycle under a yellow sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 3,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle under a yellow sun.",
  "latency": 23.58,
  "svg": "svg/claude-fable-5__pelican_bicycle__003.svg",
  "png": "png/claude-fable-5__pelican_bicycle__003.png"
}
claude-fable-5__pelican_bicycle__004
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a red bicycle under a yellow sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 4,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle under a yellow sun.",
  "latency": 29.07,
  "svg": "svg/claude-fable-5__pelican_bicycle__004.svg",
  "png": "png/claude-fable-5__pelican_bicycle__004.png"
}
claude-fable-5__pelican_bicycle__005
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a red bicycle and holding a yellow ball in its beak.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 5,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle and holding a yellow ball in its beak.",
  "latency": 21.39,
  "svg": "svg/claude-fable-5__pelican_bicycle__005.svg",
  "png": "png/claude-fable-5__pelican_bicycle__005.png"
}
claude-fable-5__pelican_bicycle__006
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon duck is riding a red bicycle under a yellow sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 6,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle under a yellow sun.",
  "latency": 21.21,
  "svg": "svg/claude-fable-5__pelican_bicycle__006.svg",
  "png": "png/claude-fable-5__pelican_bicycle__006.png"
}
claude-fable-5__pelican_bicycle__007
Upstream outputs, not a Pelican Map ranking · reward 0.801
A cartoon duck is riding a red bicycle on a green surface against a light blue background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 7,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle on a green surface against a light blue background.",
  "latency": 23.51,
  "svg": "svg/claude-fable-5__pelican_bicycle__007.svg",
  "png": "png/claude-fable-5__pelican_bicycle__007.png"
}
claude-fable-5__pelican_bicycle__008
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 8,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 25.99,
  "svg": "svg/claude-fable-5__pelican_bicycle__008.svg",
  "png": "png/claude-fable-5__pelican_bicycle__008.png"
}
claude-fable-5__pelican_bicycle__009
Upstream outputs, not a Pelican Map ranking · reward 0.801
A cartoon duck is riding a red bicycle under a yellow sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 9,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle under a yellow sun.",
  "latency": 24.52,
  "svg": "svg/claude-fable-5__pelican_bicycle__009.svg",
  "png": "png/claude-fable-5__pelican_bicycle__009.png"
}
claude-fable-5__pelican_bicycle__010
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird is riding a red bicycle under a sunny sky.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 10,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle under a sunny sky.",
  "latency": 27.41,
  "svg": "svg/claude-fable-5__pelican_bicycle__010.svg",
  "png": "png/claude-fable-5__pelican_bicycle__010.png"
}
claude-fable-5__pelican_bicycle__011
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle under a sunny sky with a cloud and sun visible.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 11,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with a cloud and sun visible.",
  "latency": 25.02,
  "svg": "svg/claude-fable-5__pelican_bicycle__011.svg",
  "png": "png/claude-fable-5__pelican_bicycle__011.png"
}
claude-fable-5__pelican_bicycle__012
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 12,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle.",
  "latency": 24.18,
  "svg": "svg/claude-fable-5__pelican_bicycle__012.svg",
  "png": "png/claude-fable-5__pelican_bicycle__012.png"
}
claude-fable-5__pelican_bicycle__013
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon duck is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 13,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 24.2,
  "svg": "svg/claude-fable-5__pelican_bicycle__013.svg",
  "png": "png/claude-fable-5__pelican_bicycle__013.png"
}
claude-fable-5__pelican_bicycle__014
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 14,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle.",
  "latency": 23.77,
  "svg": "svg/claude-fable-5__pelican_bicycle__014.svg",
  "png": "png/claude-fable-5__pelican_bicycle__014.png"
}
claude-fable-5__pelican_bicycle__015
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle with a yellow sun in the background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 15,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle with a yellow sun in the background.",
  "latency": 24.83,
  "svg": "svg/claude-fable-5__pelican_bicycle__015.svg",
  "png": "png/claude-fable-5__pelican_bicycle__015.png"
}
claude-fable-5__pelican_bicycle__016
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird is riding a red bicycle under a yellow sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 16,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle under a yellow sun.",
  "latency": 22.24,
  "svg": "svg/claude-fable-5__pelican_bicycle__016.svg",
  "png": "png/claude-fable-5__pelican_bicycle__016.png"
}
claude-fable-5__pelican_bicycle__017
Upstream outputs, not a Pelican Map ranking · reward 0.847
A cartoon bird is riding a red bicycle under a yellow sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 17,
  "reward": 0.8465277777777778,
  "structure_score": 1.0,
  "semantic_score": 0.7638888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle under a yellow sun.",
  "latency": 24.78,
  "svg": "svg/claude-fable-5__pelican_bicycle__017.svg",
  "png": "png/claude-fable-5__pelican_bicycle__017.png"
}
claude-fable-5__pelican_bicycle__018
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon goose is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 18,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle.",
  "latency": 22.62,
  "svg": "svg/claude-fable-5__pelican_bicycle__018.svg",
  "png": "png/claude-fable-5__pelican_bicycle__018.png"
}
claude-fable-5__pelican_bicycle__019
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird is riding a red bicycle under a yellow sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 19,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle under a yellow sun.",
  "latency": 27.39,
  "svg": "svg/claude-fable-5__pelican_bicycle__019.svg",
  "png": "png/claude-fable-5__pelican_bicycle__019.png"
}
claude-opus-5
20 rows · 20 images
＋
Model summary and representative images →
claude-opus-5__pelican_bicycle__000
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a red bicycle on a green ground with a blue sky and clouds in the background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle on a green ground with a blue sky and clouds in the background.",
  "latency": 44.02,
  "svg": "svg/claude-opus-5__pelican_bicycle__000.svg",
  "png": "png/claude-opus-5__pelican_bicycle__000.png"
}
claude-opus-5__pelican_bicycle__001
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon goose with an orange beak and legs is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 1,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose with an orange beak and legs is riding a red bicycle.",
  "latency": 27.42,
  "svg": "svg/claude-opus-5__pelican_bicycle__001.svg",
  "png": "png/claude-opus-5__pelican_bicycle__001.png"
}
claude-opus-5__pelican_bicycle__002
Upstream outputs, not a Pelican Map ranking · reward 0.494
A cartoon pelican is riding a red and yellow bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 2,
  "reward": 0.4944444444444444,
  "structure_score": 1.0,
  "semantic_score": 0.2222222222222222,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red and yellow bicycle.",
  "latency": 43.9,
  "svg": "svg/claude-opus-5__pelican_bicycle__002.svg",
  "png": "png/claude-opus-5__pelican_bicycle__002.png"
}
claude-opus-5__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck wearing a red scarf is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 3,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck wearing a red scarf is riding a red bicycle.",
  "latency": 28.36,
  "svg": "svg/claude-opus-5__pelican_bicycle__003.svg",
  "png": "png/claude-opus-5__pelican_bicycle__003.png"
}
claude-opus-5__pelican_bicycle__004
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 4,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle.",
  "latency": 40.06,
  "svg": "svg/claude-opus-5__pelican_bicycle__004.svg",
  "png": "png/claude-opus-5__pelican_bicycle__004.png"
}
claude-opus-5__pelican_bicycle__005
Upstream outputs, not a Pelican Map ranking · reward 0.801
A cartoon goose is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 5,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle.",
  "latency": 47.29,
  "svg": "svg/claude-opus-5__pelican_bicycle__005.svg",
  "png": "png/claude-opus-5__pelican_bicycle__005.png"
}
claude-opus-5__pelican_bicycle__006
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a bicycle with its wings outstretched, and there is a yellow circle resembling the sun in the background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 6,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle with its wings outstretched, and there is a yellow circle resembling the sun in the background.",
  "latency": 51.91,
  "svg": "svg/claude-opus-5__pelican_bicycle__006.svg",
  "png": "png/claude-opus-5__pelican_bicycle__006.png"
}
claude-opus-5__pelican_bicycle__007
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 7,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle.",
  "latency": 43.12,
  "svg": "svg/claude-opus-5__pelican_bicycle__007.svg",
  "png": "png/claude-opus-5__pelican_bicycle__007.png"
}
claude-opus-5__pelican_bicycle__008
Upstream outputs, not a Pelican Map ranking · reward 0.883
A cartoon bird with an orange beak is riding a red bicycle against a light blue background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 8,
  "reward": 0.8826388888888889,
  "structure_score": 1.0,
  "semantic_score": 0.8194444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird with an orange beak is riding a red bicycle against a light blue background.",
  "latency": 25.03,
  "svg": "svg/claude-opus-5__pelican_bicycle__008.svg",
  "png": "png/claude-opus-5__pelican_bicycle__008.png"
}
claude-opus-5__pelican_bicycle__009
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 9,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle.",
  "latency": 36.72,
  "svg": "svg/claude-opus-5__pelican_bicycle__009.svg",
  "png": "png/claude-opus-5__pelican_bicycle__009.png"
}
claude-opus-5__pelican_bicycle__010
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 10,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle.",
  "latency": 35.34,
  "svg": "svg/claude-opus-5__pelican_bicycle__010.svg",
  "png": "png/claude-opus-5__pelican_bicycle__010.png"
}
claude-opus-5__pelican_bicycle__011
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 11,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 27.42,
  "svg": "svg/claude-opus-5__pelican_bicycle__011.svg",
  "png": "png/claude-opus-5__pelican_bicycle__011.png"
}
claude-opus-5__pelican_bicycle__012
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose with an orange beak is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 12,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose with an orange beak is riding a bicycle.",
  "latency": 23.64,
  "svg": "svg/claude-opus-5__pelican_bicycle__012.svg",
  "png": "png/claude-opus-5__pelican_bicycle__012.png"
}
claude-opus-5__pelican_bicycle__013
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 13,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 36.71,
  "svg": "svg/claude-opus-5__pelican_bicycle__013.svg",
  "png": "png/claude-opus-5__pelican_bicycle__013.png"
}
claude-opus-5__pelican_bicycle__014
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 14,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 36.04,
  "svg": "svg/claude-opus-5__pelican_bicycle__014.svg",
  "png": "png/claude-opus-5__pelican_bicycle__014.png"
}
claude-opus-5__pelican_bicycle__015
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 15,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle.",
  "latency": 35.08,
  "svg": "svg/claude-opus-5__pelican_bicycle__015.svg",
  "png": "png/claude-opus-5__pelican_bicycle__015.png"
}
claude-opus-5__pelican_bicycle__016
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 16,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle.",
  "latency": 33.39,
  "svg": "svg/claude-opus-5__pelican_bicycle__016.svg",
  "png": "png/claude-opus-5__pelican_bicycle__016.png"
}
claude-opus-5__pelican_bicycle__017
Upstream outputs, not a Pelican Map ranking · reward 0.883
A cartoon bird with an orange beak is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 17,
  "reward": 0.8826388888888889,
  "structure_score": 1.0,
  "semantic_score": 0.8194444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird with an orange beak is riding a bicycle.",
  "latency": 37.33,
  "svg": "svg/claude-opus-5__pelican_bicycle__017.svg",
  "png": "png/claude-opus-5__pelican_bicycle__017.png"
}
claude-opus-5__pelican_bicycle__018
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 18,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle.",
  "latency": 49.62,
  "svg": "svg/claude-opus-5__pelican_bicycle__018.svg",
  "png": "png/claude-opus-5__pelican_bicycle__018.png"
}
claude-opus-5__pelican_bicycle__019
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "claude-opus-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 19,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 43.85,
  "svg": "svg/claude-opus-5__pelican_bicycle__019.svg",
  "png": "png/claude-opus-5__pelican_bicycle__019.png"
}
gpt-5.6-sol
20 rows · 20 images
＋
Model summary and representative images →
gpt-5.6-sol__pelican_bicycle__000
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on a grassy path under a blue sky.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on a grassy path under a blue sky.",
  "latency": 35.89,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__000.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__000.png"
}
gpt-5.6-sol__pelican_bicycle__001
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a blue bicycle on a grassy path under a sunny sky with birds flying.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 1,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a blue bicycle on a grassy path under a sunny sky with birds flying.",
  "latency": 54.6,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__001.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__001.png"
}
gpt-5.6-sol__pelican_bicycle__002
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on a grassy field under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 2,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on a grassy field under a sunny sky with clouds.",
  "latency": 38.06,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__002.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__002.png"
}
gpt-5.6-sol__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a red bicycle on grass under a blue sky with clouds and a sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 3,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle on grass under a blue sky with clouds and a sun.",
  "latency": 40.36,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__003.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__003.png"
}
gpt-5.6-sol__pelican_bicycle__004
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with an orange beak and legs is riding a blue bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 4,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird with an orange beak and legs is riding a blue bicycle.",
  "latency": 41.9,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__004.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__004.png"
}
gpt-5.6-sol__pelican_bicycle__005
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a blue bicycle on grass under a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 5,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a blue bicycle on grass under a blue sky with clouds.",
  "latency": 46.92,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__005.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__005.png"
}
gpt-5.6-sol__pelican_bicycle__006
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with an orange beak is riding a red bicycle on a grassy path.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 6,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird with an orange beak is riding a red bicycle on a grassy path.",
  "latency": 31.43,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__006.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__006.png"
}
gpt-5.6-sol__pelican_bicycle__007
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on grass with a blue sky background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 7,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on grass with a blue sky background.",
  "latency": 33.97,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__007.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__007.png"
}
gpt-5.6-sol__pelican_bicycle__008
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 8,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle.",
  "latency": 38.62,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__008.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__008.png"
}
gpt-5.6-sol__pelican_bicycle__009
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on a road with green hills, a yellow sun, and two birds flying in the sky.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 9,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on a road with green hills, a yellow sun, and two birds flying in the sky.",
  "latency": 37.22,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__009.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__009.png"
}
gpt-5.6-sol__pelican_bicycle__010
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle with a yellow sun in the background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 10,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle with a yellow sun in the background.",
  "latency": 32.35,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__010.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__010.png"
}
gpt-5.6-sol__pelican_bicycle__011
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with an orange beak is riding a red bicycle on a green surface.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 11,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird with an orange beak is riding a red bicycle on a green surface.",
  "latency": 28.37,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__011.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__011.png"
}
gpt-5.6-sol__pelican_bicycle__012
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose with an orange beak is riding a red bicycle on a grassy hill under a blue sky.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 12,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose with an orange beak is riding a red bicycle on a grassy hill under a blue sky.",
  "latency": 35.3,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__012.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__012.png"
}
gpt-5.6-sol__pelican_bicycle__013
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with grass below.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 13,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with grass below.",
  "latency": 49.22,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__013.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__013.png"
}
gpt-5.6-sol__pelican_bicycle__014
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with an orange beak is riding a red bicycle on a grassy path.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 14,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird with an orange beak is riding a red bicycle on a grassy path.",
  "latency": 32.81,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__014.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__014.png"
}
gpt-5.6-sol__pelican_bicycle__015
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on grass under a sunny sky with a bird flying above.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 15,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on grass under a sunny sky with a bird flying above.",
  "latency": 43.87,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__015.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__015.png"
}
gpt-5.6-sol__pelican_bicycle__016
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on a grassy hill under a sunny sky.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 16,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on a grassy hill under a sunny sky.",
  "latency": 34.22,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__016.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__016.png"
}
gpt-5.6-sol__pelican_bicycle__017
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on a grassy hill under a blue sky.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 17,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on a grassy hill under a blue sky.",
  "latency": 33.85,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__017.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__017.png"
}
gpt-5.6-sol__pelican_bicycle__018
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 18,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 42.15,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__018.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__018.png"
}
gpt-5.6-sol__pelican_bicycle__019
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on grass under a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "gpt-5.6-sol",
  "access": "closed",
  "provider": "OpenAI",
  "task": "pelican_bicycle",
  "sample": 19,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on grass under a blue sky with clouds.",
  "latency": 84.64,
  "svg": "svg/gpt-5.6-sol__pelican_bicycle__019.svg",
  "png": "png/gpt-5.6-sol__pelican_bicycle__019.png"
}
moonshotai/Kimi-K3
19 rows · 18 images
＋
Model summary and representative images →
moonshotai__Kimi-K3__pelican_bicycle__000
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with clouds.",
  "latency": 368.02,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__000.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__000.png"
}
moonshotai__Kimi-K3__pelican_bicycle__001
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 1,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 354.78,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__001.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__001.png"
}
moonshotai__Kimi-K3__pelican_bicycle__002
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with a cloud and sun visible.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 2,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with a cloud and sun visible.",
  "latency": 473.92,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__002.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__002.png"
}
moonshotai__Kimi-K3__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 3,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 444.65,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__003.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__003.png"
}
moonshotai__Kimi-K3__pelican_bicycle__004
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on grass under a blue sky with a cloud and a yellow sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 4,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on grass under a blue sky with a cloud and a yellow sun.",
  "latency": 178.86,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__004.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__004.png"
}
Truncated SVG; no PNG available. Original reward = 0 remains in the denominator.
moonshotai__Kimi-K3__pelican_bicycle__005
Upstream outputs, not a Pelican Map ranking · reward 0.000
Blind caption unavailable
Upstream SVG ↗
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 5,
  "reward": 0.0,
  "structure_score": 0.0,
  "semantic_score": 0.0,
  "gate_passed": false,
  "violations": [
    "truncated_svg"
  ],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "",
  "latency": 214.51,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__005.svg",
  "png": null
}
moonshotai__Kimi-K3__pelican_bicycle__006
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 6,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 258.13,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__006.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__006.png"
}
moonshotai__Kimi-K3__pelican_bicycle__008
Upstream outputs, not a Pelican Map ranking · reward 0.801
A stork is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 8,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A stork is riding a red bicycle under a sunny sky with clouds.",
  "latency": 382.87,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__008.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__008.png"
}
moonshotai__Kimi-K3__pelican_bicycle__009
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican wearing a red helmet rides a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 9,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican wearing a red helmet rides a red bicycle under a sunny sky with clouds.",
  "latency": 324.34,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__009.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__009.png"
}
moonshotai__Kimi-K3__pelican_bicycle__010
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork wearing a red scarf is riding a red bicycle under a sunny sky with clouds and birds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 10,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork wearing a red scarf is riding a red bicycle under a sunny sky with clouds and birds.",
  "latency": 378.0,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__010.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__010.png"
}
moonshotai__Kimi-K3__pelican_bicycle__011
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 11,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with clouds.",
  "latency": 331.39,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__011.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__011.png"
}
moonshotai__Kimi-K3__pelican_bicycle__012
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 12,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with clouds.",
  "latency": 279.25,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__012.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__012.png"
}
moonshotai__Kimi-K3__pelican_bicycle__013
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 13,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 542.65,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__013.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__013.png"
}
moonshotai__Kimi-K3__pelican_bicycle__014
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 14,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a bicycle under a sunny sky with clouds.",
  "latency": 368.53,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__014.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__014.png"
}
moonshotai__Kimi-K3__pelican_bicycle__015
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 15,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 394.98,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__015.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__015.png"
}
moonshotai__Kimi-K3__pelican_bicycle__016
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a green bicycle under a sunny sky with a cloud.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 16,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a green bicycle under a sunny sky with a cloud.",
  "latency": 494.77,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__016.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__016.png"
}
moonshotai__Kimi-K3__pelican_bicycle__017
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 17,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 357.67,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__017.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__017.png"
}
moonshotai__Kimi-K3__pelican_bicycle__018
Upstream outputs, not a Pelican Map ranking · reward 0.801
A cartoon stork is riding a red bicycle with a baby carriage attached, under a sunny sky with a cloud and sun visible.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 18,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle with a baby carriage attached, under a sunny sky with a cloud and sun visible.",
  "latency": 449.24,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__018.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__018.png"
}
moonshotai__Kimi-K3__pelican_bicycle__019
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican wearing a red cap rides a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 19,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican wearing a red cap rides a red bicycle under a sunny sky with clouds.",
  "latency": 476.76,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__019.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__019.png"
}
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4
20 rows · 20 images
＋
Model summary and representative images →
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__000
Upstream outputs, not a Pelican Map ranking · reward 0.810
A bird with an orange beak is riding a bicycle with two wheels and handlebars.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 0.8104166666666666,
  "structure_score": 1.0,
  "semantic_score": 0.7083333333333333,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A bird with an orange beak is riding a bicycle with two wheels and handlebars.",
  "latency": 268.67,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__000.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__000.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__001
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a bicycle on a line under a blue sky with a cloud.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 1,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle on a line under a blue sky with a cloud.",
  "latency": 31.8,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__001.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__001.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__002
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 2,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle.",
  "latency": 68.4,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__002.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__002.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 0.465
A cartoon bird with an orange beak and feet is riding a bicycle with two large wheels.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 3,
  "reward": 0.46510416666666665,
  "structure_score": 1.0,
  "semantic_score": 0.17708333333333331,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird with an orange beak and feet is riding a bicycle with two large wheels.",
  "latency": 35.8,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__003.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__003.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__004
Upstream outputs, not a Pelican Map ranking · reward 0.847
The image shows a cartoon-style drawing of a white bird with an orange beak riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 4,
  "reward": 0.8465277777777778,
  "structure_score": 1.0,
  "semantic_score": 0.7638888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "The image shows a cartoon-style drawing of a white bird with an orange beak riding a bicycle.",
  "latency": 69.25,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__004.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__004.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__005
Upstream outputs, not a Pelican Map ranking · reward 0.765
A stick figure with an orange beak is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 5,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A stick figure with an orange beak is riding a bicycle.",
  "latency": 28.18,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__005.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__005.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__006
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon stork is riding a bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 6,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a bicycle under a sunny sky with clouds.",
  "latency": 24.75,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__006.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__006.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__007
Upstream outputs, not a Pelican Map ranking · reward 0.847
A bird with an orange beak is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 7,
  "reward": 0.8465277777777778,
  "structure_score": 1.0,
  "semantic_score": 0.7638888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A bird with an orange beak is riding a bicycle.",
  "latency": 101.63,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__007.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__007.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__008
Upstream outputs, not a Pelican Map ranking · reward 0.801
A cartoon stork is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 8,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a bicycle.",
  "latency": 12.76,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__008.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__008.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__009
Upstream outputs, not a Pelican Map ranking · reward 0.950
A cartoon pelican is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 9,
  "reward": 0.95,
  "structure_score": 0.8571428571428571,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle.",
  "latency": 10.91,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__009.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__009.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__010
Upstream outputs, not a Pelican Map ranking · reward 0.494
The image shows a bicycle with a pelican perched on its frame.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 10,
  "reward": 0.4944444444444444,
  "structure_score": 1.0,
  "semantic_score": 0.2222222222222222,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "The image shows a bicycle with a pelican perched on its frame.",
  "latency": 16.29,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__010.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__010.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__011
Upstream outputs, not a Pelican Map ranking · reward 0.883
A bird with an orange beak is riding a bicycle while holding a paper airplane in its beak.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 11,
  "reward": 0.8826388888888889,
  "structure_score": 1.0,
  "semantic_score": 0.8194444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A bird with an orange beak is riding a bicycle while holding a paper airplane in its beak.",
  "latency": 22.6,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__011.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__011.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__012
Upstream outputs, not a Pelican Map ranking · reward 0.838
The image depicts a stylized drawing of a bicycle with a large, rounded front and two wheels, but the rider is not clearly identifiable.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 12,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "The image depicts a stylized drawing of a bicycle with a large, rounded front and two wheels, but the rider is not clearly identifiable.",
  "latency": 10.56,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__012.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__012.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__013
Upstream outputs, not a Pelican Map ranking · reward 0.914
A cartoon pelican is riding a bicycle with its wings spread out.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 13,
  "reward": 0.913888888888889,
  "structure_score": 0.8571428571428571,
  "semantic_score": 0.9444444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle with its wings spread out.",
  "latency": 129.18,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__013.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__013.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__014
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 14,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle.",
  "latency": 21.0,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__014.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__014.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__015
Upstream outputs, not a Pelican Map ranking · reward 0.456
A bicycle with orange arrows pointing at its pedals and handlebars, and a bird-like figure above it.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 15,
  "reward": 0.4560763888888889,
  "structure_score": 1.0,
  "semantic_score": 0.16319444444444445,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A bicycle with orange arrows pointing at its pedals and handlebars, and a bird-like figure above it.",
  "latency": 296.77,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__015.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__015.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__016
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 16,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a bicycle.",
  "latency": 16.48,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__016.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__016.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__017
Upstream outputs, not a Pelican Map ranking · reward 0.964
A cartoon pelican is riding a bicycle with large wheels on a grassy area against a light blue background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 17,
  "reward": 0.9638888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.9444444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle with large wheels on a grassy area against a light blue background.",
  "latency": 24.27,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__017.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__017.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__018
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a bicycle on a line.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 18,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle on a line.",
  "latency": 17.09,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__018.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__018.png"
}
nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__019
Upstream outputs, not a Pelican Map ranking · reward 0.810
A cartoon bird with an orange beak is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 19,
  "reward": 0.8104166666666666,
  "structure_score": 1.0,
  "semantic_score": 0.7083333333333333,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird with an orange beak is riding a bicycle.",
  "latency": 10.86,
  "svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__019.svg",
  "png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__019.png"
}
zai-org/GLM-5.2
20 rows · 20 images
＋
Model summary and representative images →
zai-org__GLM-5.2__pelican_bicycle__000
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle while carrying a fish in its beak.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle while carrying a fish in its beak.",
  "latency": 39.87,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__000.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__000.png"
}
zai-org__GLM-5.2__pelican_bicycle__001
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 1,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle under a sunny sky with clouds.",
  "latency": 45.56,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__001.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__001.png"
}
zai-org__GLM-5.2__pelican_bicycle__002
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon stork is riding a red bicycle under a sunny sky with a cloud and a hot dog in its beak.
Upstream SVG ↗
Animated source SVG is not mirrored; only its upstream static PNG is shown.
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 2,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with a cloud and a hot dog in its beak.",
  "latency": 229.49,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__002.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__002.png"
}
zai-org__GLM-5.2__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle against a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 3,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle against a blue sky with clouds.",
  "latency": 70.75,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__003.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__003.png"
}
zai-org__GLM-5.2__pelican_bicycle__004
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 4,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a bicycle under a sunny sky with clouds.",
  "latency": 54.16,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__004.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__004.png"
}
zai-org__GLM-5.2__pelican_bicycle__005
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 5,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a bicycle.",
  "latency": 103.07,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__005.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__005.png"
}
zai-org__GLM-5.2__pelican_bicycle__006
Upstream outputs, not a Pelican Map ranking · reward 0.964
A cartoon pelican wearing a helmet is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 6,
  "reward": 0.9638888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.9444444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican wearing a helmet is riding a red bicycle.",
  "latency": 152.65,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__006.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__006.png"
}
zai-org__GLM-5.2__pelican_bicycle__007
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with a cloud and sun visible.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 7,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with a cloud and sun visible.",
  "latency": 122.35,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__007.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__007.png"
}
zai-org__GLM-5.2__pelican_bicycle__008
Upstream outputs, not a Pelican Map ranking · reward 0.503
A cartoon pelican with a fish in its beak is riding a red bicycle on a path under a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 8,
  "reward": 0.5034722222222222,
  "structure_score": 1.0,
  "semantic_score": 0.2361111111111111,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican with a fish in its beak is riding a red bicycle on a path under a blue sky with clouds.",
  "latency": 73.73,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__008.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__008.png"
}
zai-org__GLM-5.2__pelican_bicycle__009
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon goose is riding a red bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 9,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle.",
  "latency": 59.7,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__009.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__009.png"
}
zai-org__GLM-5.2__pelican_bicycle__010
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a red bicycle on a sandy path under a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 10,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle on a sandy path under a blue sky with clouds.",
  "latency": 58.96,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__010.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__010.png"
}
zai-org__GLM-5.2__pelican_bicycle__011
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon stork is riding a red bicycle on a grassy path under a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 11,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle on a grassy path under a blue sky with clouds.",
  "latency": 159.06,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__011.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__011.png"
}
zai-org__GLM-5.2__pelican_bicycle__012
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with an orange beak is riding a bicycle.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 12,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird with an orange beak is riding a bicycle.",
  "latency": 121.45,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__012.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__012.png"
}
zai-org__GLM-5.2__pelican_bicycle__013
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon goose is riding a red bicycle on a green ground with a blue sky background.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 13,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle on a green ground with a blue sky background.",
  "latency": 87.53,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__013.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__013.png"
}
zai-org__GLM-5.2__pelican_bicycle__014
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 14,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 89.78,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__014.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__014.png"
}
zai-org__GLM-5.2__pelican_bicycle__015
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican with a fish in its beak is riding a red bicycle on a road under a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 15,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican with a fish in its beak is riding a red bicycle on a road under a blue sky with clouds.",
  "latency": 79.98,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__015.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__015.png"
}
zai-org__GLM-5.2__pelican_bicycle__016
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with a yellow beak is riding a red bicycle under a yellow sun.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 16,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird with a yellow beak is riding a red bicycle under a yellow sun.",
  "latency": 61.16,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__016.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__016.png"
}
zai-org__GLM-5.2__pelican_bicycle__017
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 17,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky.",
  "latency": 66.9,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__017.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__017.png"
}
zai-org__GLM-5.2__pelican_bicycle__018
Upstream outputs, not a Pelican Map ranking · reward 0.801
A cartoon stork is riding a red bicycle under a sunny sky.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 18,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky.",
  "latency": 69.4,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__018.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__018.png"
}
zai-org__GLM-5.2__pelican_bicycle__019
Upstream outputs, not a Pelican Map ranking · reward 0.801
A cartoon goose is riding a red bicycle under a blue sky with clouds.
Upstream SVG ↗
·
Local SVG
Original fields and blind caption
{
  "model": "zai-org/GLM-5.2",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 19,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle under a blue sky with clouds.",
  "latency": 53.86,
  "svg": "svg/zai-org__GLM-5.2__pelican_bicycle__019.svg",
  "png": "png/zai-org__GLM-5.2__pelican_bicycle__019.png"
}
No matching samples.

https://pelicanmap.aveniqa.com/ru/collections/openenv-2026-07-29/
