2026-07-29 / Not separately published; publication is not the run date
Pinned revision
548f58a232c4aadf05f4798c2d69b8bd95e4b502
Model labels follow the source and are not independently authenticated. Providers and sampling conditions differ; scores come from the upstream judge, not a Pelican Bicycle Archive capability assessment. 139 main-task rows, 138 viewable images and one failed row.
Upstream outputs, not a Pelican Map ranking · Alphabetical by model; failed rows remain in the denominator
{
"model": "Qwen/Qwen3.6-27B",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 1,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red bicycle under a blue sky with clouds and a sun.",
"latency": 68.88,
"svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__001.svg",
"png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__001.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__002
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle while holding an orange basket in its beak, with a blue sky, sun, and clouds in the background.
{
"model": "Qwen/Qwen3.6-27B",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 2,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red bicycle while holding an orange basket in its beak, with a blue sky, sun, and clouds in the background.",
"latency": 58.97,
"svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__002.svg",
"png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__002.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a blue sky with clouds.
{
"model": "Qwen/Qwen3.6-27B",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 5,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.",
"latency": 72.08,
"svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__005.svg",
"png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__005.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__006
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon stork is riding a red and black bicycle on a green road with a blue sky background.
{
"model": "Qwen/Qwen3.6-27B",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 6,
"reward": 0.7652777777777777,
"structure_score": 1.0,
"semantic_score": 0.6388888888888888,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red and black bicycle on a green road with a blue sky background.",
"latency": 116.07,
"svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__006.svg",
"png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__006.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__007
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon stork is riding a red bicycle under a sunny blue sky with clouds and grass below.
{
"model": "Qwen/Qwen3.6-27B",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 8,
"reward": 0.91875,
"structure_score": 1.0,
"semantic_score": 0.875,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon bird is riding a red bicycle with a basket on its back under a sunny sky with clouds.",
"latency": 123.31,
"svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__008.svg",
"png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__008.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__009
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.
{
"model": "Qwen/Qwen3.6-27B",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 9,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.",
"latency": 65.49,
"svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__009.svg",
"png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__009.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__010
Upstream outputs, not a Pelican Map ranking · reward 0.454
A cartoon stork is riding a red bicycle under a sunny sky with clouds and grass below.
{
"model": "Qwen/Qwen3.6-27B",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 12,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red bicycle on grass under a blue sky with clouds and a sun.",
"latency": 97.27,
"svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__012.svg",
"png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__012.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__013
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle on a road under a blue sky with clouds and a sun.
{
"model": "Qwen/Qwen3.6-27B",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 13,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle on a road under a blue sky with clouds and a sun.",
"latency": 62.11,
"svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__013.svg",
"png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__013.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__014
Upstream outputs, not a Pelican Map ranking · reward 0.964
A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.
{
"model": "Qwen/Qwen3.6-27B",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 14,
"reward": 0.9638888888888889,
"structure_score": 1.0,
"semantic_score": 0.9444444444444444,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle under a blue sky with clouds and a sun.",
"latency": 153.52,
"svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__014.svg",
"png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__014.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__015
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle against a blue sky with clouds.
{
"model": "Qwen/Qwen3.6-27B",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 17,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red bicycle on a green ground with a blue sky and clouds in the background.",
"latency": 114.38,
"svg": "svg/Qwen__Qwen3.6-27B__pelican_bicycle__017.svg",
"png": "png/Qwen__Qwen3.6-27B__pelican_bicycle__017.png"
}
Qwen__Qwen3.6-27B__pelican_bicycle__018
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon goose is riding a red bicycle on grass under a blue sky with clouds.
{
"model": "claude-fable-5",
"access": "closed",
"provider": "Anthropic",
"task": "pelican_bicycle",
"sample": 7,
"reward": 0.8013888888888889,
"structure_score": 1.0,
"semantic_score": 0.6944444444444444,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon duck is riding a red bicycle on a green surface against a light blue background.",
"latency": 23.51,
"svg": "svg/claude-fable-5__pelican_bicycle__007.svg",
"png": "png/claude-fable-5__pelican_bicycle__007.png"
}
claude-fable-5__pelican_bicycle__008
Upstream outputs, not a Pelican Map ranking · reward 0.838
{
"model": "claude-fable-5",
"access": "closed",
"provider": "Anthropic",
"task": "pelican_bicycle",
"sample": 11,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with a cloud and sun visible.",
"latency": 25.02,
"svg": "svg/claude-fable-5__pelican_bicycle__011.svg",
"png": "png/claude-fable-5__pelican_bicycle__011.png"
}
claude-fable-5__pelican_bicycle__012
Upstream outputs, not a Pelican Map ranking · reward 0.838
{
"model": "claude-opus-5",
"access": "closed",
"provider": "Anthropic",
"task": "pelican_bicycle",
"sample": 0,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon goose is riding a red bicycle on a green ground with a blue sky and clouds in the background.",
"latency": 44.02,
"svg": "svg/claude-opus-5__pelican_bicycle__000.svg",
"png": "png/claude-opus-5__pelican_bicycle__000.png"
}
claude-opus-5__pelican_bicycle__001
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon goose with an orange beak and legs is riding a red bicycle.
{
"model": "claude-opus-5",
"access": "closed",
"provider": "Anthropic",
"task": "pelican_bicycle",
"sample": 6,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a bicycle with its wings outstretched, and there is a yellow circle resembling the sun in the background.",
"latency": 51.91,
"svg": "svg/claude-opus-5__pelican_bicycle__006.svg",
"png": "png/claude-opus-5__pelican_bicycle__006.png"
}
claude-opus-5__pelican_bicycle__007
Upstream outputs, not a Pelican Map ranking · reward 0.838
{
"model": "gpt-5.6-sol",
"access": "closed",
"provider": "OpenAI",
"task": "pelican_bicycle",
"sample": 2,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle on a grassy field under a sunny sky with clouds.",
"latency": 38.06,
"svg": "svg/gpt-5.6-sol__pelican_bicycle__002.svg",
"png": "png/gpt-5.6-sol__pelican_bicycle__002.png"
}
gpt-5.6-sol__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 0.838
A cartoon duck is riding a red bicycle on grass under a blue sky with clouds and a sun.
{
"model": "gpt-5.6-sol",
"access": "closed",
"provider": "OpenAI",
"task": "pelican_bicycle",
"sample": 3,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon duck is riding a red bicycle on grass under a blue sky with clouds and a sun.",
"latency": 40.36,
"svg": "svg/gpt-5.6-sol__pelican_bicycle__003.svg",
"png": "png/gpt-5.6-sol__pelican_bicycle__003.png"
}
gpt-5.6-sol__pelican_bicycle__004
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with an orange beak and legs is riding a blue bicycle.
{
"model": "gpt-5.6-sol",
"access": "closed",
"provider": "OpenAI",
"task": "pelican_bicycle",
"sample": 9,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle on a road with green hills, a yellow sun, and two birds flying in the sky.",
"latency": 37.22,
"svg": "svg/gpt-5.6-sol__pelican_bicycle__009.svg",
"png": "png/gpt-5.6-sol__pelican_bicycle__009.png"
}
gpt-5.6-sol__pelican_bicycle__010
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle with a yellow sun in the background.
{
"model": "gpt-5.6-sol",
"access": "closed",
"provider": "OpenAI",
"task": "pelican_bicycle",
"sample": 12,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon goose with an orange beak is riding a red bicycle on a grassy hill under a blue sky.",
"latency": 35.3,
"svg": "svg/gpt-5.6-sol__pelican_bicycle__012.svg",
"png": "png/gpt-5.6-sol__pelican_bicycle__012.png"
}
gpt-5.6-sol__pelican_bicycle__013
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with grass below.
{
"model": "gpt-5.6-sol",
"access": "closed",
"provider": "OpenAI",
"task": "pelican_bicycle",
"sample": 17,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle on a grassy hill under a blue sky.",
"latency": 33.85,
"svg": "svg/gpt-5.6-sol__pelican_bicycle__017.svg",
"png": "png/gpt-5.6-sol__pelican_bicycle__017.png"
}
gpt-5.6-sol__pelican_bicycle__018
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
{
"model": "moonshotai/Kimi-K3",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 2,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with a cloud and sun visible.",
"latency": 473.92,
"svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__002.svg",
"png": "png/moonshotai__Kimi-K3__pelican_bicycle__002.png"
}
moonshotai__Kimi-K3__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
{
"model": "moonshotai/Kimi-K3",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 4,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle on grass under a blue sky with a cloud and a yellow sun.",
"latency": 178.86,
"svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__004.svg",
"png": "png/moonshotai__Kimi-K3__pelican_bicycle__004.png"
}
Truncated SVG; no PNG available. Original reward = 0 remains in the denominator.
moonshotai__Kimi-K3__pelican_bicycle__005
Upstream outputs, not a Pelican Map ranking · reward 0.000
{
"model": "moonshotai/Kimi-K3",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 18,
"reward": 0.8013888888888889,
"structure_score": 1.0,
"semantic_score": 0.6944444444444444,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red bicycle with a baby carriage attached, under a sunny sky with a cloud and sun visible.",
"latency": 449.24,
"svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__018.svg",
"png": "png/moonshotai__Kimi-K3__pelican_bicycle__018.png"
}
moonshotai__Kimi-K3__pelican_bicycle__019
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican wearing a red cap rides a red bicycle under a sunny sky with clouds.
{
"model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 1,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a bicycle on a line under a blue sky with a cloud.",
"latency": 31.8,
"svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__001.svg",
"png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__001.png"
}
{
"model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 11,
"reward": 0.8826388888888889,
"structure_score": 1.0,
"semantic_score": 0.8194444444444444,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A bird with an orange beak is riding a bicycle while holding a paper airplane in its beak.",
"latency": 22.6,
"svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__011.svg",
"png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__011.png"
}
{
"model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 12,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "The image depicts a stylized drawing of a bicycle with a large, rounded front and two wheels, but the rider is not clearly identifiable.",
"latency": 10.56,
"svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__012.svg",
"png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__012.png"
}
{
"model": "nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 17,
"reward": 0.9638888888888889,
"structure_score": 1.0,
"semantic_score": 0.9444444444444444,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a bicycle with large wheels on a grassy area against a light blue background.",
"latency": 24.27,
"svg": "svg/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__017.svg",
"png": "png/nvidia__NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4__pelican_bicycle__017.png"
}
Animated source SVG is not mirrored; only its upstream static PNG is shown.
Original fields and blind caption
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 2,
"reward": 0.7652777777777777,
"structure_score": 1.0,
"semantic_score": 0.6388888888888888,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with a cloud and a hot dog in its beak.",
"latency": 229.49,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__002.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__002.png"
}
zai-org__GLM-5.2__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle against a blue sky with clouds.
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 7,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with a cloud and sun visible.",
"latency": 122.35,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__007.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__007.png"
}
zai-org__GLM-5.2__pelican_bicycle__008
Upstream outputs, not a Pelican Map ranking · reward 0.503
A cartoon pelican with a fish in its beak is riding a red bicycle on a path under a blue sky with clouds.
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 8,
"reward": 0.5034722222222222,
"structure_score": 1.0,
"semantic_score": 0.2361111111111111,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican with a fish in its beak is riding a red bicycle on a path under a blue sky with clouds.",
"latency": 73.73,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__008.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__008.png"
}
zai-org__GLM-5.2__pelican_bicycle__009
Upstream outputs, not a Pelican Map ranking · reward 0.765
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 10,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon goose is riding a red bicycle on a sandy path under a blue sky with clouds.",
"latency": 58.96,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__010.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__010.png"
}
zai-org__GLM-5.2__pelican_bicycle__011
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon stork is riding a red bicycle on a grassy path under a blue sky with clouds.
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 11,
"reward": 0.7652777777777777,
"structure_score": 1.0,
"semantic_score": 0.6388888888888888,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red bicycle on a grassy path under a blue sky with clouds.",
"latency": 159.06,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__011.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__011.png"
}
zai-org__GLM-5.2__pelican_bicycle__012
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with an orange beak is riding a bicycle.
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 13,
"reward": 0.7652777777777777,
"structure_score": 1.0,
"semantic_score": 0.6388888888888888,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon goose is riding a red bicycle on a green ground with a blue sky background.",
"latency": 87.53,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__013.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__013.png"
}
zai-org__GLM-5.2__pelican_bicycle__014
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 15,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican with a fish in its beak is riding a red bicycle on a road under a blue sky with clouds.",
"latency": 79.98,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__015.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__015.png"
}
zai-org__GLM-5.2__pelican_bicycle__016
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with a yellow beak is riding a red bicycle under a yellow sun.
