Matches species words in original captions; no new image judging. Multiple labels and missing/unidentified captions remain in the denominator. Original captions are retained below.
Perfect upstream reward = 1
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle while carrying a fish in its beak.
Animated source SVG is not mirrored; only its upstream static PNG is shown.
Original fields and blind caption
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 2,
"reward": 0.7652777777777777,
"structure_score": 1.0,
"semantic_score": 0.6388888888888888,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with a cloud and a hot dog in its beak.",
"latency": 229.49,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__002.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__002.png"
}
zai-org__GLM-5.2__pelican_bicycle__003
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle against a blue sky with clouds.
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 7,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with a cloud and sun visible.",
"latency": 122.35,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__007.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__007.png"
}
zai-org__GLM-5.2__pelican_bicycle__008
Upstream outputs, not a Pelican Map ranking · reward 0.503
A cartoon pelican with a fish in its beak is riding a red bicycle on a path under a blue sky with clouds.
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 8,
"reward": 0.5034722222222222,
"structure_score": 1.0,
"semantic_score": 0.2361111111111111,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican with a fish in its beak is riding a red bicycle on a path under a blue sky with clouds.",
"latency": 73.73,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__008.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__008.png"
}
zai-org__GLM-5.2__pelican_bicycle__009
Upstream outputs, not a Pelican Map ranking · reward 0.765
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 10,
"reward": 0.8375,
"structure_score": 1.0,
"semantic_score": 0.75,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon goose is riding a red bicycle on a sandy path under a blue sky with clouds.",
"latency": 58.96,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__010.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__010.png"
}
zai-org__GLM-5.2__pelican_bicycle__011
Upstream outputs, not a Pelican Map ranking · reward 0.765
A cartoon stork is riding a red bicycle on a grassy path under a blue sky with clouds.
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 11,
"reward": 0.7652777777777777,
"structure_score": 1.0,
"semantic_score": 0.6388888888888888,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon stork is riding a red bicycle on a grassy path under a blue sky with clouds.",
"latency": 159.06,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__011.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__011.png"
}
zai-org__GLM-5.2__pelican_bicycle__012
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with an orange beak is riding a bicycle.
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 13,
"reward": 0.7652777777777777,
"structure_score": 1.0,
"semantic_score": 0.6388888888888888,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon goose is riding a red bicycle on a green ground with a blue sky background.",
"latency": 87.53,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__013.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__013.png"
}
zai-org__GLM-5.2__pelican_bicycle__014
Upstream outputs, not a Pelican Map ranking · reward 1.000
A cartoon pelican is riding a red bicycle under a sunny sky with clouds.
{
"model": "zai-org/GLM-5.2",
"access": "open",
"provider": "hf-inference-providers",
"task": "pelican_bicycle",
"sample": 15,
"reward": 1.0,
"structure_score": 1.0,
"semantic_score": 1.0,
"gate_passed": true,
"violations": [],
"judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
"judge_blind_caption": "A cartoon pelican with a fish in its beak is riding a red bicycle on a road under a blue sky with clouds.",
"latency": 79.98,
"svg": "svg/zai-org__GLM-5.2__pelican_bicycle__015.svg",
"png": "png/zai-org__GLM-5.2__pelican_bicycle__015.png"
}
zai-org__GLM-5.2__pelican_bicycle__016
Upstream outputs, not a Pelican Map ranking · reward 0.919
A cartoon bird with a yellow beak is riding a red bicycle under a yellow sun.
