Pelican MapAN AI FIELD GUIDE
HF / OPENENV · REFERENCE ONLY

claude-fable-5

Upstream outputs, not a Pelican Map ranking

Upstream outputs, not a Pelican Map ranking

An independent HuggingFace / OpenEnv scoring reference, excluded from the main timeline, collection and case total.

Rows: 20 · Viewable images: 20 · Upstream mean reward: 0.844271

Species words in upstream blind captions

bird: 5/20 · duck: 8/20 · goose: 4/20 · pelican: 1/20 · stork: 2/20

Matches species words in original captions; no new image judging. Multiple labels and missing/unidentified captions remain in the denominator. Original captions are retained below.

claude-fable-5__pelican_bicycle__014
Perfect upstream reward = 1

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 14,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle.",
  "latency": 23.77,
  "svg": "svg/claude-fable-5__pelican_bicycle__014.svg",
  "png": "png/claude-fable-5__pelican_bicycle__014.png"
}
claude-fable-5__pelican_bicycle__000
Sample not called a pelican by the blind caption

Upstream outputs, not a Pelican Map ranking · reward 0.801

A cartoon duck is riding a red bicycle.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 24.25,
  "svg": "svg/claude-fable-5__pelican_bicycle__000.svg",
  "png": "png/claude-fable-5__pelican_bicycle__000.png"
}
Expand all samples (20)
claude-fable-5__pelican_bicycle__000
claude-fable-5__pelican_bicycle__000

Upstream outputs, not a Pelican Map ranking · reward 0.801

A cartoon duck is riding a red bicycle.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 24.25,
  "svg": "svg/claude-fable-5__pelican_bicycle__000.svg",
  "png": "png/claude-fable-5__pelican_bicycle__000.png"
}
claude-fable-5__pelican_bicycle__001
claude-fable-5__pelican_bicycle__001

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon duck is riding a red bicycle under a yellow sun.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 1,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle under a yellow sun.",
  "latency": 22.41,
  "svg": "svg/claude-fable-5__pelican_bicycle__001.svg",
  "png": "png/claude-fable-5__pelican_bicycle__001.png"
}
claude-fable-5__pelican_bicycle__002
claude-fable-5__pelican_bicycle__002

Upstream outputs, not a Pelican Map ranking · reward 0.883

A cartoon bird is riding a red bicycle while holding a yellow object in its beak.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 2,
  "reward": 0.8826388888888889,
  "structure_score": 1.0,
  "semantic_score": 0.8194444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle while holding a yellow object in its beak.",
  "latency": 23.06,
  "svg": "svg/claude-fable-5__pelican_bicycle__002.svg",
  "png": "png/claude-fable-5__pelican_bicycle__002.png"
}
claude-fable-5__pelican_bicycle__003
claude-fable-5__pelican_bicycle__003

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon duck is riding a red bicycle under a yellow sun.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 3,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle under a yellow sun.",
  "latency": 23.58,
  "svg": "svg/claude-fable-5__pelican_bicycle__003.svg",
  "png": "png/claude-fable-5__pelican_bicycle__003.png"
}
claude-fable-5__pelican_bicycle__004
claude-fable-5__pelican_bicycle__004

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon goose is riding a red bicycle under a yellow sun.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 4,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle under a yellow sun.",
  "latency": 29.07,
  "svg": "svg/claude-fable-5__pelican_bicycle__004.svg",
  "png": "png/claude-fable-5__pelican_bicycle__004.png"
}
claude-fable-5__pelican_bicycle__005
claude-fable-5__pelican_bicycle__005

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon goose is riding a red bicycle and holding a yellow ball in its beak.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 5,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle and holding a yellow ball in its beak.",
  "latency": 21.39,
  "svg": "svg/claude-fable-5__pelican_bicycle__005.svg",
  "png": "png/claude-fable-5__pelican_bicycle__005.png"
}
claude-fable-5__pelican_bicycle__006
claude-fable-5__pelican_bicycle__006

Upstream outputs, not a Pelican Map ranking · reward 0.765

A cartoon duck is riding a red bicycle under a yellow sun.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 6,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle under a yellow sun.",
  "latency": 21.21,
  "svg": "svg/claude-fable-5__pelican_bicycle__006.svg",
  "png": "png/claude-fable-5__pelican_bicycle__006.png"
}
claude-fable-5__pelican_bicycle__007
claude-fable-5__pelican_bicycle__007

Upstream outputs, not a Pelican Map ranking · reward 0.801

A cartoon duck is riding a red bicycle on a green surface against a light blue background.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 7,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle on a green surface against a light blue background.",
  "latency": 23.51,
  "svg": "svg/claude-fable-5__pelican_bicycle__007.svg",
  "png": "png/claude-fable-5__pelican_bicycle__007.png"
}
claude-fable-5__pelican_bicycle__008
claude-fable-5__pelican_bicycle__008

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon duck is riding a red bicycle.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 8,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 25.99,
  "svg": "svg/claude-fable-5__pelican_bicycle__008.svg",
  "png": "png/claude-fable-5__pelican_bicycle__008.png"
}
claude-fable-5__pelican_bicycle__009
claude-fable-5__pelican_bicycle__009

Upstream outputs, not a Pelican Map ranking · reward 0.801

A cartoon duck is riding a red bicycle under a yellow sun.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 9,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle under a yellow sun.",
  "latency": 24.52,
  "svg": "svg/claude-fable-5__pelican_bicycle__009.svg",
  "png": "png/claude-fable-5__pelican_bicycle__009.png"
}
claude-fable-5__pelican_bicycle__010
claude-fable-5__pelican_bicycle__010

Upstream outputs, not a Pelican Map ranking · reward 0.919

A cartoon bird is riding a red bicycle under a sunny sky.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 10,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle under a sunny sky.",
  "latency": 27.41,
  "svg": "svg/claude-fable-5__pelican_bicycle__010.svg",
  "png": "png/claude-fable-5__pelican_bicycle__010.png"
}
claude-fable-5__pelican_bicycle__011
claude-fable-5__pelican_bicycle__011

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon stork is riding a red bicycle under a sunny sky with a cloud and sun visible.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 11,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with a cloud and sun visible.",
  "latency": 25.02,
  "svg": "svg/claude-fable-5__pelican_bicycle__011.svg",
  "png": "png/claude-fable-5__pelican_bicycle__011.png"
}
claude-fable-5__pelican_bicycle__012
claude-fable-5__pelican_bicycle__012

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon goose is riding a red bicycle.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 12,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle.",
  "latency": 24.18,
  "svg": "svg/claude-fable-5__pelican_bicycle__012.svg",
  "png": "png/claude-fable-5__pelican_bicycle__012.png"
}
claude-fable-5__pelican_bicycle__013
claude-fable-5__pelican_bicycle__013

Upstream outputs, not a Pelican Map ranking · reward 0.765

A cartoon duck is riding a red bicycle.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 13,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon duck is riding a red bicycle.",
  "latency": 24.2,
  "svg": "svg/claude-fable-5__pelican_bicycle__013.svg",
  "png": "png/claude-fable-5__pelican_bicycle__013.png"
}
claude-fable-5__pelican_bicycle__014
claude-fable-5__pelican_bicycle__014

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 14,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle.",
  "latency": 23.77,
  "svg": "svg/claude-fable-5__pelican_bicycle__014.svg",
  "png": "png/claude-fable-5__pelican_bicycle__014.png"
}
claude-fable-5__pelican_bicycle__015
claude-fable-5__pelican_bicycle__015

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon stork is riding a red bicycle with a yellow sun in the background.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 15,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle with a yellow sun in the background.",
  "latency": 24.83,
  "svg": "svg/claude-fable-5__pelican_bicycle__015.svg",
  "png": "png/claude-fable-5__pelican_bicycle__015.png"
}
claude-fable-5__pelican_bicycle__016
claude-fable-5__pelican_bicycle__016

Upstream outputs, not a Pelican Map ranking · reward 0.919

A cartoon bird is riding a red bicycle under a yellow sun.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 16,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle under a yellow sun.",
  "latency": 22.24,
  "svg": "svg/claude-fable-5__pelican_bicycle__016.svg",
  "png": "png/claude-fable-5__pelican_bicycle__016.png"
}
claude-fable-5__pelican_bicycle__017
claude-fable-5__pelican_bicycle__017

Upstream outputs, not a Pelican Map ranking · reward 0.847

A cartoon bird is riding a red bicycle under a yellow sun.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 17,
  "reward": 0.8465277777777778,
  "structure_score": 1.0,
  "semantic_score": 0.7638888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle under a yellow sun.",
  "latency": 24.78,
  "svg": "svg/claude-fable-5__pelican_bicycle__017.svg",
  "png": "png/claude-fable-5__pelican_bicycle__017.png"
}
claude-fable-5__pelican_bicycle__018
claude-fable-5__pelican_bicycle__018

Upstream outputs, not a Pelican Map ranking · reward 0.765

A cartoon goose is riding a red bicycle.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 18,
  "reward": 0.7652777777777777,
  "structure_score": 1.0,
  "semantic_score": 0.6388888888888888,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon goose is riding a red bicycle.",
  "latency": 22.62,
  "svg": "svg/claude-fable-5__pelican_bicycle__018.svg",
  "png": "png/claude-fable-5__pelican_bicycle__018.png"
}
claude-fable-5__pelican_bicycle__019
claude-fable-5__pelican_bicycle__019

Upstream outputs, not a Pelican Map ranking · reward 0.919

A cartoon bird is riding a red bicycle under a yellow sun.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "claude-fable-5",
  "access": "closed",
  "provider": "Anthropic",
  "task": "pelican_bicycle",
  "sample": 19,
  "reward": 0.91875,
  "structure_score": 1.0,
  "semantic_score": 0.875,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon bird is riding a red bicycle under a yellow sun.",
  "latency": 27.39,
  "svg": "svg/claude-fable-5__pelican_bicycle__019.svg",
  "png": "png/claude-fable-5__pelican_bicycle__019.png"
}

← Back to scoring reference