Pelican MapAN AI FIELD GUIDE
HF / OPENENV · REFERENCE ONLY

moonshotai/Kimi-K3

Upstream outputs, not a Pelican Map ranking

Upstream outputs, not a Pelican Map ranking

An independent HuggingFace / OpenEnv scoring reference, excluded from the main timeline, collection and case total.

Rows: 19 · Viewable images: 18 · Upstream mean reward: 0.883699

Species words in upstream blind captions

not identified: 1/19 · pelican: 11/19 · stork: 7/19

Matches species words in original captions; no new image judging. Multiple labels and missing/unidentified captions remain in the denominator. Original captions are retained below.

moonshotai__Kimi-K3__pelican_bicycle__001
Perfect upstream reward = 1

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 1,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 354.78,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__001.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__001.png"
}
moonshotai__Kimi-K3__pelican_bicycle__000
Sample not called a pelican by the blind caption

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon stork is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with clouds.",
  "latency": 368.02,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__000.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__000.png"
}
Expand all samples (19)
moonshotai__Kimi-K3__pelican_bicycle__000
moonshotai__Kimi-K3__pelican_bicycle__000

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon stork is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 0,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with clouds.",
  "latency": 368.02,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__000.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__000.png"
}
moonshotai__Kimi-K3__pelican_bicycle__001
moonshotai__Kimi-K3__pelican_bicycle__001

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 1,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 354.78,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__001.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__001.png"
}
moonshotai__Kimi-K3__pelican_bicycle__002
moonshotai__Kimi-K3__pelican_bicycle__002

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle under a sunny sky with a cloud and sun visible.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 2,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with a cloud and sun visible.",
  "latency": 473.92,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__002.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__002.png"
}
moonshotai__Kimi-K3__pelican_bicycle__003
moonshotai__Kimi-K3__pelican_bicycle__003

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 3,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 444.65,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__003.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__003.png"
}
moonshotai__Kimi-K3__pelican_bicycle__004
moonshotai__Kimi-K3__pelican_bicycle__004

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle on grass under a blue sky with a cloud and a yellow sun.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 4,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle on grass under a blue sky with a cloud and a yellow sun.",
  "latency": 178.86,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__004.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__004.png"
}

Truncated SVG; no PNG available. Original reward = 0 remains in the denominator.

moonshotai__Kimi-K3__pelican_bicycle__005

Upstream outputs, not a Pelican Map ranking · reward 0.000

Blind caption unavailable

Upstream SVG ↗

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 5,
  "reward": 0.0,
  "structure_score": 0.0,
  "semantic_score": 0.0,
  "gate_passed": false,
  "violations": [
    "truncated_svg"
  ],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "",
  "latency": 214.51,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__005.svg",
  "png": null
}
moonshotai__Kimi-K3__pelican_bicycle__006
moonshotai__Kimi-K3__pelican_bicycle__006

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 6,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 258.13,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__006.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__006.png"
}
moonshotai__Kimi-K3__pelican_bicycle__008
moonshotai__Kimi-K3__pelican_bicycle__008

Upstream outputs, not a Pelican Map ranking · reward 0.801

A stork is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 8,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A stork is riding a red bicycle under a sunny sky with clouds.",
  "latency": 382.87,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__008.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__008.png"
}
moonshotai__Kimi-K3__pelican_bicycle__009
moonshotai__Kimi-K3__pelican_bicycle__009

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican wearing a red helmet rides a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 9,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican wearing a red helmet rides a red bicycle under a sunny sky with clouds.",
  "latency": 324.34,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__009.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__009.png"
}
moonshotai__Kimi-K3__pelican_bicycle__010
moonshotai__Kimi-K3__pelican_bicycle__010

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon stork wearing a red scarf is riding a red bicycle under a sunny sky with clouds and birds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 10,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork wearing a red scarf is riding a red bicycle under a sunny sky with clouds and birds.",
  "latency": 378.0,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__010.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__010.png"
}
moonshotai__Kimi-K3__pelican_bicycle__011
moonshotai__Kimi-K3__pelican_bicycle__011

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon stork is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 11,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with clouds.",
  "latency": 331.39,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__011.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__011.png"
}
moonshotai__Kimi-K3__pelican_bicycle__012
moonshotai__Kimi-K3__pelican_bicycle__012

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon stork is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 12,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle under a sunny sky with clouds.",
  "latency": 279.25,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__012.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__012.png"
}
moonshotai__Kimi-K3__pelican_bicycle__013
moonshotai__Kimi-K3__pelican_bicycle__013

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 13,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 542.65,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__013.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__013.png"
}
moonshotai__Kimi-K3__pelican_bicycle__014
moonshotai__Kimi-K3__pelican_bicycle__014

Upstream outputs, not a Pelican Map ranking · reward 0.838

A cartoon stork is riding a bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 14,
  "reward": 0.8375,
  "structure_score": 1.0,
  "semantic_score": 0.75,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a bicycle under a sunny sky with clouds.",
  "latency": 368.53,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__014.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__014.png"
}
moonshotai__Kimi-K3__pelican_bicycle__015
moonshotai__Kimi-K3__pelican_bicycle__015

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 15,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 394.98,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__015.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__015.png"
}
moonshotai__Kimi-K3__pelican_bicycle__016
moonshotai__Kimi-K3__pelican_bicycle__016

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a green bicycle under a sunny sky with a cloud.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 16,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a green bicycle under a sunny sky with a cloud.",
  "latency": 494.77,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__016.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__016.png"
}
moonshotai__Kimi-K3__pelican_bicycle__017
moonshotai__Kimi-K3__pelican_bicycle__017

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican is riding a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 17,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican is riding a red bicycle under a sunny sky with clouds.",
  "latency": 357.67,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__017.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__017.png"
}
moonshotai__Kimi-K3__pelican_bicycle__018
moonshotai__Kimi-K3__pelican_bicycle__018

Upstream outputs, not a Pelican Map ranking · reward 0.801

A cartoon stork is riding a red bicycle with a baby carriage attached, under a sunny sky with a cloud and sun visible.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 18,
  "reward": 0.8013888888888889,
  "structure_score": 1.0,
  "semantic_score": 0.6944444444444444,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon stork is riding a red bicycle with a baby carriage attached, under a sunny sky with a cloud and sun visible.",
  "latency": 449.24,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__018.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__018.png"
}
moonshotai__Kimi-K3__pelican_bicycle__019
moonshotai__Kimi-K3__pelican_bicycle__019

Upstream outputs, not a Pelican Map ranking · reward 1.000

A cartoon pelican wearing a red cap rides a red bicycle under a sunny sky with clouds.

Upstream SVG ↗ · Local SVG

Original fields and blind caption
{
  "model": "moonshotai/Kimi-K3",
  "access": "open",
  "provider": "hf-inference-providers",
  "task": "pelican_bicycle",
  "sample": 19,
  "reward": 1.0,
  "structure_score": 1.0,
  "semantic_score": 1.0,
  "gate_passed": true,
  "violations": [],
  "judge_model": "Qwen/Qwen2.5-VL-72B-Instruct",
  "judge_blind_caption": "A cartoon pelican wearing a red cap rides a red bicycle under a sunny sky with clouds.",
  "latency": 476.76,
  "svg": "svg/moonshotai__Kimi-K3__pelican_bicycle__019.svg",
  "png": "png/moonshotai__Kimi-K3__pelican_bicycle__019.png"
}

← Back to scoring reference