reference

`gold/summeval_100` gold

Promoted as gold: the yardstick a decision rests on.
Promoted from person the dataset's authors, 2026-10-15: promoted before labels existed (0.6.0): its tier was given when it was made

01what it is

tier: gold
dataset: summeval_100
promoted from: person the dataset's authors
why: promoted before labels existed (0.6.0): its tier was given when it was made
items: 100
created: 2026-10-15T13:03:29Z

02scored against it · 41

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

arm	metric	mean	items
se_gemma_l_n100_pairwise_v1	pair_agreement	0.825	100	inspect
se_qwen_s_n100_pairwise_v1	pair_agreement	0.812	100	inspect
se_random_n100_pairwise_v1	pair_agreement	0.473	100	inspect
se_gemma_l_pubtext_n100_v1 · pair	tau	0.551	100	inspect
se_openai_l_n100_v1	tau	0.540	100	inspect
se_gemma_l_pubtextcw_n100_v1 · pair	tau	0.540	100	inspect
se_gemma_l_n100_v1	tau	0.538	100	inspect
se_anthropic_l_n100_v1	tau	0.528	100	inspect
se_openai_m_n100_v1	tau	0.528	100	inspect
se_qwen37max_n100_v1	tau	0.520	100	inspect
se_qwen_s_n100_v1	tau	0.519	100	inspect
se_glm_m_n100_v1	tau	0.517	100	inspect
se_qwen_m_n100_v1	tau	0.507	100	inspect
se_glm_l_n100_v1	tau	0.492	100	inspect
se_deepseek_m_n100_v1	tau	0.486	100	inspect
se_anthropic_s_n100_v1	tau	0.484	100	inspect
se_anthropic_m_n100_v1	tau	0.480	100	inspect
se_gemma_m_n100_v1	tau	0.477	100	inspect
se_deepseek_l_n100_v1	tau	0.469	100	inspect
se_mistral_m_n100_v1	tau	0.468	100	inspect
se_deepseek_s_n100_v1	tau	0.459	100	inspect
se_mistral_l_n100_v1	tau	0.455	100	inspect
se_llama_l_n100_v1	tau	0.454	100	inspect
se_glm_s_n100_v1	tau	0.446	100	inspect
se_mistral_s_n100_v1	tau	0.427	100	inspect
se_gemma_s_n100_v1	tau	0.420	100	inspect
se_openai_s_n100_v1	tau	0.411	100	inspect
se_llama_m_n100_v1	tau	0.406	100	inspect
se_unievalpub_n100_v1	tau	0.372	100	inspect
se_llama_s_n100_v1	tau	0.353	100	inspect
se_unieval_n100_v1	tau	0.348	100	inspect
se_bartscore_n100_v1	tau	0.256	100	inspect
se_rouge2_n100_v1	tau	0.158	100	inspect
se_rouge1_n100_v1	tau	0.149	100	inspect
se_rougeL_n100_v1	tau	0.143	100	inspect
se_coverage_n100_v1	tau	0.101	100	inspect
se_length_n100_v1	tau	0.039	100	inspect
se_random_n100_v1	tau	0.003	100	inspect
se_gemma_l_n100_pick_v1	top1	0.364	100	inspect
se_qwen_s_n100_pick_v1	top1	0.263	100	inspect
se_random_n100_pick_v1	top1	0.070	100	inspect

gold/summeval_100 gold

`gold/summeval_100` gold