metric

`reasoning_tokens`

better: neutral: a description
kind: descriptive: says what the output was, never whether it was good
decides: no goal
weighed by: no goal
recorded on: ag_news_200, cnn_dailymail_200, dbpedia_280, few_nerd_280, scifact_200, summeval_100

01what it measures, and how

Tokens a reasoning model spent thinking before it answered, as the provider reported them: a description of the call, not a quality.

Read from the provider's usage (completion_tokens_details.reasoning_tokens or its equivalent). Empty when the provider does not report it, never 0. Billed with the completion tokens, so cost_usd already includes it.

02on ag_news_200

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

arm	items	scored against
ag_anthropic_l_n200_v1	200	gold/ag_news_200 gold
ag_anthropic_m_n200_v1	200	gold/ag_news_200 gold
ag_anthropic_s_n200_v1	200	gold/ag_news_200 gold
ag_deepseek_l_n200_v1	200	gold/ag_news_200 gold
ag_deepseek_m_n200_v1	200	gold/ag_news_200 gold
ag_deepseek_s_n200_v1	200	gold/ag_news_200 gold
ag_gemma_l_n200_v1	200	gold/ag_news_200 gold
ag_gemma_m_n200_v1	200	gold/ag_news_200 gold
ag_gemma_s_n200_v1	200	gold/ag_news_200 gold
ag_glm_l_n200_v1	200	gold/ag_news_200 gold
ag_glm_m_n200_v1	200	gold/ag_news_200 gold
ag_glm_s_n200_v1	200	gold/ag_news_200 gold
ag_llama_l_n200_v1	200	gold/ag_news_200 gold
ag_llama_m_n200_v1	200	gold/ag_news_200 gold
ag_llama_s_n200_v1	200	gold/ag_news_200 gold
ag_mistral_l_n200_v1	200	gold/ag_news_200 gold
ag_mistral_m_n200_v1	200	gold/ag_news_200 gold
ag_mistral_s_n200_v1	200	gold/ag_news_200 gold
ag_openai_l_n200_v1	200	gold/ag_news_200 gold
ag_openai_m_n200_v1	200	gold/ag_news_200 gold
ag_openai_s_n200_v1	200	gold/ag_news_200 gold
ag_qwen_l_n200_v1	200	gold/ag_news_200 gold
ag_qwen_m_n200_v1	200	gold/ag_news_200 gold
ag_qwen_s_n200_v1	200	gold/ag_news_200 gold
ag_anthropic_l_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_anthropic_m_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_anthropic_s_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_deepseek_l_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_deepseek_m_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_deepseek_s_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_gemma_l_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_gemma_m_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_gemma_s_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_glm_l_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_glm_m_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_glm_s_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_llama_l_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_llama_m_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_llama_s_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_mistral_l_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_mistral_m_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_mistral_s_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_openai_l_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_openai_m_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_openai_s_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_qwen_l_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_qwen_m_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold
ag_qwen_s_n200_v1 · adjudicated	200	gold/ag_news_200_adj1 gold

03on cnn_dailymail_200

Not drawn: cnn_anthropic_l_n200_v1 · silver, scored against the reference it wrote (its row is in the table).

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

arm	items	scored against
cnn_anthropic_l_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_anthropic_m_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_anthropic_s_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_deepseek_l_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_deepseek_m_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_deepseek_s_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_gemma_l_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_gemma_m_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_gemma_s_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_glm_l_n200_v1	199	gold/cnn_dailymail_200 gold
cnn_glm_m_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_glm_s_n200_v1	199	gold/cnn_dailymail_200 gold
cnn_llama_l_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_llama_m_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_llama_s_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_mistral_l_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_mistral_m_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_mistral_s_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_openai_l_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_openai_m_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_openai_s_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_qwen_l_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_qwen_m_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_qwen_s_n200_v1	200	gold/cnn_dailymail_200 gold
cnn_anthropic_l_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_anthropic_m_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_anthropic_s_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_deepseek_l_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_deepseek_m_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_deepseek_s_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_gemma_l_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_gemma_m_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_gemma_s_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_glm_l_n200_v1 · silver	199	silver/cnn_dailymail_200 silver
cnn_glm_m_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_glm_s_n200_v1 · silver	199	silver/cnn_dailymail_200 silver
cnn_llama_l_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_llama_m_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_llama_s_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_mistral_l_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_mistral_m_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_mistral_s_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_openai_l_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_openai_m_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_openai_s_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_qwen_l_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_qwen_m_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_qwen_s_n200_v1 · silver	200	silver/cnn_dailymail_200 silver
cnn_anthropic_l_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_anthropic_m_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_anthropic_s_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_deepseek_l_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_deepseek_m_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_deepseek_s_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_gemma_l_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_gemma_m_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_gemma_s_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_glm_l_n200_v1 · judged/judge-summ-pick-v1	197	judge `judge-summ-pick-v1`
cnn_glm_m_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_glm_s_n200_v1 · judged/judge-summ-pick-v1	197	judge `judge-summ-pick-v1`
cnn_llama_l_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_llama_m_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_llama_s_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_mistral_l_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_mistral_m_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_mistral_s_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_openai_l_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_openai_m_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_openai_s_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_qwen_l_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_qwen_m_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_qwen_s_n200_v1 · judged/judge-summ-pick-v1	198	judge `judge-summ-pick-v1`
cnn_deepseek_m_n200_v1 · judged/judge-summ-pointwise-v1	200	judge `judge-summ-pointwise-v1`
cnn_anthropic_l_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_anthropic_m_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_anthropic_s_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_deepseek_l_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_deepseek_m_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_deepseek_s_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_gemma_l_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_gemma_m_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_gemma_s_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_glm_l_n200_v1 · judged/judge-summ-v1	196	judge `judge-summ-v1`
cnn_glm_m_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_glm_s_n200_v1 · judged/judge-summ-v1	196	judge `judge-summ-v1`
cnn_llama_l_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_llama_m_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_llama_s_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_mistral_l_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_mistral_m_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_mistral_s_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_openai_l_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_openai_m_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_openai_s_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_qwen_l_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_qwen_m_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_qwen_s_n200_v1 · judged/judge-summ-v1	197	judge `judge-summ-v1`
cnn_anthropic_l_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_anthropic_m_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_anthropic_s_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_deepseek_l_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_deepseek_m_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_deepseek_s_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_gemma_l_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_gemma_m_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_gemma_s_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_glm_l_n200_v1 · judged/judge-summ-v2	199	judge `judge-summ-v2`
cnn_glm_m_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_glm_s_n200_v1 · judged/judge-summ-v2	199	judge `judge-summ-v2`
cnn_llama_l_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_llama_m_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_llama_s_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_mistral_l_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_mistral_m_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_mistral_s_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_openai_l_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_openai_m_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_openai_s_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_qwen_l_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_qwen_m_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`
cnn_qwen_s_n200_v1 · judged/judge-summ-v2	200	judge `judge-summ-v2`

04on dbpedia_280

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

arm	items	scored against
db_anthropic_l_n200_v1	280	gold/dbpedia_280 gold
db_anthropic_m_n200_v1	280	gold/dbpedia_280 gold
db_anthropic_s_n200_v1	280	gold/dbpedia_280 gold
db_deepseek_l_n200_v1	280	gold/dbpedia_280 gold
db_deepseek_m_n200_v1	280	gold/dbpedia_280 gold
db_deepseek_s_n200_v1	280	gold/dbpedia_280 gold
db_gemma_l_n200_v1	280	gold/dbpedia_280 gold
db_gemma_m_n200_v1	280	gold/dbpedia_280 gold
db_gemma_s_n200_v1	280	gold/dbpedia_280 gold
db_glm_l_n200_v1	280	gold/dbpedia_280 gold
db_glm_m_n200_v1	280	gold/dbpedia_280 gold
db_glm_s_n200_v1	279	gold/dbpedia_280 gold
db_llama_l_n200_v1	280	gold/dbpedia_280 gold
db_llama_m_n200_v1	280	gold/dbpedia_280 gold
db_llama_s_n200_v1	280	gold/dbpedia_280 gold
db_mistral_l_n200_v1	280	gold/dbpedia_280 gold
db_mistral_m_n200_v1	280	gold/dbpedia_280 gold
db_mistral_s_n200_v1	280	gold/dbpedia_280 gold
db_openai_l_n200_v1	280	gold/dbpedia_280 gold
db_openai_m_n200_v1	280	gold/dbpedia_280 gold
db_openai_s_n200_v1	280	gold/dbpedia_280 gold
db_qwen_l_n200_v1	280	gold/dbpedia_280 gold
db_qwen_m_n200_v1	280	gold/dbpedia_280 gold
db_qwen_s_n200_v1	280	gold/dbpedia_280 gold

05on few_nerd_280

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

arm	items	scored against
fn_anthropic_l_n200_v1	280	gold/few_nerd_280 gold
fn_anthropic_m_n200_v1	280	gold/few_nerd_280 gold
fn_anthropic_s_n200_v1	280	gold/few_nerd_280 gold
fn_deepseek_l_n200_v1	280	gold/few_nerd_280 gold
fn_deepseek_m_n200_v1	280	gold/few_nerd_280 gold
fn_deepseek_s_n200_v1	280	gold/few_nerd_280 gold
fn_gemma_l_n200_v1	280	gold/few_nerd_280 gold
fn_gemma_m_n200_v1	280	gold/few_nerd_280 gold
fn_gemma_s_n200_v1	280	gold/few_nerd_280 gold
fn_glm_l_n200_v1	280	gold/few_nerd_280 gold
fn_glm_m_n200_v1	280	gold/few_nerd_280 gold
fn_glm_s_n200_v1	280	gold/few_nerd_280 gold
fn_llama_l_n200_v1	280	gold/few_nerd_280 gold
fn_llama_m_n200_v1	280	gold/few_nerd_280 gold
fn_llama_s_n200_v1	280	gold/few_nerd_280 gold
fn_mistral_l_n200_v1	280	gold/few_nerd_280 gold
fn_mistral_m_n200_v1	280	gold/few_nerd_280 gold
fn_mistral_s_n200_v1	280	gold/few_nerd_280 gold
fn_openai_l_n200_v1	280	gold/few_nerd_280 gold
fn_openai_m_n200_v1	280	gold/few_nerd_280 gold
fn_openai_s_n200_v1	280	gold/few_nerd_280 gold
fn_qwen_l_n200_v1	280	gold/few_nerd_280 gold
fn_qwen_m_n200_v1	280	gold/few_nerd_280 gold
fn_qwen_s_n200_v1	280	gold/few_nerd_280 gold

06on scifact_200

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

arm	mean reasoning_tokens	items	scored against
sf_deepseek_m_n200_v1	3.500	200	gold/scifact_200 gold
sf_deepseek_s_n200_v1	0.000	200	gold/scifact_200 gold
sf_gemma_l_n200_v1	0.000	200	gold/scifact_200 gold
sf_gemma_m_n200_v1	0.000	200	gold/scifact_200 gold
sf_gemma_s_n200_v1	0.000	200	gold/scifact_200 gold
sf_glm_m_n200_v1	0.000	200	gold/scifact_200 gold
sf_glm_s_n200_v1	0.000	200	gold/scifact_200 gold
sf_llama_l_n200_v1	0.000	200	gold/scifact_200 gold
sf_llama_m_n200_v1	0.000	200	gold/scifact_200 gold
sf_llama_s_n200_v1	0.000	200	gold/scifact_200 gold
sf_mistral_s_n200_v1	0.000	200	gold/scifact_200 gold
sf_qwen_s_n200_v1	0.000	200	gold/scifact_200 gold
sf_glm_s_bm25first_n200_v1 · pair	0.000	200	gold/scifact_200 gold
sf_glm_s_e5first_n200_v1 · pair	0.000	200	gold/scifact_200 gold
sf_qwen_s_bm25first_n200_v1 · pair	0.000	200	gold/scifact_200 gold
sf_qwen_s_e5first_n200_v1 · pair	0.000	200	gold/scifact_200 gold
sf_llama_l_n200_v1 · repeats	0.000	200	gold/scifact_200 gold
sf_llama_s_n200_v1 · repeats	0.000	200	gold/scifact_200 gold
sf_qwen_s_n200_v1 · repeats	0.000	200	gold/scifact_200 gold

07on summeval_100

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

arm	items	scored against
se_anthropic_l_n100_v1	100	gold/summeval_100 gold
se_anthropic_m_n100_v1	100	gold/summeval_100 gold
se_anthropic_s_n100_v1	100	gold/summeval_100 gold
se_deepseek_l_n100_v1	100	gold/summeval_100 gold
se_deepseek_m_n100_v1	100	gold/summeval_100 gold
se_deepseek_s_n100_v1	100	gold/summeval_100 gold
se_gemma_l_n100_pairwise_v1	100	gold/summeval_100 gold
se_gemma_l_n100_pick_v1	100	gold/summeval_100 gold
se_gemma_l_n100_v1	100	gold/summeval_100 gold
se_gemma_m_n100_v1	100	gold/summeval_100 gold
se_gemma_s_n100_v1	100	gold/summeval_100 gold
se_glm_l_n100_v1	100	gold/summeval_100 gold
se_glm_m_n100_v1	100	gold/summeval_100 gold
se_glm_s_n100_v1	100	gold/summeval_100 gold
se_llama_l_n100_v1	100	gold/summeval_100 gold
se_llama_m_n100_v1	100	gold/summeval_100 gold
se_llama_s_n100_v1	100	gold/summeval_100 gold
se_mistral_l_n100_v1	100	gold/summeval_100 gold
se_mistral_m_n100_v1	100	gold/summeval_100 gold
se_mistral_s_n100_v1	100	gold/summeval_100 gold
se_openai_l_n100_v1	100	gold/summeval_100 gold
se_openai_m_n100_v1	100	gold/summeval_100 gold
se_openai_s_n100_v1	100	gold/summeval_100 gold
se_qwen37max_n100_v1	100	gold/summeval_100 gold
se_qwen_m_n100_v1	100	gold/summeval_100 gold
se_qwen_s_n100_pairwise_v1	100	gold/summeval_100 gold
se_qwen_s_n100_pick_v1	100	gold/summeval_100 gold
se_qwen_s_n100_v1	100	gold/summeval_100 gold
se_gemma_l_pubtext_n100_v1 · pair	100	gold/summeval_100 gold
se_gemma_l_pubtextcw_n100_v1 · pair	100	gold/summeval_100 gold