dataset
cnn_dailymail_200
200 items · 153 arms. Headline: each arm's own primary metric, mean over its items; arms with different primary metrics are not ranked against each other.
baseline, promoted 2026-10-25
bart_l (BART-large-CNN, MIT, $0 on a CPU) leads on coverage at 0.3461, not significantly different from deepseek_m (0.3460, p = 0.99), for CNN-style text; rent deepseek_m if you need speed. REPORT_SUMMARIZATION, executive summary.
Inspect the 35 arms on coverage, scored against gold/cnn_dailymail_200Inspect the 29 arms on coverage, scored against silver/cnn_dailymail_200Inspect the 29 arms on judge_score, judged by judge-summ-v1Inspect the 29 arms on judge_score, judged by judge-summ-v2Inspect the 29 arms on judge_won, judged by judge-summ-pick-v1Inspect the 2 arms on judge_score_unvalidated, judged by judge-summ-pointwise-v1Open its sheet
goals: Short news summaries (CNN)
01arms
scored against silverscored by a judgescored against a label set, not a reference setunmarked rows are scored against gold
153 shown
| arm | metric | mean | items | cost per item | speed per item | runs | scored against | |
|---|---|---|---|---|---|---|---|---|
| cnn_bart_l_n200_v1 baseline run on mac-dev · Darwin/x86_64, 12 CPUs | coverage | 0.346 | 200 | $0.000000 · 763 tok | p50 10,724 · p95 14,371 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_bart_l_n200_v1 · linux run on Linux/x86_64, 4 CPUs | coverage | 0.346 | 200 | $0.000000 · 763 tok | p50 6,257 · p95 9,188 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_deepseek_m_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.346 | 200 | $0.000191 · 812 tok | p50 1,497 · p95 2,924 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_llama_l_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.339 | 200 | $0.000195 · 805 tok | p50 3,646 · p95 5,531 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_llama_m_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.338 | 200 | $0.000165 · 809 tok | p50 2,682 · p95 11,240 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_bart_m_n200_v1 run on Linux/x86_64, 4 CPUs | coverage | 0.337 | 200 | $0.000000 · 766 tok | p50 4,649 · p95 7,223 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_bart_m_n200_v1 · linux run on Linux/x86_64, 4 CPUs | coverage | 0.337 | 200 | $0.000000 · 766 tok | p50 4,108 · p95 6,463 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_llama_s_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.333 | 200 | $0.000111 · 814 tok | p50 2,204 · p95 4,041 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_deepseek_l_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.332 | 200 | $0.000694 · 802 tok | p50 2,354 · p95 4,380 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_glm_m_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.332 | 200 | $0.000497 · 803 tok | p50 1,848 · p95 7,145 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_deepseek_s_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.328 | 200 | $0.000069 · 800 tok | p50 2,237 · p95 5,644 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_bart_s_n200_v1 run on Linux/x86_64, 4 CPUs | coverage | 0.328 | 200 | $0.000000 · 761 tok | p50 3,683 · p95 5,055 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_bart_s_n200_v1 · linux run on Linux/x86_64, 4 CPUs | coverage | 0.328 | 200 | $0.000000 · 761 tok | p50 3,387 · p95 4,550 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_bart_s_n200_v1 · repeats run on Linux/x86_64, 4 CPUs | coverage | 0.328 | 200 | $0.000000 · 761 tok | p50 3,708 · p95 4,822 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_openai_m_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.327 | 200 | $0.005358 · 786 tok | p50 1,719 · p95 2,126 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_openai_l_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.327 | 200 | $0.002181 · 786 tok | p50 1,735 · p95 2,381 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_mistral_s_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.326 | 200 | $0.000089 · 833 tok | p50 2,573 · p95 5,142 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_anthropic_s_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.324 | 200 | $0.001305 · 897 tok | p50 1,982 · p95 2,834 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_anthropic_m_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.324 | 200 | $0.003739 · 1,282 tok | p50 2,992 · p95 3,675 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_gemma_l_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.320 | 200 | $0.000119 · 810 tok | p50 1,817 · p95 6,172 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_openai_s_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.317 | 200 | $0.000836 · 793 tok | p50 1,238 · p95 1,573 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_anthropic_l_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.315 | 200 | $0.009826 · 1,301 tok | p50 3,259 · p95 4,718 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_glm_s_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.314 | 200 | $0.000152 · 786 tok | p50 1,580 · p95 2,341 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_gemma_m_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.314 | 200 | $0.000077 · 812 tok | p50 1,388 · p95 4,483 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_glm_l_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.312 | 200 | $0.000766 · 818 tok | p50 2,351 · p95 12,758 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_gemma_s_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.312 | 200 | $0.000100 · 820 tok | p50 5,933 · p95 12,255 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_qwen_l_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.311 | 200 | $0.000844 · 828 tok | p50 2,732 · p95 4,428 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_mistral_l_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.308 | 200 | $0.000486 · 828 tok | p50 2,272 · p95 51,619 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_qwen_s_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.307 | 200 | $0.000135 · 825 tok | p50 7,855 · p95 108,807 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_mistral_m_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.304 | 200 | $0.000435 · 832 tok | p50 2,495 · p95 4,801 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_qwen_m_n200_v1 run on Darwin/x86_64, 12 CPUs | coverage | 0.303 | 200 | $0.000331 · 826 tok | p50 1,531 · p95 1,911 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_lead3_n200_v1 run on mac-dev · Darwin/x86_64, 12 CPUs | coverage | 0.272 | 200 | $0.000000 | p50 0.057 · p95 0.13 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_lead3_n200_v1 · linux run on Linux/x86_64, 4 CPUs | coverage | 0.272 | 200 | $0.000000 | p50 0.063 · p95 0.15 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_bart_l_xsum_n200_v1 run on Linux/x86_64, 4 CPUs | coverage | 0.207 | 200 | $0.000000 · 725 tok | p50 4,433 · p95 7,325 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_bart_l_xsum_n200_v1 · linux run on Linux/x86_64, 4 CPUs | coverage | 0.207 | 200 | $0.000000 · 725 tok | p50 3,934 · p95 7,054 ms | 1 | gold/cnn_dailymail_200 gold | inspect |
| cnn_anthropic_l_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 1.000 | 200 | $0.009826 · 1,301 tok | p50 3,259 · p95 4,718 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_anthropic_m_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.491 | 200 | $0.003739 · 1,282 tok | p50 2,992 · p95 3,675 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_deepseek_m_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.471 | 200 | $0.000191 · 812 tok | p50 1,497 · p95 2,924 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_anthropic_s_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.469 | 200 | $0.001305 · 897 tok | p50 1,982 · p95 2,834 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_deepseek_l_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.399 | 200 | $0.000694 · 802 tok | p50 2,354 · p95 4,380 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_qwen_l_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.398 | 200 | $0.000844 · 828 tok | p50 2,732 · p95 4,428 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_glm_m_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.389 | 200 | $0.000497 · 803 tok | p50 1,848 · p95 7,145 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_llama_s_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.388 | 200 | $0.000111 · 814 tok | p50 2,204 · p95 4,041 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_deepseek_s_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.388 | 200 | $0.000069 · 800 tok | p50 2,237 · p95 5,644 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_openai_s_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.384 | 200 | $0.000836 · 793 tok | p50 1,238 · p95 1,573 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_mistral_s_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.382 | 200 | $0.000089 · 833 tok | p50 2,573 · p95 5,142 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_qwen_m_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.381 | 200 | $0.000331 · 826 tok | p50 1,531 · p95 1,911 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_glm_l_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.375 | 200 | $0.000766 · 818 tok | p50 2,351 · p95 12,758 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_openai_l_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.371 | 200 | $0.002181 · 786 tok | p50 1,735 · p95 2,381 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_llama_l_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.370 | 200 | $0.000195 · 805 tok | p50 3,646 · p95 5,531 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_openai_m_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.359 | 200 | $0.005358 · 786 tok | p50 1,719 · p95 2,126 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_llama_m_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.358 | 200 | $0.000165 · 809 tok | p50 2,682 · p95 11,240 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_gemma_s_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.350 | 200 | $0.000100 · 820 tok | p50 5,933 · p95 12,255 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_gemma_m_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.342 | 200 | $0.000077 · 812 tok | p50 1,388 · p95 4,483 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_gemma_l_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.342 | 200 | $0.000119 · 810 tok | p50 1,817 · p95 6,172 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_mistral_l_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.337 | 200 | $0.000486 · 828 tok | p50 2,272 · p95 51,619 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_qwen_s_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.334 | 200 | $0.000135 · 825 tok | p50 7,855 · p95 108,807 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_mistral_m_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.320 | 200 | $0.000435 · 832 tok | p50 2,495 · p95 4,801 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_bart_m_n200_v1 · silver run on Linux/x86_64, 4 CPUs | coverage | 0.320 | 200 | $0.000000 · 766 tok | p50 4,649 · p95 7,223 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_bart_l_n200_v1 · silver run on mac-dev · Darwin/x86_64, 12 CPUs | coverage | 0.317 | 200 | $0.000000 · 763 tok | p50 10,724 · p95 14,371 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_bart_s_n200_v1 · silver run on Linux/x86_64, 4 CPUs | coverage | 0.306 | 200 | $0.000000 · 761 tok | p50 3,683 · p95 5,055 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_glm_s_n200_v1 · silver run on Darwin/x86_64, 12 CPUs | coverage | 0.303 | 200 | $0.000152 · 786 tok | p50 1,580 · p95 2,341 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_lead3_n200_v1 · silver run on mac-dev · Darwin/x86_64, 12 CPUs | coverage | 0.300 | 200 | $0.000000 | p50 0.057 · p95 0.13 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_bart_l_xsum_n200_v1 · silver run on Linux/x86_64, 4 CPUs | coverage | 0.137 | 200 | $0.000000 · 725 tok | p50 4,433 · p95 7,325 ms | 1 | silver/cnn_dailymail_200 silver | inspect |
| cnn_anthropic_l_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.976 | 197 | $0.009811 · 1,298 tok | p50 3,258 · p95 4,724 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_anthropic_m_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.963 | 197 | $0.003730 · 1,278 tok | p50 2,992 · p95 3,678 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_anthropic_s_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.952 | 197 | $0.001301 · 894 tok | p50 1,981 · p95 2,838 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_deepseek_m_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.923 | 197 | $0.000191 · 809 tok | p50 1,489 · p95 2,889 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_anthropic_l_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.888 | 200 | $0.009826 · 1,301 tok | p50 3,259 · p95 4,718 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_deepseek_l_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.877 | 197 | $0.000685 · 799 tok | p50 2,350 · p95 4,386 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_qwen_m_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.876 | 197 | $0.000330 · 824 tok | p50 1,529 · p95 1,913 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_glm_m_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.861 | 197 | $0.000497 · 801 tok | p50 1,853 · p95 7,153 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_deepseek_m_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.854 | 200 | $0.000191 · 812 tok | p50 1,497 · p95 2,924 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_openai_l_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.847 | 200 | $0.002181 · 786 tok | p50 1,735 · p95 2,381 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_openai_s_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.825 | 197 | $0.000834 · 791 tok | p50 1,238 · p95 1,588 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_deepseek_s_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.818 | 197 | $0.000069 · 797 tok | p50 2,247 · p95 5,697 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_qwen_l_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.812 | 197 | $0.000842 · 826 tok | p50 2,725 · p95 4,438 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_openai_m_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.811 | 200 | $0.005358 · 786 tok | p50 1,719 · p95 2,126 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_anthropic_m_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.809 | 200 | $0.003739 · 1,282 tok | p50 2,992 · p95 3,675 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_gemma_s_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.801 | 197 | $0.000100 · 818 tok | p50 5,952 · p95 12,351 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_mistral_s_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.798 | 197 | $0.000089 · 831 tok | p50 2,575 · p95 5,148 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_openai_m_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.795 | 197 | $0.005346 · 784 tok | p50 1,720 · p95 2,132 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_openai_l_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.773 | 197 | $0.002175 · 783 tok | p50 1,733 · p95 2,376 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_deepseek_l_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.763 | 200 | $0.000694 · 802 tok | p50 2,354 · p95 4,380 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_openai_s_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.747 | 200 | $0.000836 · 793 tok | p50 1,238 · p95 1,573 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_anthropic_s_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.728 | 200 | $0.001305 · 897 tok | p50 1,982 · p95 2,834 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_glm_m_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.718 | 200 | $0.000497 · 803 tok | p50 1,848 · p95 7,145 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_gemma_l_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.715 | 197 | $0.000119 · 808 tok | p50 1,826 · p95 6,351 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_mistral_m_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.708 | 197 | $0.000434 · 830 tok | p50 2,496 · p95 4,810 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_gemma_m_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.707 | 197 | $0.000077 · 810 tok | p50 1,386 · p95 4,487 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_llama_s_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.704 | 197 | $0.000111 · 812 tok | p50 2,195 · p95 4,062 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_llama_l_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.700 | 197 | $0.000193 · 803 tok | p50 3,657 · p95 5,541 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_mistral_l_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.698 | 197 | $0.000485 · 826 tok | p50 2,240 · p95 51,633 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_llama_m_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.674 | 197 | $0.000165 · 807 tok | p50 2,692 · p95 11,257 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_deepseek_s_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.644 | 200 | $0.000069 · 800 tok | p50 2,237 · p95 5,644 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_qwen_s_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.609 | 197 | $0.000135 · 823 tok | p50 7,347 · p95 110,048 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_glm_l_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.607 | 197 | $0.000763 · 816 tok | p50 2,351 · p95 12,769 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_gemma_l_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.603 | 200 | $0.000119 · 810 tok | p50 1,817 · p95 6,172 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_qwen_m_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.600 | 200 | $0.000331 · 826 tok | p50 1,531 · p95 1,911 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_gemma_m_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.585 | 200 | $0.000077 · 812 tok | p50 1,388 · p95 4,483 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_qwen_l_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.573 | 200 | $0.000844 · 828 tok | p50 2,732 · p95 4,428 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_glm_s_n200_v1 · judged/judge-summ-v1 run on Darwin/x86_64, 12 CPUs | judge_score | 4.530 | 197 | $0.000152 · 783 tok | p50 1,587 · p95 2,343 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_llama_l_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.529 | 200 | $0.000195 · 805 tok | p50 3,646 · p95 5,531 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_llama_m_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.488 | 200 | $0.000165 · 809 tok | p50 2,682 · p95 11,240 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_llama_s_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.469 | 200 | $0.000111 · 814 tok | p50 2,204 · p95 4,041 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_qwen_s_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.461 | 200 | $0.000135 · 825 tok | p50 7,855 · p95 108,807 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_gemma_s_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.429 | 200 | $0.000100 · 820 tok | p50 5,933 · p95 12,255 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_glm_s_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.420 | 200 | $0.000152 · 786 tok | p50 1,580 · p95 2,341 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_mistral_s_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.408 | 200 | $0.000089 · 833 tok | p50 2,573 · p95 5,142 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_glm_l_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.384 | 200 | $0.000766 · 818 tok | p50 2,351 · p95 12,758 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_mistral_m_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.309 | 200 | $0.000435 · 832 tok | p50 2,495 · p95 4,801 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_mistral_l_n200_v1 · judged/judge-summ-v2 run on Darwin/x86_64, 12 CPUs | judge_score | 4.037 | 200 | $0.000486 · 828 tok | p50 2,272 · p95 51,619 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_bart_l_n200_v1 · judged/judge-summ-v1 run on mac-dev · Darwin/x86_64, 12 CPUs | judge_score | 3.868 | 197 | $0.000000 · 761 tok | p50 10,700 · p95 14,266 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_bart_l_n200_v1 · judged/judge-summ-v2 run on mac-dev · Darwin/x86_64, 12 CPUs | judge_score | 3.821 | 200 | $0.000000 · 763 tok | p50 10,724 · p95 14,371 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_bart_m_n200_v1 · judged/judge-summ-v1 run on Linux/x86_64, 4 CPUs | judge_score | 3.564 | 197 | $0.000000 · 764 tok | p50 4,621 · p95 7,239 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_bart_l_xsum_n200_v1 · judged/judge-summ-v1 run on Linux/x86_64, 4 CPUs | judge_score | 3.516 | 197 | $0.000000 · 723 tok | p50 4,368 · p95 7,328 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_lead3_n200_v1 · judged/judge-summ-v1 run on mac-dev · Darwin/x86_64, 12 CPUs | judge_score | 3.421 | 197 | $0.000000 | p50 0.057 · p95 0.13 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_bart_l_xsum_n200_v1 · judged/judge-summ-v2 run on Linux/x86_64, 4 CPUs | judge_score | 3.366 | 200 | $0.000000 · 725 tok | p50 4,433 · p95 7,325 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_lead3_n200_v1 · judged/judge-summ-v2 run on mac-dev · Darwin/x86_64, 12 CPUs | judge_score | 3.339 | 200 | $0.000000 | p50 0.057 · p95 0.13 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_bart_m_n200_v1 · judged/judge-summ-v2 run on Linux/x86_64, 4 CPUs | judge_score | 3.235 | 200 | $0.000000 · 766 tok | p50 4,649 · p95 7,223 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_bart_s_n200_v1 · judged/judge-summ-v1 run on Linux/x86_64, 4 CPUs | judge_score | 3.185 | 197 | $0.000000 · 759 tok | p50 3,672 · p95 5,058 ms | 1 | judge judge-summ-v1 | inspect |
| cnn_bart_s_n200_v1 · judged/judge-summ-v2 run on Linux/x86_64, 4 CPUs | judge_score | 2.946 | 200 | $0.000000 · 761 tok | p50 3,683 · p95 5,055 ms | 1 | judge judge-summ-v2 | inspect |
| cnn_deepseek_m_n200_v1 · judged/judge-summ-pointwise-v1 run on Darwin/x86_64, 12 CPUs | judge_score_unvalidated | 4.940 | 200 | $0.000191 · 812 tok | p50 1,497 · p95 2,924 ms | 1 | judge judge-summ-pointwise-v1 | inspect |
| cnn_bart_l_n200_v1 · judged/judge-summ-pointwise-v1 run on mac-dev · Darwin/x86_64, 12 CPUs | judge_score_unvalidated | 4.181 | 200 | $0.000000 · 763 tok | p50 10,724 · p95 14,371 ms | 1 | judge judge-summ-pointwise-v1 | inspect |
| cnn_anthropic_l_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.402 | 198 | $0.009783 · 1,293 tok | p50 3,259 · p95 4,722 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_anthropic_s_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.226 | 198 | $0.001299 · 892 tok | p50 1,980 · p95 2,836 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_anthropic_m_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.144 | 198 | $0.003724 · 1,275 tok | p50 2,992 · p95 3,677 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_deepseek_m_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.083 | 198 | $0.000189 · 807 tok | p50 1,497 · p95 2,927 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_qwen_l_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.059 | 198 | $0.000840 · 823 tok | p50 2,732 · p95 4,435 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_qwen_m_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.020 | 198 | $0.000329 · 821 tok | p50 1,528 · p95 1,912 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_deepseek_l_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.014 | 198 | $0.000699 · 797 tok | p50 2,348 · p95 4,384 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_openai_s_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.008 | 198 | $0.000833 · 788 tok | p50 1,238 · p95 1,583 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_glm_l_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.006 | 198 | $0.000765 · 813 tok | p50 2,351 · p95 12,765 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_gemma_m_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.005 | 198 | $0.000076 · 807 tok | p50 1,388 · p95 4,485 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_glm_m_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.005 | 198 | $0.000496 · 798 tok | p50 1,848 · p95 7,151 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_openai_l_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.004 | 198 | $0.002169 · 781 tok | p50 1,731 · p95 2,385 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_mistral_s_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.004 | 198 | $0.000089 · 828 tok | p50 2,573 · p95 5,085 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_deepseek_s_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.004 | 198 | $0.000068 · 795 tok | p50 2,227 · p95 5,599 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_openai_m_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.004 | 198 | $0.005335 · 781 tok | p50 1,719 · p95 2,130 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_llama_l_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.003 | 198 | $0.000194 · 800 tok | p50 3,646 · p95 5,538 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_mistral_l_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.003 | 198 | $0.000484 · 823 tok | p50 2,236 · p95 51,435 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_gemma_s_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.002 | 198 | $0.000099 · 816 tok | p50 5,887 · p95 12,319 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_llama_s_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.001 | 198 | $0.000111 · 809 tok | p50 2,191 · p95 4,013 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_qwen_s_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.001 | 198 | $0.000134 · 820 tok | p50 7,855 · p95 109,634 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_glm_s_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.001 | 198 | $0.000151 · 781 tok | p50 1,580 · p95 2,342 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_gemma_l_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.001 | 198 | $0.000118 · 805 tok | p50 1,817 · p95 6,291 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_llama_m_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.001 | 198 | $0.000163 · 804 tok | p50 2,682 · p95 11,251 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_bart_l_n200_v1 · judged/judge-summ-pick-v1 run on mac-dev · Darwin/x86_64, 12 CPUs | judge_won | 0.000 | 198 | $0.000000 · 759 tok | p50 10,690 · p95 14,372 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_bart_l_xsum_n200_v1 · judged/judge-summ-pick-v1 run on Linux/x86_64, 4 CPUs | judge_won | 0.000 | 198 | $0.000000 · 721 tok | p50 4,392 · p95 7,327 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_bart_m_n200_v1 · judged/judge-summ-pick-v1 run on Linux/x86_64, 4 CPUs | judge_won | 0.000 | 198 | $0.000000 · 761 tok | p50 4,623 · p95 7,234 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_bart_s_n200_v1 · judged/judge-summ-pick-v1 run on Linux/x86_64, 4 CPUs | judge_won | 0.000 | 198 | $0.000000 · 757 tok | p50 3,675 · p95 5,057 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_lead3_n200_v1 · judged/judge-summ-pick-v1 run on mac-dev · Darwin/x86_64, 12 CPUs | judge_won | 0.000 | 198 | $0.000000 | p50 0.057 · p95 0.13 ms | 1 | judge judge-summ-pick-v1 | inspect |
| cnn_mistral_m_n200_v1 · judged/judge-summ-pick-v1 run on Darwin/x86_64, 12 CPUs | judge_won | 0.000 | 198 | $0.000433 · 827 tok | p50 2,482 · p95 4,807 ms | 1 | judge judge-summ-pick-v1 | inspect |
02what's inside
200 items, text, 102–1497 words (median 465, middle half 283–774).
Source: abisee/cnn_dailymail (test split). The text stays there; each item below links to its row.
the gold
gold/cnn_dailymail_200: text, 14–67 words, median 34
200 shown
| item | words | gold | open |
|---|---|---|---|
012819ffa254 | 871 | 33 words | source ↗ · inspect |
04c28c2d6c52 | 1497 | 41 words | source ↗ · inspect |
054ccc280767 | 261 | 50 words | source ↗ · inspect |
07f60889bcd1 | 926 | 18 words | source ↗ · inspect |
0a6b027b3384 | 455 | 27 words | source ↗ · inspect |
0b66cb7ebcfd | 235 | 41 words | source ↗ · inspect |
0d3c8c276d07 | 361 | 44 words | source ↗ · inspect |
0f39feebc34f | 648 | 45 words | source ↗ · inspect |
12a3eec84bff | 283 | 23 words | source ↗ · inspect |
12d18fce8155 | 171 | 38 words | source ↗ · inspect |
130663882dcf | 455 | 15 words | source ↗ · inspect |
17412737648b | 344 | 36 words | source ↗ · inspect |
18e1af12d679 | 238 | 22 words | source ↗ · inspect |
192bf513d8ad | 196 | 52 words | source ↗ · inspect |
1b2cc634e2bf | 440 | 24 words | source ↗ · inspect |
1c26bc664022 | 362 | 26 words | source ↗ · inspect |
1dd00c89d71a | 954 | 45 words | source ↗ · inspect |
1ecb11d97cc3 | 616 | 47 words | source ↗ · inspect |
202a51397a4d | 282 | 27 words | source ↗ · inspect |
203886369fee | 465 | 32 words | source ↗ · inspect |
20a6b5894c4c | 266 | 28 words | source ↗ · inspect |
230c52285499 | 411 | 44 words | source ↗ · inspect |
23b01320d93b | 728 | 49 words | source ↗ · inspect |
2549d3c10d5b | 787 | 26 words | source ↗ · inspect |
25a52d1de3a3 | 867 | 40 words | source ↗ · inspect |
2af3d5505559 | 289 | 24 words | source ↗ · inspect |
2b1b6a434b17 | 1123 | 37 words | source ↗ · inspect |
2b4eb5a283f5 | 103 | 28 words | source ↗ · inspect |
2bd8ada1de6a | 113 | 21 words | source ↗ · inspect |
2c05ddcc2bf5 | 287 | 44 words | source ↗ · inspect |
2dac7b4a9ed9 | 966 | 67 words | source ↗ · inspect |
2f6106809de4 | 405 | 21 words | source ↗ · inspect |
2ffe3bdf91bd | 661 | 40 words | source ↗ · inspect |
32655a04c9e4 | 444 | 43 words | source ↗ · inspect |
32a7125a655a | 690 | 23 words | source ↗ · inspect |
32f8af7757d5 | 707 | 27 words | source ↗ · inspect |
33cab1f129c3 | 371 | 35 words | source ↗ · inspect |
346c39e1a892 | 328 | 33 words | source ↗ · inspect |
357a3c6ad7f5 | 718 | 25 words | source ↗ · inspect |
36ac591f1b7a | 986 | 25 words | source ↗ · inspect |
37477ed1fc06 | 319 | 38 words | source ↗ · inspect |
3783ef06d42f | 515 | 30 words | source ↗ · inspect |
384175be1c8d | 498 | 27 words | source ↗ · inspect |
386b182672cd | 102 | 30 words | source ↗ · inspect |
38a207accfb3 | 209 | 28 words | source ↗ · inspect |
3bfe27dc86f0 | 200 | 25 words | source ↗ · inspect |
3cf7f404fef8 | 336 | 44 words | source ↗ · inspect |
3fbdee096ce9 | 836 | 42 words | source ↗ · inspect |
41592d02ca32 | 1055 | 29 words | source ↗ · inspect |
41c6edecee12 | 364 | 47 words | source ↗ · inspect |
42c49513463e | 719 | 33 words | source ↗ · inspect |
43f18fc9b20f | 143 | 24 words | source ↗ · inspect |
4495ba8f3a34 | 704 | 38 words | source ↗ · inspect |
44d681105bca | 568 | 38 words | source ↗ · inspect |
454434c7bf77 | 522 | 41 words | source ↗ · inspect |
469c6ac05092 | 1133 | 52 words | source ↗ · inspect |
4bd20bce9066 | 637 | 33 words | source ↗ · inspect |
4cc5744a14d8 | 647 | 40 words | source ↗ · inspect |
4fbf675fb790 | 746 | 46 words | source ↗ · inspect |
5139ccfabee5 | 281 | 35 words | source ↗ · inspect |
5231a93ff48e | 547 | 40 words | source ↗ · inspect |
5362f24162b3 | 839 | 26 words | source ↗ · inspect |
5493b9481b00 | 179 | 37 words | source ↗ · inspect |
574767c29dfe | 1079 | 27 words | source ↗ · inspect |
578677b3280b | 270 | 30 words | source ↗ · inspect |
58b9fcb9a353 | 1215 | 39 words | source ↗ · inspect |
599bf6f13bc8 | 252 | 49 words | source ↗ · inspect |
5a4f7f0a9cc7 | 750 | 62 words | source ↗ · inspect |
5a650587a76e | 500 | 29 words | source ↗ · inspect |
61a610564280 | 168 | 20 words | source ↗ · inspect |
6222f33c2c79 | 289 | 28 words | source ↗ · inspect |
6302a6cf8564 | 183 | 23 words | source ↗ · inspect |
6344c9689865 | 1326 | 43 words | source ↗ · inspect |
63e19d477469 | 388 | 59 words | source ↗ · inspect |
63ee59d69982 | 345 | 44 words | source ↗ · inspect |
646cba2e8b30 | 833 | 31 words | source ↗ · inspect |
68382576e699 | 1229 | 50 words | source ↗ · inspect |
695fecd970ab | 151 | 24 words | source ↗ · inspect |
69af3b9fc4ba | 635 | 42 words | source ↗ · inspect |
69e1f777e41b | 183 | 36 words | source ↗ · inspect |
6c4ed9b048e0 | 1089 | 33 words | source ↗ · inspect |
6ce9f3ddbed9 | 890 | 42 words | source ↗ · inspect |
6da088a4a4c5 | 427 | 26 words | source ↗ · inspect |
72610cfcc7b8 | 595 | 26 words | source ↗ · inspect |
72df456684b6 | 1269 | 47 words | source ↗ · inspect |
74b24c60df8b | 278 | 57 words | source ↗ · inspect |
74e99c26d8bb | 195 | 30 words | source ↗ · inspect |
76a518ad3aa5 | 252 | 33 words | source ↗ · inspect |
78a670384c90 | 275 | 24 words | source ↗ · inspect |
7b8bb308a48e | 774 | 37 words | source ↗ · inspect |
7d5b44afe30b | 261 | 30 words | source ↗ · inspect |
7e4d197d5fe8 | 290 | 21 words | source ↗ · inspect |
7fb513044e37 | 519 | 40 words | source ↗ · inspect |
8012ab9261e1 | 937 | 32 words | source ↗ · inspect |
82461522ee90 | 435 | 28 words | source ↗ · inspect |
837970f6b544 | 545 | 23 words | source ↗ · inspect |
84c9dd43080e | 299 | 33 words | source ↗ · inspect |
84dabfdd73c2 | 1095 | 50 words | source ↗ · inspect |
8610ead0a430 | 752 | 23 words | source ↗ · inspect |
88e7dac40f3e | 805 | 29 words | source ↗ · inspect |
8911c07945c3 | 152 | 44 words | source ↗ · inspect |
89daa80db49b | 354 | 26 words | source ↗ · inspect |
8ba20bec4358 | 488 | 37 words | source ↗ · inspect |
8be49747e364 | 222 | 44 words | source ↗ · inspect |
8ec9aabea31a | 134 | 32 words | source ↗ · inspect |
934a2d923502 | 490 | 19 words | source ↗ · inspect |
9378a8d4b9a6 | 472 | 36 words | source ↗ · inspect |
947b339a524a | 382 | 26 words | source ↗ · inspect |
947eeb8bbfec | 233 | 42 words | source ↗ · inspect |
970f75d6e5b2 | 395 | 29 words | source ↗ · inspect |
978a6fc6a910 | 285 | 37 words | source ↗ · inspect |
97c0670cd614 | 408 | 44 words | source ↗ · inspect |
996940764a06 | 263 | 28 words | source ↗ · inspect |
9a2ffa6ad643 | 621 | 24 words | source ↗ · inspect |
9b54bd1709bd | 252 | 34 words | source ↗ · inspect |
9bea5cbe9a01 | 274 | 27 words | source ↗ · inspect |
9dc3325d9018 | 261 | 27 words | source ↗ · inspect |
9eb7dd37e50b | 699 | 46 words | source ↗ · inspect |
9f051fe922a8 | 992 | 49 words | source ↗ · inspect |
9fbd984bd3a4 | 343 | 20 words | source ↗ · inspect |
a168d9139450 | 783 | 46 words | source ↗ · inspect |
a2363d02185b | 858 | 52 words | source ↗ · inspect |
a2a2ac30f465 | 213 | 46 words | source ↗ · inspect |
a2b66e437625 | 407 | 25 words | source ↗ · inspect |
a2ee2faeb2dc | 1046 | 32 words | source ↗ · inspect |
a37f0005819d | 1066 | 56 words | source ↗ · inspect |
a38e72fed886 | 202 | 45 words | source ↗ · inspect |
a43893ac7046 | 1349 | 27 words | source ↗ · inspect |
a8c1b6fc6738 | 319 | 24 words | source ↗ · inspect |
afd04a7bf645 | 408 | 24 words | source ↗ · inspect |
b10db3ae83ab | 674 | 52 words | source ↗ · inspect |
b21cd5493149 | 919 | 45 words | source ↗ · inspect |
b3619076f8eb | 258 | 24 words | source ↗ · inspect |
b540aeae06b0 | 694 | 23 words | source ↗ · inspect |
b7c282a03739 | 187 | 32 words | source ↗ · inspect |
b882ed05925f | 543 | 29 words | source ↗ · inspect |
b8e56b3cb5fa | 982 | 45 words | source ↗ · inspect |
bbdc0e58a203 | 534 | 28 words | source ↗ · inspect |
bbe26fc38175 | 799 | 35 words | source ↗ · inspect |
be5d8524bf21 | 349 | 36 words | source ↗ · inspect |
c0340e53445e | 335 | 46 words | source ↗ · inspect |
c222979bd1cf | 738 | 37 words | source ↗ · inspect |
c27cf1b136cc | 364 | 43 words | source ↗ · inspect |
c34d84d38ccf | 951 | 37 words | source ↗ · inspect |
c5390093fa60 | 1088 | 34 words | source ↗ · inspect |
c67a5be9af71 | 451 | 28 words | source ↗ · inspect |
c71b08cede3b | 273 | 24 words | source ↗ · inspect |
c7a2fff81694 | 131 | 30 words | source ↗ · inspect |
c7caf9181c2e | 813 | 44 words | source ↗ · inspect |
c811d9ae87c9 | 1054 | 49 words | source ↗ · inspect |
ca1c3b587b72 | 1036 | 47 words | source ↗ · inspect |
cb56840e21bb | 137 | 26 words | source ↗ · inspect |
cc86a588b4e4 | 256 | 29 words | source ↗ · inspect |
cd745b3c66da | 419 | 28 words | source ↗ · inspect |
cf3f7388c3b5 | 332 | 24 words | source ↗ · inspect |
cf7094270cbb | 1466 | 46 words | source ↗ · inspect |
d71e9a0213b1 | 131 | 26 words | source ↗ · inspect |
d8aee1ae4b11 | 894 | 42 words | source ↗ · inspect |
d96576c5c5e6 | 594 | 37 words | source ↗ · inspect |
da9588f556b1 | 502 | 48 words | source ↗ · inspect |
dc833f8b55e3 | 1028 | 47 words | source ↗ · inspect |
dc8bb8429f62 | 921 | 39 words | source ↗ · inspect |
dd4f72620035 | 213 | 31 words | source ↗ · inspect |
e21f3aefeb41 | 878 | 41 words | source ↗ · inspect |
e2706dce6cf2 | 773 | 56 words | source ↗ · inspect |
e2bccd4dec93 | 460 | 37 words | source ↗ · inspect |
e30518a464ea | 132 | 32 words | source ↗ · inspect |
e3f8ceb7a627 | 949 | 25 words | source ↗ · inspect |
e4fcad9e8cf8 | 203 | 32 words | source ↗ · inspect |
e65440d2469c | 1298 | 24 words | source ↗ · inspect |
e67604ecb75a | 286 | 26 words | source ↗ · inspect |
e6c7c16699d2 | 549 | 25 words | source ↗ · inspect |
e709f9942da0 | 359 | 44 words | source ↗ · inspect |
e8c90d557031 | 1481 | 53 words | source ↗ · inspect |
eaf4a7864208 | 536 | 25 words | source ↗ · inspect |
eb39e1395ad1 | 424 | 35 words | source ↗ · inspect |
ec4b5fef725b | 389 | 35 words | source ↗ · inspect |
ecb2616fc4fb | 675 | 14 words | source ↗ · inspect |
ee17dfb574fe | 111 | 33 words | source ↗ · inspect |
eeafdc8b2d81 | 262 | 18 words | source ↗ · inspect |
ef92201afc2d | 485 | 32 words | source ↗ · inspect |
f001ec5c4704 | 567 | 36 words | source ↗ · inspect |
f1c555fe64f9 | 573 | 36 words | source ↗ · inspect |
f309d4d0aabf | 702 | 31 words | source ↗ · inspect |
f555b81fb888 | 493 | 26 words | source ↗ · inspect |
f66c8ff2cad2 | 369 | 35 words | source ↗ · inspect |
f78024d271fd | 585 | 23 words | source ↗ · inspect |
f78fb08d7ccc | 999 | 28 words | source ↗ · inspect |
f7c2eb465479 | 230 | 23 words | source ↗ · inspect |
f8e429a6906f | 393 | 45 words | source ↗ · inspect |
f97442bee2ac | 390 | 34 words | source ↗ · inspect |
f97b9b19e5a9 | 667 | 45 words | source ↗ · inspect |
f9f5d81bc74d | 331 | 38 words | source ↗ · inspect |
fcd69b35b0bd | 196 | 19 words | source ↗ · inspect |
fd0e8622b9ee | 383 | 34 words | source ↗ · inspect |
ff42fad959e8 | 438 | 20 words | source ↗ · inspect |
ff4cf78e837b | 1074 | 36 words | source ↗ · inspect |
ff866754ef03 | 1204 | 39 words | source ↗ · inspect |
ff9c1536bfa6 | 618 | 46 words | source ↗ · inspect |
ffff11a2f44d | 926 | 38 words | source ↗ · inspect |
Each row is the profile evh dataset-items --dataset-id cnn_dailymail_200 prints; inspect opens the item in the inspector with the dataset's largest group of comparable arms, and its text where the inspector runs on a machine that has it.
03reference sets
- gold/cnn_dailymail_200 gold · promoted from person the dataset's authors
- silver/cnn_dailymail_200 silver · promoted from model the arm:
cnn_anthropic_l_n200_v1
04labels
No labels yet. A sheet to fill: evh label-sheet --dataset-id cnn_dailymail_200 --out sheet.csv; a run's outputs as a model set: evh label-from-run --run R --set S.