catalog

Every evaluation, at a glance

Pages the harness builds from this project's committed runs: what each goal concludes so far, when the work happened and what it cost, what each dataset covers, and everything recorded. Every name is a link: goals, datasets, arms, models, reference sets and metrics each have a page, and the inspector tests any arms against a baseline, item by item.

This is eval-harness's catalog, live on its six worked examples. Every run behind the numbers on the findings: each goal is one eval, and the inspector tests any of its arms here, without installing anything.

Ask it from your agent, too. The same catalog answers over MCP at https://evals.humancopilot.eu/mcp: its views as read-only tools (datasets and what is inside them, goals, arms, references, metrics, the inspector's comparisons), for Claude, ChatGPT and the OpenAI API, Gemini, or any MCP client. No sign-in; nothing it does writes or spends. How to connect.

Your own project gets the same pages over its runs: evh catalog, then evh catalog-serve (tutorial 5), and the same tools with evh mcp.

all time, 2026-09-25 to 2026-11-02

7goals 16datasets 20reference sets 267configs 686arms 64models 96metrics 293measured runs $45.66billed 69,692,67269.7Mtokens

goalsdataarmswork and spend

01goals at a glance

The leader is the best arm the goal may recommend (not flagged, over a limit or retired), scored against the gold group's reference; the test is the leader against the baseline alone (threshold 0.05). The goal page tests every arm, Holm across them. recommended is what the goal's strategy picks once limits and the tie-break on cost and speed are applied; its ratios are against the baseline (0.5× costs half).

goal	dataset	decides	recommended	baseline	leader	leader vs baseline
Named-entity extraction (Few-NERD)	few_nerd_280	f1	fn_span_marker_n200_v1	fn_span_marker_n200_v1 0.767	fn_span_marker_n200_v1 0.767	the baseline leads
Encyclopedia topic classification (DBpedia)	dbpedia_280	correct	db_bert_base_fy_n200_v1	db_bert_base_fy_n200_v1 0.986	db_qwen_m_n200_v1 0.993	not significant · Δ +0.007 · p 0.6217 inspect
Short news summaries (CNN)	cnn_dailymail_200	coverage	cnn_bart_l_n200_v1	cnn_bart_l_n200_v1 0.346	cnn_bart_l_n200_v1 0.346	the baseline leads
News topic classification (AG News)	ag_news_200	correct	none yet	ag_bert_mini_n200_v1 0.945	ag_bert_base_ta_n200_v1 0.960	not significant · Δ +0.015 · p 0.5522 inspect
Evidence retrieval for scientific claims (SciFact)	scifact_200	ndcg_10	sf_e5_base_n200_v1	sf_e5_base_n200_v1 0.719	sf_glm_s_n200_v1 0.744	not significant · Δ +0.025 · p 0.2670 inspect
A scorer that agrees with experts on summaries (SummEval)	summeval_100	tau	se_gemma_l_n100_v1	se_gemma_l_n100_v1 0.538	se_openai_l_n100_v1 0.540	not significant · Δ +0.001 · p 0.8634 inspect
Triage decisions on Orrery's error signals	orrery_triage_v1_labelled	triage_cost ↓	none yet	triage_baseline_pro_v1 0.785	triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1 0.400	not significant · Δ -0.385 · p 0.0897 inspect

02activity and spend

activity

293 measured runs (repeats counted one by one), by day and dataset.

ag_news_200cnn_dailymail_20cnn_dailymail_200cnn_dailymail_dm200dbpedia_280few_nerd_280fleet_dedup_v1orrery_triage_v1_labelledscifact_200smoke_v1summeval_100

spend

systems under test $32.15 · judges $13.50 · total $45.66

systems under testjudges

every dataset, arm and kind of spend in the period

03coverage

dataset	items	arms scored against	reference sets	metrics	goals	last run
orrery_triage_v1_labelled	65	gold 336	gold/orrery_triage_v1_labelled, silver/orrery_triage_v1_labelled_hand, silver/orrery_triage_v1_labelled_outcomes	20 correct, cost_usd, deferred, escalated, false_alarm, false_dismiss, latency_ms, model_correct, model_escalated, model_false_alarm, model_false_dismiss, model_triage_cost, n_probes, no_decision, table_miss, tokens_in, tokens_out, triage_cost, triage_cost_p10, triage_cost_p3	Triage decisions on Orrery's error signals	2026-11-02
cnn_dailymail_200	200	gold 35 · silver 29 · judged 89	gold/cnn_dailymail_200, silver/cnn_dailymail_200	31 compression, concision, cost_usd, coverage, fmt_bullets, fmt_label, fmt_markdown, fmt_narration, fmt_overlong, fmt_paragraphs, grounding, input_truncated, judge_anthropic_l, judge_gemma_l, judge_gemma_l_unvalidated, judge_openai_l, judge_qwen_s, judge_qwen_s_unvalidated, judge_score, judge_score_unvalidated, judge_won, latency_ms, length_vs_reference, reasoning_tokens, reference_words, rouge1, rougeLsum, summary_words, tokens_in, tokens_out, truncated	Short news summaries (CNN)	2026-11-02
ag_news_200	200	gold 63	gold/ag_news_200, gold/ag_news_200_adj1	13 answer_words, confidence, correct, correct_after_repair, cost_usd, fmt_markdown, fmt_verbose, latency_ms, parsed, reasoning_tokens, tokens_in, tokens_out, truncated	News topic classification (AG News)	2026-10-25
summeval_100	100	gold 41	gold/summeval_100	23 cost_usd, input_truncated, latency_ms, n_pairs, pair_agreement, parsed, reasoning_tokens, rho, rho_coherence, rho_consistency, rho_fluency, rho_relevance, tau, tau_coherence, tau_consistency, tau_fluency, tau_relevance, tie_rate, tokens_in, tokens_out, top1, top1_chance, truncated	A scorer that agrees with experts on summaries (SummEval)	2026-11-02
dbpedia_280	280	gold 29	gold/dbpedia_280	13 answer_words, confidence, correct, correct_after_repair, cost_usd, fmt_markdown, fmt_verbose, latency_ms, parsed, reasoning_tokens, tokens_in, tokens_out, truncated	Encyclopedia topic classification (DBpedia)	2026-09-30
few_nerd_280	280	gold 28	gold/few_nerd_280	20 cost_usd, f1, fn, fp, latency_ms, n_gold, n_predicted, parsed, precision, reasoning_tokens, recall, tokens_in, tokens_out, tp, truncated, type_penalty, untyped_f1, untyped_fn, untyped_fp, untyped_tp	Named-entity extraction (Few-NERD)	2026-10-01
scifact_200	200	gold 26	gold/scifact_200	19 cost_usd, duplicate_ids, found_any, latency_ms, llm_named_unknown, llm_parsed, mrr_10, n_relevant, n_returned, ndcg_10, parsed, rank_of_first, reasoning_tokens, recall_10, recall_100, tokens_in, tokens_out, truncated, unknown_ids	Evidence retrieval for scientific claims (SciFact)	2026-09-29
cnn_dailymail_dm200	200	gold 5	gold/cnn_dailymail_dm200	20 compression, concision, cost_usd, coverage, fmt_bullets, fmt_label, fmt_markdown, fmt_narration, fmt_overlong, fmt_paragraphs, grounding, input_truncated, latency_ms, length_vs_reference, reference_words, rouge1, rougeLsum, summary_words, tokens_in, tokens_out	Short news summaries (CNN)	2026-10-15
cnn_dailymail_20	20	gold 2	gold/cnn_dailymail_20	20 compression, concision, cost_usd, coverage, fmt_bullets, fmt_label, fmt_markdown, fmt_narration, fmt_overlong, fmt_paragraphs, grounding, input_truncated, latency_ms, length_vs_reference, reference_words, rouge1, rougeLsum, summary_words, tokens_in, tokens_out	Short news summaries (CNN)	2026-09-26
fleet_dedup_v1	100	silver 1 · none 1	silver/fleet_dedup_v1	3 class_match, key_match, latency_ms	—	2026-10-30
smoke_v1	5	silver 1	silver/smoke_v1	4 cost_usd, latency_ms, output_words, overlap_f1	—	2026-10-23
ag_news_20	20	—	gold/ag_news_20	—	News topic classification (AG News)	—
dbpedia_56	56	—	gold/dbpedia_56	—	Encyclopedia topic classification (DBpedia)	—
few_nerd_56	56	—	gold/few_nerd_56	—	Named-entity extraction (Few-NERD)	—
orrery_triage_smoke	2	—	gold/orrery_triage_smoke	—	—	—
scifact_40	40	—	gold/scifact_40	—	Evidence retrieval for scientific claims (SciFact)	—

04recorded

when	what	kind
2026-11-02 16:17	judged cnn_mistral_m_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_mistral_s_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_openai_l_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_openai_m_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_openai_s_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_qwen_l_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_qwen_m_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_qwen_s_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_anthropic_l_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_anthropic_m_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_anthropic_s_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_bart_l_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_bart_l_xsum_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_bart_m_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_bart_s_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_deepseek_l_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_deepseek_m_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_deepseek_s_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_gemma_l_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_gemma_m_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_gemma_s_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_glm_l_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_glm_m_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_glm_s_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_lead3_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_llama_l_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_llama_m_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_llama_s_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:17	judged cnn_mistral_l_n200_v1 · judged/judge-summ-pick-v1 on cnn_dailymail_200	judge
2026-11-02 16:01	ran se_qwen_s_n100_pairwise_v1 on summeval_100	run
2026-11-02 15:28	ran se_gemma_l_n100_pairwise_v1 on summeval_100	run
2026-11-02 15:16	ran se_qwen_s_n100_pick_v1 on summeval_100	run
2026-11-02 15:13	ran se_gemma_l_n100_pick_v1 on summeval_100	run
2026-11-02 14:14	ran se_random_n100_pairwise_v1 on summeval_100	run
2026-11-02 14:14	ran se_random_n100_pick_v1 on summeval_100	run
2026-11-02 08:17	rescored triage_local_mac_nemotron_35_bolt_e4b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_nemotron_35_lightning_30b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_phi4_14b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_qwen38_27b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_qwen3_30b_a3b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_gemma4_31b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_gpt_oss_20b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_llama31_8b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_ministral_3_14b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_nemotron_35_lightning_30b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_phi4_14b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_qwen38_27b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_qwen3_30b_a3b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_mistral_large_4_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_sonnet_55_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_stub_dismiss_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_stub_escalate_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored 5f2c057c, repeats on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_deepseek_41flash_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_gemini_35_flash_lite_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_gemini_4_argon_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_gpt_61_sol_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_gpt_6_luna_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_haiku_55_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_hosted_gemma4_31b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_hosted_gpt_oss_120b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_hosted_mistral_medium_35_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_hosted_qwen35_122b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_hosted_qwen3_30b_a3b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_kimi_k31_pro_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_gemma4_12b_noreason_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_gemma4_31b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_gpt_oss_120b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_gpt_oss_20b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_llama31_8b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_llama4_scout_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_ministral_3_14b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_mistral_medium_35_128b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_nemotron_35_bolt_e4b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_nemotron_35_lightning_30b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_nemotron_35_super_120b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_phi4_14b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_qwen35_122b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_qwen38_27b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_qwen3_30b_a3b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_gemma4_12b_noreason_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_gemma4_31b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_gpt_oss_20b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_llama31_8b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_ministral_3_14b_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_baseline_pro_v1 · rescored 5f2c057c, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_gpt_61_sol_v1 · rescored 5f2c057c, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_gpt_6_luna_v1 · rescored 5f2c057c, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_haiku_55_v1 · rescored 5f2c057c, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_baseline_pro_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_hosted_gemma4_31b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_hosted_gpt_oss_120b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_hosted_qwen35_122b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_kimi_k31_pro_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_gemma4_31b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_gpt_oss_120b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_gpt_oss_20b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_nemotron_35_bolt_e4b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_nemotron_35_lightning_30b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_nemotron_35_super_120b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_qwen35_122b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_dgx_qwen38_27b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_gemma4_31b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_gpt_oss_20b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_nemotron_35_bolt_e4b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_nemotron_35_lightning_30b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_mac_qwen38_27b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_gemma4_31b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_gpt_oss_20b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_nemotron_35_bolt_e4b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_nemotron_35_lightning_30b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_local_x3_qwen38_27b_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_mistral_large_4_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_baseline_pro_noreason_v1 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_deepseek_41flash_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	rescored triage_gpt_6_luna_v2 · rescored 5f2c057c on orrery_triage_v1_labelled	rescore
2026-11-02 08:17	silver reference silver/orrery_triage_v1_labelled_outcomes	reference
2026-11-01 08:15	closed round r3 of Triage decisions on Orrery's error signals	round
2026-11-01 08:14	rescored triage_hosted_gpt_oss_120b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_hosted_mistral_medium_35_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_hosted_qwen35_122b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_hosted_qwen3_30b_a3b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_kimi_k31_pro_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_gemma4_12b_noreason_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_gemma4_31b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_gpt_oss_120b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_gpt_oss_20b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_llama31_8b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_llama4_scout_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_ministral_3_14b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_mistral_medium_35_128b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_nemotron_35_bolt_e4b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_nemotron_35_lightning_30b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_nemotron_35_super_120b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_phi4_14b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_qwen35_122b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_qwen38_27b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_qwen3_30b_a3b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_mac_gemma4_12b_noreason_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_mac_gemma4_31b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_mac_gpt_oss_20b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_mac_llama31_8b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_mac_ministral_3_14b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_mac_nemotron_35_bolt_e4b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_mac_nemotron_35_lightning_30b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_mac_phi4_14b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_mac_qwen38_27b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_mac_qwen3_30b_a3b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_x3_gemma4_31b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_x3_gpt_oss_20b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_x3_llama31_8b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_x3_ministral_3_14b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_x3_nemotron_35_bolt_e4b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_x3_nemotron_35_lightning_30b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_x3_phi4_14b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_x3_qwen38_27b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_local_x3_qwen3_30b_a3b_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_mistral_large_4_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_sonnet_55_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_stub_dismiss_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_stub_escalate_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_baseline_pro_noreason_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_baseline_pro_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_deepseek_41flash_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_gemini_35_flash_lite_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_gemini_4_argon_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_gpt_61_sol_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_gpt_6_luna_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_haiku_55_v1 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_hosted_gemma4_31b_v2 · rescored 3d3a6afd on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_baseline_pro_v1 · rescored 3d3a6afd, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_gpt_61_sol_v1 · rescored 3d3a6afd, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-11-01 08:14	rescored triage_haiku_55_v1 · rescored 3d3a6afd, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-11-01 08:13	ran triage_local_mac_gemma4_31b_v2 on orrery_triage_v1_labelled	run
2026-10-31 17:31	ran triage_local_mac_qwen38_27b_v2 on orrery_triage_v1_labelled	run
2026-10-31 16:54	ran triage_local_mac_nemotron_35_lightning_30b_v2 on orrery_triage_v1_labelled	run
2026-10-31 16:42	ran triage_local_mac_gpt_oss_20b_v2 on orrery_triage_v1_labelled	run
2026-10-31 16:36	ran triage_local_mac_nemotron_35_bolt_e4b_v2 on orrery_triage_v1_labelled	run
2026-10-31 16:23	ran triage_baseline_pro_noreason_v1 on orrery_triage_v1_labelled	run
2026-10-31 16:14	ran triage_mistral_large_4_v2 on orrery_triage_v1_labelled	run
2026-10-31 16:05	ran triage_local_dgx_gpt_oss_20b_v2 on orrery_triage_v1_labelled	run
2026-10-31 16:00	ran triage_local_dgx_gpt_oss_120b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:51	ran triage_kimi_k31_pro_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:51	ran triage_local_dgx_nemotron_35_super_120b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:49	ran triage_local_x3_qwen38_27b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:32	ran triage_local_dgx_qwen35_122b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:28	ran triage_hosted_qwen35_122b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:26	ran triage_local_x3_nemotron_35_lightning_30b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:21	ran triage_hosted_gpt_oss_120b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:18	ran triage_local_x3_nemotron_35_bolt_e4b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:16	ran triage_local_dgx_nemotron_35_lightning_30b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:14	ran triage_hosted_gemma4_31b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:12	ran triage_local_x3_gpt_oss_20b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:08	ran triage_local_dgx_nemotron_35_bolt_e4b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:05	ran triage_local_x3_gemma4_31b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:03	ran triage_local_dgx_qwen38_27b_v2 on orrery_triage_v1_labelled	run
2026-10-31 15:02	ran triage_gpt_6_luna_v2 on orrery_triage_v1_labelled	run
2026-10-31 14:53	ran triage_deepseek_41flash_v2 on orrery_triage_v1_labelled	run
2026-10-31 14:44	ran triage_local_dgx_gemma4_31b_v2 on orrery_triage_v1_labelled	run
2026-10-31 14:22	closed round r2 of Triage decisions on Orrery's error signals	round
2026-10-31 14:22	opened round r3 of Triage decisions on Orrery's error signals	round
2026-10-31 13:23	rescored triage_local_dgx_gpt_oss_20b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_llama31_8b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_llama4_scout_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_ministral_3_14b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_mistral_medium_35_128b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_nemotron_35_bolt_e4b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_nemotron_35_lightning_30b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_nemotron_35_super_120b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_phi4_14b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_qwen35_122b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_qwen38_27b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_qwen3_30b_a3b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_mac_gemma4_12b_noreason_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_mac_gemma4_31b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_mac_gpt_oss_20b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_mac_llama31_8b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_mac_ministral_3_14b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_mac_nemotron_35_bolt_e4b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_mac_nemotron_35_lightning_30b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_mac_phi4_14b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_mac_qwen38_27b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_mac_qwen3_30b_a3b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_x3_gemma4_31b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_x3_gpt_oss_20b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_x3_llama31_8b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_x3_ministral_3_14b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_x3_nemotron_35_lightning_30b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_x3_phi4_14b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_x3_qwen38_27b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_x3_qwen3_30b_a3b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_mistral_large_4_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_sonnet_55_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_stub_dismiss_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_stub_escalate_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored 77adc97b, repeats on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_baseline_pro_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_deepseek_41flash_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_gemini_35_flash_lite_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_gemini_4_argon_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_gpt_61_sol_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_gpt_6_luna_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_haiku_55_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_hosted_gemma4_31b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_hosted_gpt_oss_120b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_hosted_mistral_medium_35_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_hosted_qwen35_122b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_hosted_qwen3_30b_a3b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_kimi_k31_pro_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_gemma4_12b_noreason_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_gemma4_31b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_local_dgx_gpt_oss_120b_v1 · rescored 77adc97b on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_baseline_pro_v1 · rescored 77adc97b, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_gpt_61_sol_v1 · rescored 77adc97b, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_gpt_6_luna_v1 · rescored 77adc97b, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	rescored triage_haiku_55_v1 · rescored 77adc97b, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-10-31 13:23	opened round r2 of Triage decisions on Orrery's error signals	round
2026-10-31 13:19	promoted triage_baseline_pro_v1 as the baseline on orrery_triage_v1_labelled	baseline
2026-10-31 13:19	closed round r1 of Triage decisions on Orrery's error signals	round
2026-10-31 13:18	opened round r1 of Triage decisions on Orrery's error signals	round
2026-10-31 11:30	rescored triage_baseline_pro_v1 · rescored cd35dc1f, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-10-31 11:30	rescored triage_gpt_61_sol_v1 · rescored cd35dc1f, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-10-31 11:30	rescored triage_gpt_6_luna_v1 · rescored cd35dc1f, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-10-31 11:30	rescored triage_haiku_55_v1 · rescored cd35dc1f, repeats ×3 on orrery_triage_v1_labelled	rescore
2026-10-31 11:30	rescored triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored cd35dc1f, repeats on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_gpt_oss_20b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_llama31_8b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_llama4_scout_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_ministral_3_14b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_mistral_medium_35_128b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_nemotron_35_bolt_e4b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_nemotron_35_lightning_30b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_nemotron_35_super_120b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_phi4_14b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_qwen35_122b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_qwen38_27b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_qwen3_30b_a3b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_mac_gemma4_12b_noreason_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_mac_gemma4_31b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_mac_gpt_oss_20b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_mac_llama31_8b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_mac_ministral_3_14b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_mac_nemotron_35_bolt_e4b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_mac_nemotron_35_lightning_30b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_mac_phi4_14b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_mac_qwen38_27b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_mac_qwen3_30b_a3b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_x3_gemma4_31b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_x3_gpt_oss_20b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_x3_llama31_8b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_x3_ministral_3_14b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_x3_nemotron_35_lightning_30b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_x3_phi4_14b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_x3_qwen38_27b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_x3_qwen3_30b_a3b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_mistral_large_4_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_sonnet_55_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_stub_dismiss_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_stub_escalate_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_baseline_pro_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_deepseek_41flash_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_gemini_35_flash_lite_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_gemini_4_argon_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_gpt_61_sol_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_gpt_6_luna_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_haiku_55_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_hosted_gemma4_31b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_hosted_gpt_oss_120b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_hosted_mistral_medium_35_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_hosted_qwen35_122b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_hosted_qwen3_30b_a3b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_kimi_k31_pro_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_gemma4_12b_noreason_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_gemma4_31b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 11:08	rescored triage_local_dgx_gpt_oss_120b_v1 · rescored cd35dc1f on orrery_triage_v1_labelled	rescore
2026-10-31 09:08	ran triage_local_dgx_gemma4_12b_noreason_v1 on orrery_triage_v1_labelled	run
2026-10-31 09:06	ran triage_local_mac_gemma4_12b_noreason_v1 on orrery_triage_v1_labelled	run
2026-10-31 09:01	ran triage_local_dgx_gpt_oss_120b_v1 on orrery_triage_v1_labelled	run
2026-10-31 08:45	ran triage_local_mac_ministral_3_14b_v1 on orrery_triage_v1_labelled	run
2026-10-31 08:45	ran triage_local_dgx_qwen3_30b_a3b_v1 on orrery_triage_v1_labelled	run
2026-10-31 08:39	ran triage_local_dgx_llama31_8b_v1 on orrery_triage_v1_labelled	run
2026-10-31 08:33	ran triage_local_dgx_phi4_14b_v1 on orrery_triage_v1_labelled	run
2026-10-31 08:14	ran triage_local_dgx_ministral_3_14b_v1 on orrery_triage_v1_labelled	run
2026-10-31 08:08	ran triage_local_mac_qwen3_30b_a3b_v1 on orrery_triage_v1_labelled	run
2026-10-31 07:52	ran triage_local_dgx_gemma4_31b_v1 on orrery_triage_v1_labelled	run
2026-10-31 07:24	ran triage_stub_escalate_v1 on orrery_triage_v1_labelled	run
2026-10-31 07:24	ran triage_stub_dismiss_v1 on orrery_triage_v1_labelled	run
2026-10-31 04:22	ran triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1 on orrery_triage_v1_labelled	run
2026-10-31 00:37	ran triage_local_x3_qwen3_30b_a3b_v1 on orrery_triage_v1_labelled	run
2026-10-30 23:46	ran triage_hosted_qwen3_30b_a3b_v1 on orrery_triage_v1_labelled	run
2026-10-30 23:07	ran triage_local_mac_qwen38_27b_v1 on orrery_triage_v1_labelled	run
2026-10-30 21:52	ran triage_local_mac_phi4_14b_v1 on orrery_triage_v1_labelled	run
2026-10-30 21:28	ran triage_local_mac_nemotron_35_lightning_30b_v1 on orrery_triage_v1_labelled	run
2026-10-30 21:06	ran triage_local_dgx_qwen38_27b_v1 on orrery_triage_v1_labelled	run
2026-10-30 20:40	ran triage_local_x3_nemotron_35_bolt_e4b_v1 · repeats on orrery_triage_v1_labelled	run
2026-10-30 20:25	ran triage_local_dgx_gpt_oss_20b_v1 on orrery_triage_v1_labelled	run
2026-10-30 20:11	ran triage_local_x3_gpt_oss_20b_v1 on orrery_triage_v1_labelled	run
2026-10-30 20:11	ran triage_local_dgx_nemotron_35_lightning_30b_v1 on orrery_triage_v1_labelled	run
2026-10-30 19:57	ran triage_local_mac_llama31_8b_v1 on orrery_triage_v1_labelled	run
2026-10-30 19:53	ran triage_local_x3_nemotron_35_bolt_e4b_v1 on orrery_triage_v1_labelled	run
2026-10-30 19:49	ran triage_local_mac_nemotron_35_bolt_e4b_v1 on orrery_triage_v1_labelled	run
2026-10-30 19:29	ran triage_local_x3_nemotron_35_lightning_30b_v1 on orrery_triage_v1_labelled	run
2026-10-30 19:27	ran triage_local_dgx_nemotron_35_bolt_e4b_v1 on orrery_triage_v1_labelled	run
2026-10-30 19:23	ran triage_local_mac_gemma4_31b_v1 on orrery_triage_v1_labelled	run
2026-10-30 19:11	ran triage_local_dgx_nemotron_35_super_120b_v1 on orrery_triage_v1_labelled	run
2026-10-30 18:46	ran triage_local_x3_gemma4_31b_v1 on orrery_triage_v1_labelled	run
2026-10-30 18:26	ran triage_local_dgx_mistral_medium_35_128b_v1 on orrery_triage_v1_labelled	run
2026-10-30 17:34	ran triage_local_mac_gpt_oss_20b_v1 on orrery_triage_v1_labelled	run
2026-10-30 17:28	ran triage_local_x3_qwen38_27b_v1 on orrery_triage_v1_labelled	run
2026-10-30 16:33	ran triage_local_x3_phi4_14b_v1 on orrery_triage_v1_labelled	run
2026-10-30 16:19	ran triage_local_dgx_llama4_scout_v1 on orrery_triage_v1_labelled	run
2026-10-30 16:14	ran triage_local_x3_ministral_3_14b_v1 on orrery_triage_v1_labelled	run
2026-10-30 16:04	ran triage_local_dgx_qwen35_122b_v1 on orrery_triage_v1_labelled	run
2026-10-30 15:25	ran triage_baseline_pro_v1 · repeats ×3 on orrery_triage_v1_labelled	run
2026-10-30 15:07	ran triage_local_x3_llama31_8b_v1 on orrery_triage_v1_labelled	run
2026-10-30 14:51	ran triage_hosted_gpt_oss_120b_v1 on orrery_triage_v1_labelled	run
2026-10-30 14:37	ran triage_gpt_61_sol_v1 · repeats ×3 on orrery_triage_v1_labelled	run
2026-10-30 14:36	ran triage_gpt_6_luna_v1 · repeats ×3 on orrery_triage_v1_labelled	run
2026-10-30 14:31	ran dedup_pinned_f07efa9_v1 on fleet_dedup_v1	run
2026-10-30 14:31	silver reference silver/fleet_dedup_v1 written by dedup_pinned_f07efa9_v1	reference
2026-10-30 14:30	ran dedup_guard_v1 on fleet_dedup_v1	run
2026-10-30 14:30	ran triage_hosted_qwen35_122b_v1 on orrery_triage_v1_labelled	run
2026-10-30 14:24	ran triage_haiku_55_v1 · repeats ×3 on orrery_triage_v1_labelled	run
2026-10-30 14:22	ran triage_hosted_gemma4_31b_v1 on orrery_triage_v1_labelled	run
2026-10-30 14:17	ran triage_hosted_mistral_medium_35_v1 on orrery_triage_v1_labelled	run
2026-10-30 13:51	ran triage_kimi_k31_pro_v1 on orrery_triage_v1_labelled	run
2026-10-30 13:33	ran triage_gemini_4_argon_v1 on orrery_triage_v1_labelled	run
2026-10-30 13:25	ran triage_baseline_pro_v1 on orrery_triage_v1_labelled	run
2026-10-30 13:15	ran triage_mistral_large_4_v1 on orrery_triage_v1_labelled	run
2026-10-30 13:09	ran triage_gpt_61_sol_v1 on orrery_triage_v1_labelled	run
2026-10-30 13:09	ran triage_gpt_6_luna_v1 on orrery_triage_v1_labelled	run
2026-10-30 13:09	ran triage_sonnet_55_v1 on orrery_triage_v1_labelled	run
2026-10-30 13:07	ran triage_deepseek_41flash_v1 on orrery_triage_v1_labelled	run
2026-10-30 13:04	ran triage_haiku_55_v1 on orrery_triage_v1_labelled	run
2026-10-30 13:00	ran triage_gemini_35_flash_lite_v1 on orrery_triage_v1_labelled	run
2026-10-30 12:33	gold reference gold/orrery_triage_smoke	reference
2026-10-30 12:24	gold reference gold/orrery_triage_v1_labelled	reference
2026-10-30 12:24	silver reference silver/orrery_triage_v1_labelled_hand	reference
2026-10-25 16:49	rescored cnn_qwen_m_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_qwen_s_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_qwen_l_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_openai_m_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_openai_s_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_mistral_s_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_openai_l_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_mistral_m_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_llama_s_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_mistral_l_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_llama_m_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_lead3_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_llama_l_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_glm_m_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_glm_s_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_glm_l_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_gemma_m_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_gemma_s_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_gemma_l_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_deepseek_m_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_deepseek_s_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_deepseek_l_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_bart_m_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_bart_s_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_bart_l_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_bart_l_xsum_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_anthropic_s_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_anthropic_l_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:49	rescored cnn_anthropic_m_n200_v1 · silver on cnn_dailymail_200	rescore
2026-10-25 16:22	silver reference silver/cnn_dailymail_200 written by cnn_anthropic_l_n200_v1	reference
2026-10-25 15:10	rescored ag_anthropic_l_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_anthropic_m_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_anthropic_s_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_bart_mnli_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_bert_base_fy_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_bert_base_ta_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_bert_mini_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_constant_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_deepseek_l_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_deepseek_m_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_deepseek_s_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_gemma_l_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_gemma_m_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_gemma_s_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_glm_l_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_glm_m_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_glm_s_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_keyword_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_llama_l_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_llama_m_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_llama_s_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_mistral_l_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_mistral_m_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_mistral_s_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_openai_l_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_openai_m_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_openai_s_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_qwen_l_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_qwen_m_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 15:10	rescored ag_qwen_s_n200_v1 · adjudicated on ag_news_200	rescore
2026-10-25 14:08	promoted fn_span_marker_n200_v1 as the baseline on few_nerd_280	baseline
2026-10-25 14:08	promoted ag_bert_mini_n200_v1 as the baseline on ag_news_200	baseline
2026-10-25 14:08	promoted cnn_bart_l_n200_v1 as the baseline on cnn_dailymail_200	baseline
2026-10-25 14:08	promoted db_bert_base_fy_n200_v1 as the baseline on dbpedia_280	baseline
2026-10-25 14:08	promoted se_gemma_l_n100_v1 as the baseline on summeval_100	baseline
2026-10-25 14:08	promoted sf_e5_base_n200_v1 as the baseline on scifact_200	baseline
2026-10-25 13:39	judged cnn_bart_l_n200_v1 · judged/judge-summ-pointwise-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_deepseek_m_n200_v1 · judged/judge-summ-pointwise-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_anthropic_l_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_anthropic_m_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_anthropic_s_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_bart_l_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_bart_l_xsum_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_bart_m_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_bart_s_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_deepseek_l_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_deepseek_m_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_deepseek_s_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_gemma_l_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_gemma_m_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_gemma_s_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_glm_l_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_glm_m_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_glm_s_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_lead3_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_llama_l_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_llama_m_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_llama_s_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_mistral_l_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_mistral_m_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_mistral_s_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_openai_l_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_openai_m_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_openai_s_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_qwen_l_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_qwen_m_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_qwen_s_n200_v1 · judged/judge-summ-v2 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_anthropic_l_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_anthropic_m_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_anthropic_s_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_bart_l_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_bart_l_xsum_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_bart_m_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_bart_s_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_deepseek_l_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_deepseek_m_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_deepseek_s_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_gemma_l_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_gemma_m_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_gemma_s_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_glm_l_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_glm_m_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_glm_s_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_lead3_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_llama_l_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_llama_m_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_llama_s_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_mistral_l_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_mistral_m_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_mistral_s_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_openai_l_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_openai_m_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_openai_s_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_qwen_l_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_qwen_m_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-25 13:39	judged cnn_qwen_s_n200_v1 · judged/judge-summ-v1 on cnn_dailymail_200	judge
2026-10-23 14:23	promoted demo_v1 as the baseline on smoke_v1	baseline
2026-10-23 14:23	ran demo_v1 on smoke_v1	run
2026-10-19 15:20	gold reference gold/ag_news_200_adj1	reference
2026-10-19 07:22	ran se_gemma_l_pubtextcw_n100_v1 · pair on summeval_100	run
2026-10-19 07:22	closed round r2 of A scorer that agrees with experts on summaries (SummEval)	round
2026-10-19 07:08	ran se_gemma_l_pubtext_n100_v1 · pair on summeval_100	run
2026-10-19 07:08	opened round r2 of A scorer that agrees with experts on summaries (SummEval)	round
2026-10-18 23:26	ran se_unievalpub_n100_v1 on summeval_100	run
2026-10-18 23:26	closed round r1 of A scorer that agrees with experts on summaries (SummEval)	round
2026-10-18 22:11	ran se_unieval_n100_v1 on summeval_100	run
2026-10-18 13:07	ran se_qwen37max_n100_v1 on summeval_100	run
2026-10-18 12:02	ran se_anthropic_l_n100_v1 on summeval_100	run
2026-10-18 11:56	ran se_anthropic_m_n100_v1 on summeval_100	run
2026-10-18 11:51	ran se_openai_l_n100_v1 on summeval_100	run
2026-10-18 11:48	ran se_openai_m_n100_v1 on summeval_100	run
2026-10-18 11:43	ran se_anthropic_s_n100_v1 on summeval_100	run
2026-10-18 11:39	ran se_mistral_l_n100_v1 on summeval_100	run
2026-10-18 11:21	ran se_mistral_m_n100_v1 on summeval_100	run
2026-10-18 11:17	ran se_openai_s_n100_v1 on summeval_100	run
2026-10-18 11:15	ran se_glm_l_n100_v1 on summeval_100	run
2026-10-18 11:09	ran se_deepseek_l_n100_v1 on summeval_100	run
2026-10-18 10:59	ran se_qwen_m_n100_v1 on summeval_100	run
2026-10-18 10:48	ran se_llama_l_n100_v1 on summeval_100	run
2026-10-18 10:27	ran se_glm_m_n100_v1 on summeval_100	run
2026-10-18 10:21	ran se_deepseek_m_n100_v1 on summeval_100	run
2026-10-18 10:19	ran se_deepseek_s_n100_v1 on summeval_100	run
2026-10-18 10:13	ran se_llama_m_n100_v1 on summeval_100	run
2026-10-18 10:04	ran se_llama_s_n100_v1 on summeval_100	run
2026-10-18 09:52	ran se_gemma_l_n100_v1 on summeval_100	run
2026-10-18 09:41	ran se_glm_s_n100_v1 on summeval_100	run
2026-10-18 09:32	ran se_qwen_s_n100_v1 on summeval_100	run
2026-10-18 09:25	ran se_gemma_s_n100_v1 on summeval_100	run
2026-10-18 09:06	ran se_gemma_m_n100_v1 on summeval_100	run
2026-10-18 08:58	ran se_mistral_s_n100_v1 on summeval_100	run
2026-10-15 13:42	ran se_bartscore_n100_v1 on summeval_100	run
2026-10-15 13:07	ran se_coverage_n100_v1 on summeval_100	run
2026-10-15 13:05	ran se_length_n100_v1 on summeval_100	run
2026-10-15 13:05	ran se_random_n100_v1 on summeval_100	run
2026-10-15 13:05	ran se_rougeL_n100_v1 on summeval_100	run
2026-10-15 13:04	ran se_rouge2_n100_v1 on summeval_100	run
2026-10-15 13:04	ran se_rouge1_n100_v1 on summeval_100	run
2026-10-15 13:04	opened round r1 of A scorer that agrees with experts on summaries (SummEval)	round
2026-10-15 13:03	gold reference gold/summeval_100	reference
2026-10-15 04:37	ran cnn_bart_s_dm200_v1 on cnn_dailymail_dm200	run
2026-10-14 15:38	ran cnn_bart_l_dm200_v1 on cnn_dailymail_dm200	run
2026-10-14 15:00	ran cnn_bart_l_xsum_dm200_v1 on cnn_dailymail_dm200	run
2026-10-14 14:40	ran cnn_bart_m_dm200_v1 on cnn_dailymail_dm200	run
2026-10-14 13:41	ran cnn_lead3_dm200_v1 on cnn_dailymail_dm200	run
2026-10-14 13:39	gold reference gold/cnn_dailymail_dm200	reference
2026-10-01 14:21	closed round r1 of Named-entity extraction (Few-NERD)	round
2026-10-01 13:08	rescored fn_mistral_l_n200_v1 on few_nerd_280	rescore
2026-09-30 15:48	ran cnn_bart_l_n200_v1 · linux on cnn_dailymail_200	run
2026-09-30 15:48	closed round r2 of Short news summaries (CNN)	round
2026-09-30 15:26	ran cnn_bart_l_xsum_n200_v1 · linux on cnn_dailymail_200	run
2026-09-30 15:09	ran cnn_bart_m_n200_v1 · linux on cnn_dailymail_200	run
2026-09-30 14:53	ran cnn_bart_s_n200_v1 · linux on cnn_dailymail_200	run
2026-09-30 14:41	ran cnn_lead3_n200_v1 · linux on cnn_dailymail_200	run
2026-09-30 14:41	opened round r2 of Short news summaries (CNN)	round
2026-09-30 14:41	ran db_bert_base_fy_n200_v1 · linux on dbpedia_280	run
2026-09-30 14:41	opened round r2 of Encyclopedia topic classification (DBpedia)	round
2026-09-30 14:41	closed round r2 of Encyclopedia topic classification (DBpedia)	round
2026-09-30 14:40	ran ag_bert_base_fy_n200_v1 · linux on ag_news_200	run
2026-09-30 14:40	closed round r2 of News topic classification (AG News)	round
2026-09-30 14:39	ran ag_bert_base_ta_n200_v1 · linux on ag_news_200	run
2026-09-30 14:38	ran ag_bert_mini_n200_v1 · linux on ag_news_200	run
2026-09-30 14:38	opened round r2 of News topic classification (AG News)	round
2026-09-30 09:46	ran ag_bert_base_ta_n200_v1 on ag_news_200	run
2026-09-30 09:46	closed round r1 of News topic classification (AG News)	round
2026-09-30 09:45	ran ag_bert_base_fy_n200_v1 on ag_news_200	run
2026-09-30 09:45	ran cnn_bart_l_xsum_n200_v1 on cnn_dailymail_200	run
2026-09-30 09:45	closed round r1 of Short news summaries (CNN)	round
2026-09-30 09:29	ran cnn_bart_s_n200_v1 on cnn_dailymail_200	run
2026-09-30 09:12	ran cnn_bart_s_n200_v1 · repeats on cnn_dailymail_200	run
2026-09-30 09:12	opened round r3 of Short news summaries (CNN)	round
2026-09-30 09:12	closed round r3 of Short news summaries (CNN)	round
2026-09-30 09:10	ran db_bert_base_fy_n200_v1 on dbpedia_280	run
2026-09-30 09:10	closed round r1 of Encyclopedia topic classification (DBpedia)	round
2026-09-30 08:57	ran cnn_bart_m_n200_v1 on cnn_dailymail_200	run
2026-09-29 18:04	closed round r3 of Evidence retrieval for scientific claims (SciFact)	round
2026-09-29 17:44	re-parsed sf_qwen_s_n200_v1 · repeats on scifact_200	reparse
2026-09-29 17:27	re-parsed sf_llama_s_n200_v1 · repeats on scifact_200	reparse
2026-09-29 17:27	opened round r3 of Evidence retrieval for scientific claims (SciFact)	round
2026-09-29 16:49	re-parsed sf_llama_l_n200_v1 · repeats on scifact_200	reparse
2026-09-28 23:15	closed round r2 of Evidence retrieval for scientific claims (SciFact)	round
2026-09-28 22:54	re-parsed sf_qwen_s_e5first_n200_v1 · pair on scifact_200	reparse
2026-09-28 22:33	re-parsed sf_qwen_s_bm25first_n200_v1 · pair on scifact_200	reparse
2026-09-28 22:23	re-parsed sf_glm_s_e5first_n200_v1 · pair on scifact_200	reparse
2026-09-28 22:23	opened round r2 of Evidence retrieval for scientific claims (SciFact)	round
2026-09-28 22:13	re-parsed sf_glm_s_bm25first_n200_v1 · pair on scifact_200	reparse
2026-09-28 22:01	closed round r1 of Evidence retrieval for scientific claims (SciFact)	round
2026-09-28 21:46	re-parsed sf_llama_l_n200_v1 on scifact_200	reparse
2026-09-28 21:23	re-parsed sf_glm_m_n200_v1 on scifact_200	reparse
2026-09-28 21:19	re-parsed sf_deepseek_m_n200_v1 on scifact_200	reparse
2026-09-28 21:05	re-parsed sf_llama_m_n200_v1 on scifact_200	reparse
2026-09-28 20:54	re-parsed sf_deepseek_s_n200_v1 on scifact_200	reparse
2026-09-28 20:21	re-parsed sf_gemma_l_n200_v1 on scifact_200	reparse
2026-09-28 19:23	re-parsed sf_llama_s_n200_v1 on scifact_200	reparse
2026-09-28 18:59	re-parsed sf_gemma_s_n200_v1 on scifact_200	reparse
2026-09-28 18:40	re-parsed sf_gemma_m_n200_v1 on scifact_200	reparse
2026-09-28 18:30	re-parsed sf_glm_s_n200_v1 on scifact_200	reparse
2026-09-28 18:06	re-parsed sf_mistral_s_n200_v1 on scifact_200	reparse
2026-09-28 17:47	re-parsed sf_qwen_s_n200_v1 on scifact_200	reparse
2026-09-28 17:46	re-parsed sf_e5_base_n200_v1 on scifact_200	reparse
2026-09-28 17:46	re-parsed sf_mpnet_n200_v1 on scifact_200	reparse
2026-09-28 17:46	re-parsed sf_bge_small_n200_v1 on scifact_200	reparse
2026-09-28 17:46	re-parsed sf_first_k_n200_v1 on scifact_200	reparse
2026-09-28 17:46	re-parsed sf_minilm_n200_v1 on scifact_200	reparse
2026-09-28 17:46	re-parsed sf_random_n200_v1 on scifact_200	reparse
2026-09-28 17:46	opened round r1 of Evidence retrieval for scientific claims (SciFact)	round
2026-09-28 17:46	re-parsed sf_bm25_n200_v1 on scifact_200	reparse
2026-09-28 14:59	gold reference gold/scifact_200	reference
2026-09-28 14:59	gold reference gold/scifact_40	reference
2026-09-28 14:19	rescored fn_qwen_s_n200_v1 on few_nerd_280	rescore
2026-09-28 14:09	rescored fn_qwen_m_n200_v1 on few_nerd_280	rescore
2026-09-28 14:01	rescored fn_qwen_l_n200_v1 on few_nerd_280	rescore
2026-09-28 13:55	rescored fn_openai_s_n200_v1 on few_nerd_280	rescore
2026-09-28 13:48	rescored fn_openai_m_n200_v1 on few_nerd_280	rescore
2026-09-28 13:39	rescored fn_openai_l_n200_v1 on few_nerd_280	rescore
2026-09-28 13:29	rescored fn_mistral_s_n200_v1 on few_nerd_280	rescore
2026-09-28 13:25	rescored fn_mistral_m_n200_v1 on few_nerd_280	rescore
2026-09-28 12:54	rescored fn_llama_s_n200_v1 on few_nerd_280	rescore
2026-09-28 12:29	rescored fn_llama_m_n200_v1 on few_nerd_280	rescore
2026-09-28 12:07	rescored fn_llama_l_n200_v1 on few_nerd_280	rescore
2026-09-28 11:57	rescored fn_glm_s_n200_v1 on few_nerd_280	rescore
2026-09-28 11:40	rescored fn_glm_m_n200_v1 on few_nerd_280	rescore
2026-09-28 10:50	rescored fn_glm_l_n200_v1 on few_nerd_280	rescore
2026-09-28 10:22	rescored fn_gemma_s_n200_v1 on few_nerd_280	rescore
2026-09-28 10:08	rescored fn_gemma_m_n200_v1 on few_nerd_280	rescore
2026-09-28 09:55	rescored fn_gemma_l_n200_v1 on few_nerd_280	rescore
2026-09-28 09:44	rescored fn_deepseek_s_n200_v1 on few_nerd_280	rescore
2026-09-28 09:38	rescored fn_deepseek_m_n200_v1 on few_nerd_280	rescore
2026-09-28 09:21	rescored fn_deepseek_l_n200_v1 on few_nerd_280	rescore
2026-09-28 09:14	rescored fn_anthropic_s_n200_v1 on few_nerd_280	rescore
2026-09-28 09:02	rescored fn_anthropic_m_n200_v1 on few_nerd_280	rescore
2026-09-28 08:49	rescored fn_anthropic_l_n200_v1 on few_nerd_280	rescore
2026-09-28 07:08	rescored fn_span_marker_n200_v1 on few_nerd_280	rescore
2026-09-28 07:07	rescored fn_gliner_n200_v1 on few_nerd_280	rescore
2026-09-28 07:07	rescored fn_capitalized_n200_v1 on few_nerd_280	rescore
2026-09-28 07:07	rescored fn_nothing_n200_v1 on few_nerd_280	rescore
2026-09-28 07:07	opened round r1 of Named-entity extraction (Few-NERD)	round
2026-09-28 05:58	gold reference gold/few_nerd_56	reference
2026-09-28 05:40	gold reference gold/few_nerd_280	reference
2026-09-27 18:29	ran db_bart_mnli_n200_v1 on dbpedia_280	run
2026-09-27 17:56	ran db_qwen_s_n200_v1 on dbpedia_280	run
2026-09-27 16:58	ran db_qwen_m_n200_v1 on dbpedia_280	run
2026-09-27 16:54	ran db_qwen_l_n200_v1 on dbpedia_280	run
2026-09-27 16:46	ran db_openai_s_n200_v1 on dbpedia_280	run
2026-09-27 16:42	ran db_openai_m_n200_v1 on dbpedia_280	run
2026-09-27 16:36	ran db_openai_l_n200_v1 on dbpedia_280	run
2026-09-27 16:30	ran db_mistral_s_n200_v1 on dbpedia_280	run
2026-09-27 16:26	ran db_mistral_m_n200_v1 on dbpedia_280	run
2026-09-27 16:24	ran db_mistral_l_n200_v1 on dbpedia_280	run
2026-09-27 15:28	ran db_llama_s_n200_v1 on dbpedia_280	run
2026-09-27 15:21	ran db_llama_m_n200_v1 on dbpedia_280	run
2026-09-27 15:12	ran db_llama_l_n200_v1 on dbpedia_280	run
2026-09-27 15:09	ran db_keyword_n200_v1 on dbpedia_280	run
2026-09-27 15:09	ran db_glm_s_n200_v1 on dbpedia_280	run
2026-09-27 15:03	ran db_glm_m_n200_v1 on dbpedia_280	run
2026-09-27 14:54	ran db_glm_l_n200_v1 on dbpedia_280	run
2026-09-27 14:45	ran db_gemma_s_n200_v1 on dbpedia_280	run
2026-09-27 14:42	ran db_gemma_m_n200_v1 on dbpedia_280	run
2026-09-27 14:38	ran db_gemma_l_n200_v1 on dbpedia_280	run
2026-09-27 14:33	ran db_deepseek_s_n200_v1 on dbpedia_280	run
2026-09-27 14:25	ran db_deepseek_m_n200_v1 on dbpedia_280	run
2026-09-27 14:21	ran db_deepseek_l_n200_v1 on dbpedia_280	run
2026-09-27 14:12	ran db_constant_n200_v1 on dbpedia_280	run
2026-09-27 14:12	ran db_anthropic_s_n200_v1 on dbpedia_280	run
2026-09-27 14:07	ran db_anthropic_m_n200_v1 on dbpedia_280	run
2026-09-27 13:57	ran db_anthropic_l_n200_v1 on dbpedia_280	run
2026-09-27 13:57	opened round r1 of Encyclopedia topic classification (DBpedia)	round
2026-09-27 11:58	gold reference gold/dbpedia_280	reference
2026-09-27 11:58	gold reference gold/dbpedia_56	reference
2026-09-27 10:53	ran ag_qwen_s_n200_v1 on ag_news_200	run
2026-09-27 10:49	ran ag_qwen_m_n200_v1 on ag_news_200	run
2026-09-27 10:46	ran ag_qwen_l_n200_v1 on ag_news_200	run
2026-09-27 10:36	ran ag_openai_s_n200_v1 on ag_news_200	run
2026-09-27 10:33	ran ag_openai_m_n200_v1 on ag_news_200	run
2026-09-27 10:30	ran ag_openai_l_n200_v1 on ag_news_200	run
2026-09-27 10:26	ran ag_mistral_s_n200_v1 on ag_news_200	run
2026-09-27 10:23	ran ag_mistral_m_n200_v1 on ag_news_200	run
2026-09-27 10:22	ran ag_mistral_l_n200_v1 on ag_news_200	run
2026-09-27 09:51	ran ag_llama_s_n200_v1 on ag_news_200	run
2026-09-27 09:48	ran ag_llama_m_n200_v1 on ag_news_200	run
2026-09-27 09:44	ran ag_llama_l_n200_v1 on ag_news_200	run
2026-09-27 09:41	ran ag_keyword_n200_v1 on ag_news_200	run
2026-09-27 09:41	ran ag_glm_s_n200_v1 on ag_news_200	run
2026-09-27 09:37	ran ag_glm_m_n200_v1 on ag_news_200	run
2026-09-27 09:30	ran ag_glm_l_n200_v1 on ag_news_200	run
2026-09-27 09:23	ran ag_gemma_s_n200_v1 on ag_news_200	run
2026-09-27 09:21	ran ag_gemma_m_n200_v1 on ag_news_200	run
2026-09-27 09:19	ran ag_gemma_l_n200_v1 on ag_news_200	run
2026-09-27 09:16	ran ag_deepseek_s_n200_v1 on ag_news_200	run
2026-09-27 09:10	ran ag_deepseek_m_n200_v1 on ag_news_200	run
2026-09-27 09:07	ran ag_deepseek_l_n200_v1 on ag_news_200	run
2026-09-27 09:03	ran ag_constant_n200_v1 on ag_news_200	run
2026-09-27 09:03	ran ag_bert_mini_n200_v1 on ag_news_200	run
2026-09-27 09:03	ran ag_bart_mnli_n200_v1 on ag_news_200	run
2026-09-27 08:58	ran ag_anthropic_s_n200_v1 on ag_news_200	run
2026-09-27 08:55	ran ag_anthropic_m_n200_v1 on ag_news_200	run
2026-09-27 08:48	ran ag_anthropic_l_n200_v1 on ag_news_200	run
2026-09-27 08:48	opened round r1 of News topic classification (AG News)	round
2026-09-27 08:02	gold reference gold/ag_news_200	reference
2026-09-27 08:02	gold reference gold/ag_news_20	reference
2026-09-26 16:14	ran cnn_bart_l_n200_v1 on cnn_dailymail_200	run
2026-09-26 15:37	ran cnn_bart_l_v1 on cnn_dailymail_20	run
2026-09-26 15:33	ran cnn_lead3_n200_v1 on cnn_dailymail_200	run
2026-09-26 15:33	ran cnn_lead3_v1 on cnn_dailymail_20	run
2026-09-26 11:28	ran cnn_mistral_s_n200_v1 on cnn_dailymail_200	run
2026-09-26 11:19	ran cnn_mistral_m_n200_v1 on cnn_dailymail_200	run
2026-09-26 11:10	ran cnn_mistral_l_n200_v1 on cnn_dailymail_200	run
2026-09-26 10:29	ran cnn_glm_s_n200_v1 on cnn_dailymail_200	run
2026-09-26 10:23	ran cnn_glm_m_n200_v1 on cnn_dailymail_200	run
2026-09-26 10:12	ran cnn_glm_l_n200_v1 on cnn_dailymail_200	run
2026-09-26 09:53	ran cnn_qwen_s_n200_v1 on cnn_dailymail_200	run
2026-09-26 08:12	ran cnn_qwen_l_n200_v1 on cnn_dailymail_200	run
2026-09-26 08:02	ran cnn_gemma_s_n200_v1 on cnn_dailymail_200	run
2026-09-26 07:39	ran cnn_gemma_m_n200_v1 on cnn_dailymail_200	run
2026-09-26 07:32	ran cnn_gemma_l_n200_v1 on cnn_dailymail_200	run
2026-09-26 07:24	ran cnn_llama_s_n200_v1 on cnn_dailymail_200	run
2026-09-26 07:05	ran cnn_openai_s_n200_v1 on cnn_dailymail_200	run
2026-09-26 07:00	ran cnn_openai_m_n200_v1 on cnn_dailymail_200	run
2026-09-26 06:54	ran cnn_anthropic_s_n200_v1 on cnn_dailymail_200	run
2026-09-26 06:48	ran cnn_anthropic_l_n200_v1 on cnn_dailymail_200	run
2026-09-26 00:32	ran cnn_anthropic_m_n200_v1 on cnn_dailymail_200	run
2026-09-26 00:22	ran cnn_openai_l_n200_v1 on cnn_dailymail_200	run
2026-09-26 00:16	ran cnn_llama_l_n200_v1 on cnn_dailymail_200	run
2026-09-26 00:04	ran cnn_llama_m_n200_v1 on cnn_dailymail_200	run
2026-09-25 23:51	ran cnn_deepseek_l_n200_v1 on cnn_dailymail_200	run
2026-09-25 23:42	ran cnn_deepseek_m_n200_v1 on cnn_dailymail_200	run
2026-09-25 23:36	ran cnn_deepseek_s_n200_v1 on cnn_dailymail_200	run
2026-09-25 23:26	ran cnn_qwen_m_n200_v1 on cnn_dailymail_200	run
2026-09-25 23:26	opened round r1 of Short news summaries (CNN)	round
2026-09-25 23:19	gold reference gold/cnn_dailymail_200	reference
2026-09-25 08:00	gold reference gold/cnn_dailymail_20	reference
2026-09-25 05:53	silver reference silver/smoke_v1 written by `reference_opus_v1`	reference