metric

`escalated`

better: lower
kind: quality: measured against a reference or by a judge
decides: no goal
weighed by: no goal
recorded on: orrery_triage_v1_labelled

01what it measures, and how

1 when the decision hands the signal to a person (escalate), labelled or not.

A project explains its own metric at length with METRIC_DESCRIPTIONS = {"escalated": {"summary": "…", "details": "…"}}.

02on orrery_triage_v1_labelled

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

arm	mean escalated	items	scored against
triage_local_dgx_llama31_8b_v1	0.154	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_llama31_8b_v1 · rescored 3d3a6afd	0.154	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_llama31_8b_v1 · rescored 5f2c057c	0.154	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_llama31_8b_v1 · rescored 77adc97b	0.154	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_llama31_8b_v1 · rescored cd35dc1f	0.154	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gpt_oss_20b_v1 · rescored 5f2c057c	0.169	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gpt_oss_20b_v1 · rescored 77adc97b	0.169	65	gold/orrery_triage_v1_labelled gold
triage_gpt_61_sol_v1	0.185	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_llama31_8b_v1	0.185	65	gold/orrery_triage_v1_labelled gold
triage_gpt_61_sol_v1 · repeats ×3	0.185	65	gold/orrery_triage_v1_labelled gold
triage_gpt_61_sol_v1 · rescored 3d3a6afd	0.185	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_llama31_8b_v1 · rescored 3d3a6afd	0.185	65	gold/orrery_triage_v1_labelled gold
triage_gpt_61_sol_v1 · rescored 3d3a6afd, repeats ×3	0.185	65	gold/orrery_triage_v1_labelled gold
triage_gpt_61_sol_v1 · rescored 5f2c057c	0.185	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_llama31_8b_v1 · rescored 5f2c057c	0.185	65	gold/orrery_triage_v1_labelled gold
triage_gpt_61_sol_v1 · rescored 5f2c057c, repeats ×3	0.185	65	gold/orrery_triage_v1_labelled gold
triage_gpt_61_sol_v1 · rescored 77adc97b	0.185	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_llama31_8b_v1 · rescored 77adc97b	0.185	65	gold/orrery_triage_v1_labelled gold
triage_gpt_61_sol_v1 · rescored 77adc97b, repeats ×3	0.185	65	gold/orrery_triage_v1_labelled gold
triage_gpt_61_sol_v1 · rescored cd35dc1f	0.185	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_llama31_8b_v1 · rescored cd35dc1f	0.185	65	gold/orrery_triage_v1_labelled gold
triage_gpt_61_sol_v1 · rescored cd35dc1f, repeats ×3	0.185	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v1	0.200	65	gold/orrery_triage_v1_labelled gold
triage_haiku_55_v1	0.200	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_llama31_8b_v1	0.200	65	gold/orrery_triage_v1_labelled gold
triage_haiku_55_v1 · rescored 3d3a6afd	0.200	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_llama31_8b_v1 · rescored 3d3a6afd	0.200	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v1 · rescored 5f2c057c	0.200	65	gold/orrery_triage_v1_labelled gold
triage_haiku_55_v1 · rescored 5f2c057c	0.200	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_llama31_8b_v1 · rescored 5f2c057c	0.200	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v1 · rescored 77adc97b	0.200	65	gold/orrery_triage_v1_labelled gold
triage_haiku_55_v1 · rescored 77adc97b	0.200	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_llama31_8b_v1 · rescored 77adc97b	0.200	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v1 · rescored cd35dc1f	0.200	65	gold/orrery_triage_v1_labelled gold
triage_haiku_55_v1 · rescored cd35dc1f	0.200	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_llama31_8b_v1 · rescored cd35dc1f	0.200	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_llama4_scout_v1	0.215	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_llama4_scout_v1 · rescored 3d3a6afd	0.215	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_20b_v1 · rescored 5f2c057c	0.215	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_llama4_scout_v1 · rescored 5f2c057c	0.215	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_20b_v1 · rescored 77adc97b	0.215	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_llama4_scout_v1 · rescored 77adc97b	0.215	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_llama4_scout_v1 · rescored cd35dc1f	0.215	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v1 · repeats ×3	0.221	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v1 · rescored 5f2c057c, repeats ×3	0.221	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v1 · rescored 77adc97b, repeats ×3	0.221	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v1 · rescored cd35dc1f, repeats ×3	0.221	65	gold/orrery_triage_v1_labelled gold
triage_haiku_55_v1 · repeats ×3	0.226	65	gold/orrery_triage_v1_labelled gold
triage_haiku_55_v1 · rescored 3d3a6afd, repeats ×3	0.226	65	gold/orrery_triage_v1_labelled gold
triage_haiku_55_v1 · rescored 5f2c057c, repeats ×3	0.226	65	gold/orrery_triage_v1_labelled gold
triage_haiku_55_v1 · rescored 77adc97b, repeats ×3	0.226	65	gold/orrery_triage_v1_labelled gold
triage_haiku_55_v1 · rescored cd35dc1f, repeats ×3	0.226	65	gold/orrery_triage_v1_labelled gold
triage_hosted_mistral_medium_35_v1	0.231	65	gold/orrery_triage_v1_labelled gold
triage_kimi_k31_pro_v1	0.231	65	gold/orrery_triage_v1_labelled gold
triage_hosted_mistral_medium_35_v1 · rescored 3d3a6afd	0.231	65	gold/orrery_triage_v1_labelled gold
triage_hosted_mistral_medium_35_v1 · rescored 5f2c057c	0.231	65	gold/orrery_triage_v1_labelled gold
triage_kimi_k31_pro_v1 · rescored 5f2c057c	0.231	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gpt_oss_20b_v1 · rescored 5f2c057c	0.231	65	gold/orrery_triage_v1_labelled gold
triage_hosted_mistral_medium_35_v1 · rescored 77adc97b	0.231	65	gold/orrery_triage_v1_labelled gold
triage_kimi_k31_pro_v1 · rescored 77adc97b	0.231	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gpt_oss_20b_v1 · rescored 77adc97b	0.231	65	gold/orrery_triage_v1_labelled gold
triage_hosted_mistral_medium_35_v1 · rescored cd35dc1f	0.231	65	gold/orrery_triage_v1_labelled gold
triage_kimi_k31_pro_v1 · rescored cd35dc1f	0.231	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_mistral_medium_35_128b_v1	0.262	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_mistral_medium_35_128b_v1 · rescored 3d3a6afd	0.262	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_mistral_medium_35_128b_v1 · rescored 5f2c057c	0.262	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_mistral_medium_35_128b_v1 · rescored 77adc97b	0.262	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_mistral_medium_35_128b_v1 · rescored cd35dc1f	0.262	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1	0.277	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1 · rescored 3d3a6afd	0.277	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1 · rescored 5f2c057c	0.277	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1 · rescored 77adc97b	0.277	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_vllm_qwen3_30b_a3b_nvfp4_v1 · rescored cd35dc1f	0.277	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_120b_v1	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_phi4_14b_v1	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_lightning_30b_v1	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_phi4_14b_v1 · rescored 3d3a6afd	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_120b_v1 · rescored 5f2c057c	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_phi4_14b_v1 · rescored 5f2c057c	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_lightning_30b_v1 · rescored 5f2c057c	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_120b_v1 · rescored 77adc97b	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_phi4_14b_v1 · rescored 77adc97b	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_lightning_30b_v1 · rescored 77adc97b	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_120b_v1 · rescored cd35dc1f	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_phi4_14b_v1 · rescored cd35dc1f	0.292	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_lightning_30b_v1 · rescored cd35dc1f	0.292	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen3_30b_a3b_v1	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_20b_v2	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_phi4_14b_v1	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gpt_oss_20b_v2	0.308	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen3_30b_a3b_v1 · rescored 3d3a6afd	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_20b_v2 · rescored 3d3a6afd	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_phi4_14b_v1 · rescored 3d3a6afd	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gpt_oss_20b_v2 · rescored 3d3a6afd	0.308	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen3_30b_a3b_v1 · rescored 5f2c057c	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_20b_v2 · rescored 5f2c057c	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_phi4_14b_v1 · rescored 5f2c057c	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gpt_oss_20b_v2 · rescored 5f2c057c	0.308	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen3_30b_a3b_v1 · rescored 77adc97b	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_phi4_14b_v1 · rescored 77adc97b	0.308	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen3_30b_a3b_v1 · rescored cd35dc1f	0.308	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_phi4_14b_v1 · rescored cd35dc1f	0.308	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen35_122b_v1	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_120b_v2	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_31b_v1	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_lightning_30b_v1	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_phi4_14b_v1	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_120b_v2 · rescored 3d3a6afd	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_phi4_14b_v1 · rescored 3d3a6afd	0.323	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen35_122b_v1 · rescored 5f2c057c	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_120b_v2 · rescored 5f2c057c	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_31b_v1 · rescored 5f2c057c	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_lightning_30b_v1 · rescored 5f2c057c	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_phi4_14b_v1 · rescored 5f2c057c	0.323	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen35_122b_v1 · rescored 77adc97b	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_31b_v1 · rescored 77adc97b	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_lightning_30b_v1 · rescored 77adc97b	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_phi4_14b_v1 · rescored 77adc97b	0.323	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen35_122b_v1 · rescored cd35dc1f	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_31b_v1 · rescored cd35dc1f	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_lightning_30b_v1 · rescored cd35dc1f	0.323	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_phi4_14b_v1 · rescored cd35dc1f	0.323	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v2	0.338	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gpt_oss_120b_v1	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_lightning_30b_v1	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_lightning_30b_v2	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v2	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen3_30b_a3b_v1	0.338	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v2 · rescored 3d3a6afd	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_lightning_30b_v2 · rescored 3d3a6afd	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v2 · rescored 3d3a6afd	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen3_30b_a3b_v1 · rescored 3d3a6afd	0.338	65	gold/orrery_triage_v1_labelled gold
triage_gpt_6_luna_v2 · rescored 5f2c057c	0.338	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gpt_oss_120b_v1 · rescored 5f2c057c	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_lightning_30b_v1 · rescored 5f2c057c	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_lightning_30b_v2 · rescored 5f2c057c	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v2 · rescored 5f2c057c	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen3_30b_a3b_v1 · rescored 5f2c057c	0.338	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gpt_oss_120b_v1 · rescored 77adc97b	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_lightning_30b_v1 · rescored 77adc97b	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen3_30b_a3b_v1 · rescored 77adc97b	0.338	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gpt_oss_120b_v1 · rescored cd35dc1f	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_lightning_30b_v1 · rescored cd35dc1f	0.338	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen3_30b_a3b_v1 · rescored cd35dc1f	0.338	65	gold/orrery_triage_v1_labelled gold
triage_kimi_k31_pro_v2	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_31b_v1	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen35_122b_v1	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen3_30b_a3b_v1	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_bolt_e4b_v1	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_bolt_e4b_v2	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen3_30b_a3b_v1	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gemma4_31b_v1	0.354	65	gold/orrery_triage_v1_labelled gold
triage_kimi_k31_pro_v2 · rescored 3d3a6afd	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen3_30b_a3b_v1 · rescored 3d3a6afd	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_bolt_e4b_v2 · rescored 3d3a6afd	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen3_30b_a3b_v1 · rescored 3d3a6afd	0.354	65	gold/orrery_triage_v1_labelled gold
triage_kimi_k31_pro_v2 · rescored 5f2c057c	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_31b_v1 · rescored 5f2c057c	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen35_122b_v1 · rescored 5f2c057c	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen3_30b_a3b_v1 · rescored 5f2c057c	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_bolt_e4b_v1 · rescored 5f2c057c	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_bolt_e4b_v2 · rescored 5f2c057c	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen3_30b_a3b_v1 · rescored 5f2c057c	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gemma4_31b_v1 · rescored 5f2c057c	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_31b_v1 · rescored 77adc97b	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen35_122b_v1 · rescored 77adc97b	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen3_30b_a3b_v1 · rescored 77adc97b	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_bolt_e4b_v1 · rescored 77adc97b	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen3_30b_a3b_v1 · rescored 77adc97b	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gemma4_31b_v1 · rescored 77adc97b	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_31b_v1 · rescored cd35dc1f	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen35_122b_v1 · rescored cd35dc1f	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen3_30b_a3b_v1 · rescored cd35dc1f	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_nemotron_35_bolt_e4b_v1 · rescored cd35dc1f	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen3_30b_a3b_v1 · rescored cd35dc1f	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gemma4_31b_v1 · rescored cd35dc1f	0.354	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_lightning_30b_v2	0.369	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gpt_oss_20b_v2	0.369	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_lightning_30b_v2 · rescored 3d3a6afd	0.369	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gpt_oss_20b_v2 · rescored 3d3a6afd	0.369	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_lightning_30b_v2 · rescored 5f2c057c	0.369	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gpt_oss_20b_v2 · rescored 5f2c057c	0.369	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_12b_noreason_v1	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_bolt_e4b_v2	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v1	0.385	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_v1 · repeats ×3	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v1 · repeats	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_12b_noreason_v1 · rescored 3d3a6afd	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_bolt_e4b_v2 · rescored 3d3a6afd	0.385	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_v1 · rescored 3d3a6afd, repeats ×3	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_12b_noreason_v1 · rescored 5f2c057c	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_bolt_e4b_v2 · rescored 5f2c057c	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored 5f2c057c	0.385	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_v1 · rescored 5f2c057c, repeats ×3	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored 5f2c057c, repeats	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_12b_noreason_v1 · rescored 77adc97b	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored 77adc97b	0.385	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_v1 · rescored 77adc97b, repeats ×3	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored 77adc97b, repeats	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_12b_noreason_v1 · rescored cd35dc1f	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored cd35dc1f	0.385	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_v1 · rescored cd35dc1f, repeats ×3	0.385	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_bolt_e4b_v1 · rescored cd35dc1f, repeats	0.385	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_v1	0.400	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gpt_oss_120b_v2	0.400	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen38_27b_v2	0.400	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen38_27b_v2	0.400	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_v1 · rescored 3d3a6afd	0.400	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gpt_oss_120b_v2 · rescored 3d3a6afd	0.400	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen38_27b_v2 · rescored 3d3a6afd	0.400	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen38_27b_v2 · rescored 3d3a6afd	0.400	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_v1 · rescored 5f2c057c	0.400	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gpt_oss_120b_v2 · rescored 5f2c057c	0.400	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen38_27b_v2 · rescored 5f2c057c	0.400	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen38_27b_v2 · rescored 5f2c057c	0.400	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_v1 · rescored 77adc97b	0.400	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_v1 · rescored cd35dc1f	0.400	65	gold/orrery_triage_v1_labelled gold
triage_gemini_4_argon_v1	0.415	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gpt_oss_20b_v1	0.415	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_lightning_30b_v2	0.415	65	gold/orrery_triage_v1_labelled gold
triage_gemini_4_argon_v1 · rescored 3d3a6afd	0.415	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_lightning_30b_v2 · rescored 3d3a6afd	0.415	65	gold/orrery_triage_v1_labelled gold
triage_gemini_4_argon_v1 · rescored 5f2c057c	0.415	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_nemotron_35_lightning_30b_v2 · rescored 5f2c057c	0.415	65	gold/orrery_triage_v1_labelled gold
triage_gemini_4_argon_v1 · rescored 77adc97b	0.415	65	gold/orrery_triage_v1_labelled gold
triage_gemini_4_argon_v1 · rescored cd35dc1f	0.415	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gpt_oss_20b_v1 · rescored cd35dc1f	0.415	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_noreason_v1	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_bolt_e4b_v1	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen38_27b_v2	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen38_27b_v1	0.431	65	gold/orrery_triage_v1_labelled gold
triage_sonnet_55_v1	0.431	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_noreason_v1 · rescored 3d3a6afd	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen38_27b_v2 · rescored 3d3a6afd	0.431	65	gold/orrery_triage_v1_labelled gold
triage_sonnet_55_v1 · rescored 3d3a6afd	0.431	65	gold/orrery_triage_v1_labelled gold
triage_baseline_pro_noreason_v1 · rescored 5f2c057c	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_bolt_e4b_v1 · rescored 5f2c057c	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen38_27b_v2 · rescored 5f2c057c	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen38_27b_v1 · rescored 5f2c057c	0.431	65	gold/orrery_triage_v1_labelled gold
triage_sonnet_55_v1 · rescored 5f2c057c	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_bolt_e4b_v1 · rescored 77adc97b	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen38_27b_v1 · rescored 77adc97b	0.431	65	gold/orrery_triage_v1_labelled gold
triage_sonnet_55_v1 · rescored 77adc97b	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_bolt_e4b_v1 · rescored cd35dc1f	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_qwen38_27b_v1 · rescored cd35dc1f	0.431	65	gold/orrery_triage_v1_labelled gold
triage_sonnet_55_v1 · rescored cd35dc1f	0.431	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_20b_v1	0.446	65	gold/orrery_triage_v1_labelled gold
triage_mistral_large_4_v1	0.446	65	gold/orrery_triage_v1_labelled gold
triage_mistral_large_4_v1 · rescored 5f2c057c	0.446	65	gold/orrery_triage_v1_labelled gold
triage_mistral_large_4_v1 · rescored 77adc97b	0.446	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gpt_oss_20b_v1 · rescored cd35dc1f	0.446	65	gold/orrery_triage_v1_labelled gold
triage_mistral_large_4_v1 · rescored cd35dc1f	0.446	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen35_122b_v2	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen35_122b_v2	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_12b_noreason_v1	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen38_27b_v1	0.462	65	gold/orrery_triage_v1_labelled gold
triage_mistral_large_4_v2	0.462	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen35_122b_v2 · rescored 3d3a6afd	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen35_122b_v2 · rescored 3d3a6afd	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_12b_noreason_v1 · rescored 3d3a6afd	0.462	65	gold/orrery_triage_v1_labelled gold
triage_mistral_large_4_v2 · rescored 3d3a6afd	0.462	65	gold/orrery_triage_v1_labelled gold
triage_hosted_qwen35_122b_v2 · rescored 5f2c057c	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen35_122b_v2 · rescored 5f2c057c	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_12b_noreason_v1 · rescored 5f2c057c	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen38_27b_v1 · rescored 5f2c057c	0.462	65	gold/orrery_triage_v1_labelled gold
triage_mistral_large_4_v2 · rescored 5f2c057c	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_12b_noreason_v1 · rescored 77adc97b	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen38_27b_v1 · rescored 77adc97b	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_12b_noreason_v1 · rescored cd35dc1f	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_qwen38_27b_v1 · rescored cd35dc1f	0.462	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_ministral_3_14b_v1	0.508	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen38_27b_v1	0.508	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gpt_oss_20b_v1	0.508	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_ministral_3_14b_v1 · rescored 3d3a6afd	0.508	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_ministral_3_14b_v1 · rescored 5f2c057c	0.508	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen38_27b_v1 · rescored 5f2c057c	0.508	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_ministral_3_14b_v1 · rescored 77adc97b	0.508	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen38_27b_v1 · rescored 77adc97b	0.508	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_ministral_3_14b_v1 · rescored cd35dc1f	0.508	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_qwen38_27b_v1 · rescored cd35dc1f	0.508	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gpt_oss_20b_v1 · rescored cd35dc1f	0.508	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gemma4_31b_v1	0.523	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_31b_v2	0.523	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_31b_v2 · rescored 3d3a6afd	0.523	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gemma4_31b_v1 · rescored 5f2c057c	0.523	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_gemma4_31b_v2 · rescored 5f2c057c	0.523	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gemma4_31b_v1 · rescored 77adc97b	0.523	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gemma4_31b_v1 · rescored cd35dc1f	0.523	65	gold/orrery_triage_v1_labelled gold
triage_deepseek_41flash_v1	0.538	65	gold/orrery_triage_v1_labelled gold
triage_gemini_35_flash_lite_v1	0.538	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_31b_v2	0.538	65	gold/orrery_triage_v1_labelled gold
triage_gemini_35_flash_lite_v1 · rescored 3d3a6afd	0.538	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_31b_v2 · rescored 3d3a6afd	0.538	65	gold/orrery_triage_v1_labelled gold
triage_deepseek_41flash_v1 · rescored 5f2c057c	0.538	65	gold/orrery_triage_v1_labelled gold
triage_gemini_35_flash_lite_v1 · rescored 5f2c057c	0.538	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_gemma4_31b_v2 · rescored 5f2c057c	0.538	65	gold/orrery_triage_v1_labelled gold
triage_deepseek_41flash_v1 · rescored 77adc97b	0.538	65	gold/orrery_triage_v1_labelled gold
triage_gemini_35_flash_lite_v1 · rescored 77adc97b	0.538	65	gold/orrery_triage_v1_labelled gold
triage_deepseek_41flash_v1 · rescored cd35dc1f	0.538	65	gold/orrery_triage_v1_labelled gold
triage_gemini_35_flash_lite_v1 · rescored cd35dc1f	0.538	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gemma4_31b_v2	0.554	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gemma4_31b_v2	0.554	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gemma4_31b_v2 · rescored 3d3a6afd	0.554	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gemma4_31b_v2 · rescored 3d3a6afd	0.554	65	gold/orrery_triage_v1_labelled gold
triage_hosted_gemma4_31b_v2 · rescored 5f2c057c	0.554	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_gemma4_31b_v2 · rescored 5f2c057c	0.554	65	gold/orrery_triage_v1_labelled gold
triage_deepseek_41flash_v2	0.585	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_super_120b_v2	0.585	65	gold/orrery_triage_v1_labelled gold
triage_deepseek_41flash_v2 · rescored 3d3a6afd	0.585	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_super_120b_v2 · rescored 3d3a6afd	0.585	65	gold/orrery_triage_v1_labelled gold
triage_deepseek_41flash_v2 · rescored 5f2c057c	0.585	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_super_120b_v2 · rescored 5f2c057c	0.585	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_ministral_3_14b_v1	0.615	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_ministral_3_14b_v1 · rescored 3d3a6afd	0.615	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_ministral_3_14b_v1 · rescored 5f2c057c	0.615	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_ministral_3_14b_v1 · rescored 77adc97b	0.615	65	gold/orrery_triage_v1_labelled gold
triage_local_x3_ministral_3_14b_v1 · rescored cd35dc1f	0.615	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_ministral_3_14b_v1 · rescored 3d3a6afd	0.631	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_ministral_3_14b_v1 · rescored 5f2c057c	0.631	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_ministral_3_14b_v1 · rescored 77adc97b	0.631	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_ministral_3_14b_v1	0.646	65	gold/orrery_triage_v1_labelled gold
triage_local_mac_ministral_3_14b_v1 · rescored cd35dc1f	0.646	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_super_120b_v1	0.677	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_super_120b_v1 · rescored 5f2c057c	0.677	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_super_120b_v1 · rescored 77adc97b	0.677	65	gold/orrery_triage_v1_labelled gold
triage_local_dgx_nemotron_35_super_120b_v1 · rescored cd35dc1f	0.677	65	gold/orrery_triage_v1_labelled gold
triage_stub_dismiss_v1	0.738	65	gold/orrery_triage_v1_labelled gold
triage_stub_dismiss_v1 · rescored 3d3a6afd	0.738	65	gold/orrery_triage_v1_labelled gold
triage_stub_dismiss_v1 · rescored 5f2c057c	0.738	65	gold/orrery_triage_v1_labelled gold
triage_stub_dismiss_v1 · rescored 77adc97b	0.738	65	gold/orrery_triage_v1_labelled gold
triage_stub_dismiss_v1 · rescored cd35dc1f	0.738	65	gold/orrery_triage_v1_labelled gold
triage_stub_escalate_v1	1.000	65	gold/orrery_triage_v1_labelled gold
triage_stub_escalate_v1 · rescored 3d3a6afd	1.000	65	gold/orrery_triage_v1_labelled gold
triage_stub_escalate_v1 · rescored 5f2c057c	1.000	65	gold/orrery_triage_v1_labelled gold
triage_stub_escalate_v1 · rescored 77adc97b	1.000	65	gold/orrery_triage_v1_labelled gold
triage_stub_escalate_v1 · rescored cd35dc1f	1.000	65	gold/orrery_triage_v1_labelled gold