dataset
ag_news_20
20 items · 0 arms. Headline: each arm's own primary metric, mean over its items; arms with different primary metrics are not ranked against each other.
01arms
scored against silverscored by a judgescored against a label set, not a reference setunmarked rows are scored against gold
| arm | metric | mean | items | cost per item | speed per item | runs | scored against |
|---|
02what's inside
20 items, text, 24–136 words (median 47, middle half 35–55).
Source: fancyzhx/ag_news (test split). The text stays there; each item below links to its row.
the gold
gold/ag_news_20: 4 labels
| label | items | share |
|---|---|---|
| Business | 5 | 25% |
| Sci/Tech | 5 | 25% |
| Sports | 5 | 25% |
| World | 5 | 25% |
| item | words | gold | open |
|---|---|---|---|
013ffb81b47f | 25 | Business | source ↗ |
0c47eb9eeb6c | 67 | Sports | source ↗ |
0e7de46882b2 | 69 | Sports | source ↗ |
108a71f66723 | 136 | Sci/Tech | source ↗ |
2510d175de8d | 70 | Sports | source ↗ |
416fc273495b | 24 | World | source ↗ |
655d89d95924 | 31 | Sports | source ↗ |
7e2d0886edef | 45 | Sci/Tech | source ↗ |
8df82604abfc | 41 | Business | source ↗ |
a1164f3023b0 | 48 | Sci/Tech | source ↗ |
a787b831978f | 44 | World | source ↗ |
afbd779348f0 | 30 | Business | source ↗ |
bee7c037baed | 47 | Business | source ↗ |
c2d5dcb0c469 | 34 | Sci/Tech | source ↗ |
cbdcc8db3003 | 35 | Sports | source ↗ |
d2ddffdd6e90 | 55 | Sci/Tech | source ↗ |
d8817a3ea9e1 | 46 | Business | source ↗ |
e1d8311be5d9 | 52 | World | source ↗ |
e35f3ecb1e02 | 55 | World | source ↗ |
eced564834db | 64 | World | source ↗ |
Each row is the profile evh dataset-items --dataset-id ag_news_20 prints; inspect opens the item in the inspector with the dataset's largest group of comparable arms, and its text where the inspector runs on a machine that has it.
03reference sets
- gold/ag_news_20 gold · promoted from person the dataset's authors
04labels
No labels yet. A sheet to fill: evh label-sheet --dataset-id ag_news_20 --out sheet.csv; a run's outputs as a model set: evh label-from-run --run R --set S.