dataset
few_nerd_56
56 items · 0 arms. Headline: each arm's own primary metric, mean over its items; arms with different primary metrics are not ranked against each other.
01arms
scored against silverscored by a judgescored against a label set, not a reference setunmarked rows are scored against gold
| arm | metric | mean | items | cost per item | speed per item | runs | scored against |
|---|
02what's inside
56 items, text, 5–61 words (median 24, middle half 16–33).
Source: DFKI-SLT/few-nerd (test split). The text stays there; each item below links to its row.
the gold
gold/few_nerd_56: a list per item, 0–13 entries, median 2
| item | words | gold | open |
|---|---|---|---|
009e011601e7 | 32 | 2 entries | source ↗ |
0d9666f7f385 | 23 | 0 entries | source ↗ |
0e88aabc5a04 | 17 | 0 entries | source ↗ |
0fd56d48992d | 5 | 0 entries | source ↗ |
114599c4db48 | 27 | 2 entries | source ↗ |
154350ae6e7f | 33 | 4 entries | source ↗ |
184098570107 | 11 | 2 entries | source ↗ |
1985ab09043b | 16 | 2 entries | source ↗ |
1996f8ce65e3 | 36 | 5 entries | source ↗ |
1e39a6ccdcf8 | 31 | 4 entries | source ↗ |
1f007e7e7bc7 | 36 | 2 entries | source ↗ |
225a2c68e43e | 8 | 1 entries | source ↗ |
259eccd9c019 | 28 | 5 entries | source ↗ |
2708ce3cf54a | 16 | 2 entries | source ↗ |
2a41dc156fa9 | 11 | 1 entries | source ↗ |
3508a3a3b41d | 26 | 3 entries | source ↗ |
353f0f464182 | 11 | 1 entries | source ↗ |
3abb3b9915ef | 24 | 2 entries | source ↗ |
45a806c770c2 | 61 | 13 entries | source ↗ |
4a6a00d4b489 | 23 | 2 entries | source ↗ |
4b6ab1b30460 | 17 | 4 entries | source ↗ |
5418a048089c | 32 | 4 entries | source ↗ |
59ff807150be | 50 | 3 entries | source ↗ |
5a648df06391 | 22 | 0 entries | source ↗ |
61d02cfeea14 | 18 | 3 entries | source ↗ |
63a55a54089c | 42 | 6 entries | source ↗ |
675c0e87cbd9 | 33 | 1 entries | source ↗ |
68495a46e487 | 16 | 4 entries | source ↗ |
7134935983e3 | 26 | 0 entries | source ↗ |
756f937ac1ca | 24 | 3 entries | source ↗ |
7779c6667d6d | 25 | 2 entries | source ↗ |
815027679a00 | 34 | 2 entries | source ↗ |
9e6f8f7c28a6 | 15 | 2 entries | source ↗ |
ac3383156b9f | 26 | 4 entries | source ↗ |
b0d96c600ed9 | 43 | 6 entries | source ↗ |
b1bd7568935c | 10 | 2 entries | source ↗ |
b1dfb240c31f | 33 | 3 entries | source ↗ |
b2283442b299 | 31 | 3 entries | source ↗ |
b8bc97b4949d | 26 | 3 entries | source ↗ |
be34c5ea1240 | 10 | 1 entries | source ↗ |
c12a0d572623 | 53 | 6 entries | source ↗ |
c463913bc497 | 43 | 0 entries | source ↗ |
c51442586d8e | 15 | 4 entries | source ↗ |
c652a25da2f9 | 54 | 5 entries | source ↗ |
c7d2d8aa9755 | 23 | 3 entries | source ↗ |
d27225312792 | 14 | 2 entries | source ↗ |
d2bb81825498 | 41 | 8 entries | source ↗ |
d837cd062513 | 21 | 1 entries | source ↗ |
d9d3911536f2 | 11 | 0 entries | source ↗ |
dcc5b5ca25ad | 24 | 1 entries | source ↗ |
ee24c587d358 | 7 | 1 entries | source ↗ |
ee90f2323bf7 | 12 | 2 entries | source ↗ |
efd76ea1d6ce | 10 | 1 entries | source ↗ |
f56f1708001a | 53 | 6 entries | source ↗ |
f5708db0e156 | 30 | 3 entries | source ↗ |
fac5fa7ae1d1 | 17 | 2 entries | source ↗ |
Each row is the profile evh dataset-items --dataset-id few_nerd_56 prints; inspect opens the item in the inspector with the dataset's largest group of comparable arms, and its text where the inspector runs on a machine that has it.
03reference sets
- gold/few_nerd_56 gold · promoted from person the dataset's authors
04labels
No labels yet. A sheet to fill: evh label-sheet --dataset-id few_nerd_56 --out sheet.csv; a run's outputs as a model set: evh label-from-run --run R --set S.