eval-harness

dataset

dbpedia_56

56 items · 0 arms. Headline: each arm's own primary metric, mean over its items; arms with different primary metrics are not ranked against each other.

Open its sheet

goals: Encyclopedia topic classification (DBpedia)

01arms

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

0 shown
armmetricmeanitemscost per itemspeed per itemrunsscored against

02what's inside

56 items, text, 15–88 words (median 52, middle half 32–64).

Source: fancyzhx/dbpedia_14 (test split). The text stays there; each item below links to its row.

051015–22 words: 723–30 words: 731–38 words: 739–46 words: 447–54 words: 855–62 words: 763–70 words: 971–78 words: 379–86 words: 387–94 words: 115–2223–3031–3839–4647–5455–6263–7071–7879–8687–94

the gold

gold/dbpedia_56: 14 labels

labelitemsshare
Album47%
Animal47%
Artist47%
Athlete47%
Building47%
Company47%
EducationalInstitution47%
Film47%
MeanOfTransportation47%
NaturalPlace47%
OfficeHolder47%
Plant47%
Village47%
WrittenWork47%
56 shown
itemwordsgoldopen
012d6549a98578WrittenWorksource ↗
041dde9431ee27Animalsource ↗
16062e4d00d834Plantsource ↗
16a663d1fa4d59Buildingsource ↗
178dc4e9c79975Buildingsource ↗
187748b7cb0f23Animalsource ↗
1c889e48a25a62Albumsource ↗
1d7da8efac6d24Plantsource ↗
20d46295732860Albumsource ↗
21995c6d588241MeanOfTransportationsource ↗
22f1d00f80f420NaturalPlacesource ↗
2e53cd0b6bd860MeanOfTransportationsource ↗
309346131a8d51Athletesource ↗
3130d871fee126EducationalInstitutionsource ↗
31e391afb71571WrittenWorksource ↗
35373bf1162034Companysource ↗
3cc62ef27e2563Artistsource ↗
3fe3a6eb6a0119Filmsource ↗
43be8c16478120Plantsource ↗
452e565b1a6c44Athletesource ↗
45b6d86b395867Buildingsource ↗
47b4346358ea20Animalsource ↗
48c79a6c1cc357Artistsource ↗
499c659a0f5182Plantsource ↗
49e3bd456b1466Companysource ↗
4c33b62cc48254Filmsource ↗
4daa4d1813f166NaturalPlacesource ↗
50f09117a7ed85Artistsource ↗
5e3abfe4844836MeanOfTransportationsource ↗
5f92c86fda0539Villagesource ↗
6080ed7c560a32Companysource ↗
6d423546f78136OfficeHoldersource ↗
712e5e8e710870NaturalPlacesource ↗
726a246737e454Villagesource ↗
95b59cc9fbbc70EducationalInstitutionsource ↗
97682568ca8637Companysource ↗
980decceae2765Buildingsource ↗
9caaf952013249Villagesource ↗
9e7ebe067f4e52WrittenWorksource ↗
a4bc16f0f9b954Albumsource ↗
ad160ba0023e64Albumsource ↗
b23116ed327626Athletesource ↗
b841fd47ab3345OfficeHoldersource ↗
bbed510bcde429MeanOfTransportationsource ↗
cc341509718d53Animalsource ↗
d09e9cf7570852EducationalInstitutionsource ↗
d71b5d944a5828Filmsource ↗
da19e3bbb42716Artistsource ↗
e4307c92bda470EducationalInstitutionsource ↗
e826c63100eb82OfficeHoldersource ↗
ed1139ca148737OfficeHoldersource ↗
f15e5d3ea87519Villagesource ↗
f96834776b6e59WrittenWorksource ↗
fe5097e1e4f658NaturalPlacesource ↗
ff3050b2902488Athletesource ↗
ffe3879bdb6c15Filmsource ↗

Each row is the profile evh dataset-items --dataset-id dbpedia_56 prints; inspect opens the item in the inspector with the dataset's largest group of comparable arms, and its text where the inspector runs on a machine that has it.

03reference sets

04labels

No labels yet. A sheet to fill: evh label-sheet --dataset-id dbpedia_56 --out sheet.csv; a run's outputs as a model set: evh label-from-run --run R --set S.