metric
answer_words
- better
- neutral: a description
- kind
- descriptive: says what the output was, never whether it was good
- decides
- no goal
- weighed by
- no goal
- recorded on
- ag_news_200, dbpedia_280
01what it measures, and how
How many whitespace-separated words the reply had: a description, not a quality.
A project explains its own metric at length with METRIC_DESCRIPTIONS = {"answer_words": {"summary": "…", "details": "…"}}.
02on ag_news_200
scored against silverscored by a judgescored against a label set, not a reference setunmarked rows are scored against gold
03on dbpedia_280
scored against silverscored by a judgescored against a label set, not a reference setunmarked rows are scored against gold