coverage

01what it measures, and how

ROUGE-Lsum recall with the summary cut to the reference's length: did it carry the story.

The summary is clipped to as many words as the gold summary has, then scored for ROUGE-Lsum recall against it (sentences split here, stemming on). Writing more cannot buy coverage; only putting the important facts first can. Read beside concision, which rewards the opposite.

02on cnn_dailymail_20

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

03on cnn_dailymail_200

Not drawn: cnn_anthropic_l_n200_v1 · silver, scored against the reference it wrote (its row is in the table).

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

04on cnn_dailymail_dm200

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold