eval-harness

model

facebook-bart-large-cnn ml

A model record: onboarded once for the project and used by any eval's arms.

weights
open
licence
MIT
aliases
facebook/bart-large-cnn
settings
defaults
onboarding
not onboarded: evh model-onboard
best result per goal
#1 of 29 Short news summaries (CNN)
#27 of 33 A scorer that agrees with experts on summaries (SummEval)

Every model

01deployments and their onboarding

No deployment is recorded for this model. Not onboarded yet: evh model-onboard facebook-bart-large-cnn.

02settings history

No change of settings or build is recorded.

03arms

armdeploymentgoalits settingsarm smokeresult
cnn_bart_l_n200_v1 · judged/judge-summ-pick-v1
cnn_dailymail_200
———nonejudge_won 0.000
cnn_bart_l_n200_v1 · judged/judge-summ-pointwise-v1
cnn_dailymail_200
———nonejudge_score_unvalidated 4.181
cnn_bart_l_n200_v1 · judged/judge-summ-v1
cnn_dailymail_200
———nonejudge_score 3.868
cnn_bart_l_n200_v1 · judged/judge-summ-v2
cnn_dailymail_200
———nonejudge_score 3.821
cnn_bart_l_n200_v1 · linux
cnn_dailymail_200
—Short news summaries (CNN)—nonecoverage 0.346
cnn_bart_l_n200_v1 · silver
cnn_dailymail_200
———nonecoverage 0.317
cnn_bart_l_v1
cnn_dailymail_20
———nonecoverage 0.366
cnn_bart_l_n200_v1
cnn_dailymail_200
—Short news summaries (CNN)—nonecoverage 0.346
cnn_bart_l_dm200_v1
cnn_dailymail_dm200
———nonecoverage 0.443
se_bartscore_n100_v1
summeval_100
—A scorer that agrees with experts on summaries (SummEval)—nonetau 0.256