eval-harness

model

eval-glm-45-air llm

A model record: onboarded once for the project and used by any eval's arms.

weights
open
licence
MIT
aliases
eval-glm-45-air
settings
defaults
onboarding
not onboarded: evh model-onboard
best result per goal
#1 of 19 Evidence retrieval for scientific claims (SciFact)
#19 of 33 A scorer that agrees with experts on summaries (SummEval)
#19 of 29 Short news summaries (CNN)
#22 of 30 News topic classification (AG News)
#23 of 28 Named-entity extraction (Few-NERD)
#25 of 28 Encyclopedia topic classification (DBpedia)

Every model

01deployments and their onboarding

No deployment is recorded for this model. Not onboarded yet: evh model-onboard eval-glm-45-air.

02settings history

No change of settings or build is recorded.

03arms

armdeploymentgoalits settingsarm smokeresult
ag_glm_s_n200_v1 · adjudicated
ag_news_200
——max_tokens 200, temperature 0.0nonecorrect 0.935
cnn_glm_s_n200_v1 · judged/judge-summ-pick-v1
cnn_dailymail_200
——max_tokens 1200, temperature 0.0nonejudge_won 0.001
cnn_glm_s_n200_v1 · judged/judge-summ-v1
cnn_dailymail_200
——max_tokens 1200, temperature 0.0nonejudge_score 4.530
cnn_glm_s_n200_v1 · judged/judge-summ-v2
cnn_dailymail_200
——max_tokens 1200, temperature 0.0nonejudge_score 4.420
sf_glm_s_bm25first_n200_v1 · pair
scifact_200
—Evidence retrieval for scientific claims (SciFact)max_tokens 700, temperature 0.0nonendcg_10 0.742
sf_glm_s_e5first_n200_v1 · pair
scifact_200
—Evidence retrieval for scientific claims (SciFact)max_tokens 700, temperature 0.0nonendcg_10 0.789
cnn_glm_s_n200_v1 · silver
cnn_dailymail_200
——max_tokens 1200, temperature 0.0nonecoverage 0.303
ag_glm_s_n200_v1
ag_news_200
—News topic classification (AG News)max_tokens 200, temperature 0.0nonecorrect 0.850
cnn_glm_s_n200_v1
cnn_dailymail_200
—Short news summaries (CNN)max_tokens 1200, temperature 0.0nonecoverage 0.314
db_glm_s_n200_v1
dbpedia_280
—Encyclopedia topic classification (DBpedia)max_tokens 200, temperature 0.0nonecorrect 0.939
fn_glm_s_n200_v1
few_nerd_280
—Named-entity extraction (Few-NERD)max_tokens 600, temperature 0.0nonef1 0.553
sf_glm_s_n200_v1
scifact_200
—Evidence retrieval for scientific claims (SciFact)max_tokens 700, temperature 0.0nonendcg_10 0.744
se_glm_s_n100_v1
summeval_100
—A scorer that agrees with experts on summaries (SummEval)max_tokens 1500, temperature 0.0nonetau 0.446