eval-harness

model

eval-qwen-3max llm

A model record: onboarded once for the project and used by any eval's arms.

weights
proprietary
aliases
eval-qwen-3max
settings
defaults
onboarding
not onboarded: evh model-onboard
best result per goal
#10 of 28 Named-entity extraction (Few-NERD)
#15 of 30 News topic classification (AG News)
#19 of 28 Encyclopedia topic classification (DBpedia)
#23 of 29 Short news summaries (CNN)

Every model

01deployments and their onboarding

No deployment is recorded for this model. Not onboarded yet: evh model-onboard eval-qwen-3max.

02settings history

No change of settings or build is recorded.

03arms

armdeploymentgoalits settingsarm smokeresult
ag_qwen_l_n200_v1 · adjudicated
ag_news_200
——max_tokens 200, temperature 0.0nonecorrect 0.955
cnn_qwen_l_n200_v1 · judged/judge-summ-pick-v1
cnn_dailymail_200
——max_tokens 1200, temperature 0.0nonejudge_won 0.059
cnn_qwen_l_n200_v1 · judged/judge-summ-v1
cnn_dailymail_200
——max_tokens 1200, temperature 0.0nonejudge_score 4.812
cnn_qwen_l_n200_v1 · judged/judge-summ-v2
cnn_dailymail_200
——max_tokens 1200, temperature 0.0nonejudge_score 4.573
cnn_qwen_l_n200_v1 · silver
cnn_dailymail_200
——max_tokens 1200, temperature 0.0nonecoverage 0.398
ag_qwen_l_n200_v1
ag_news_200
—News topic classification (AG News)max_tokens 200, temperature 0.0nonecorrect 0.870
cnn_qwen_l_n200_v1
cnn_dailymail_200
—Short news summaries (CNN)max_tokens 1200, temperature 0.0nonecoverage 0.311
db_qwen_l_n200_v1
dbpedia_280
—Encyclopedia topic classification (DBpedia)max_tokens 200, temperature 0.0nonecorrect 0.968
fn_qwen_l_n200_v1
few_nerd_280
—Named-entity extraction (Few-NERD)max_tokens 600, temperature 0.0nonef1 0.624