eval-harness

model

Llama 3.1 8B llm

A model record: onboarded once for the project and used by any eval's arms.

weights
open
licence
LLAMA 3.1 COMMUNITY LICENSE AGREEMENT
aliases
llama3.1:8b
settings
defaults
onboarding
onboarded, no arm smoked 2026-10-31
best result per goal
#2 of 55 Triage decisions on Orrery's error signals

Every model

01deployments and their onboarding

x3 · x3 · ollama 0.40.13 · llama3.1:8b · onboarding pass 2026-10-31 · 39.8 tokens/s
where
x3
server or device
ollama 0.40.13
build
llama3.1:8b
46e0c10c039e019119339687c3c1757cc81b9da49709a3b3924863ba87ca666e
Q4_K_M
matches the record
yes
checked
2026-10-31
onboarded on
x3
probemeasurementflag
endpointprovider openai · base url http://127.0.0.1:11434/v1 · model llama3.1:8b—
digest found46e0c10c039e019119339687c3c1757cc81b9da49709a3b3924863ba87ca666e—
defaults 4.67 · tokens out 19 · reasoned: no · finish stop—
chosens 0.48 · tokens out 19 · reasoned: no · finish stop · settings ()—
tokens per s39.8—
deterministicyes—
json validyes—
dgx · dgx · ollama 0.40.13 · llama3.1:8b · onboarding pass 2026-10-31 · 41.5 tokens/s
where
dgx
server or device
ollama 0.40.13
build
llama3.1:8b
46e0c10c039e019119339687c3c1757cc81b9da49709a3b3924863ba87ca666e
matches the record
yes
checked
2026-10-31
onboarded on
dgx
probemeasurementflag
endpointprovider openai · base url http://100.69.49.126:11434/v1 · model llama3.1:8b—
digest found46e0c10c039e019119339687c3c1757cc81b9da49709a3b3924863ba87ca666e—
defaults 4.68 · tokens out 22 · reasoned: no · finish stop—
chosens 0.53 · tokens out 22 · reasoned: no · finish stop · settings ()—
tokens per s41.5—
deterministicyes—
json validyes—
mac · mac · ollama 0.40.13 · llama3.1:8b · onboarding pass 2026-10-31 · 34.5 tokens/s
where
mac
server or device
ollama 0.40.13
build
llama3.1:8b
46e0c10c039e019119339687c3c1757cc81b9da49709a3b3924863ba87ca666e
Q4_K_M
matches the record
yes
checked
2026-10-31
onboarded on
mac
probemeasurementflag
endpointprovider openai · base url http://127.0.0.1:11435/v1 · model llama3.1:8b—
digest found46e0c10c039e019119339687c3c1757cc81b9da49709a3b3924863ba87ca666e—
defaults 5.01 · tokens out 19 · reasoned: no · finish stop—
chosens 0.55 · tokens out 19 · reasoned: no · finish stop · settings ()—
tokens per s34.5—
deterministicyes—
json validyes—

What it can do, across its deployments: reasons: no · json mode: yes

02settings history

No change of settings or build is recorded.