eval-harness

model

Nemotron 3.5 Super 120B llm

A model record: onboarded once for the project and used by any eval's arms.

weights
open
licence
OpenMDW License Agreement, version 1.1 (OpenMDW-1.1)
aliases
nemotron-3.5-super:120b
settings
reasoning_effort none it reasoned by default on the onboarding probe (2026-10-31); off unless a task needs it (RUNBOOK §16): left at the server's default, one model reasons at length and the next not at all
onboarding
not onboarded: evh model-onboard
best result per goal
#22 of 55 Triage decisions on Orrery's error signals

Every model

01deployments and their onboarding

x3 · x3 · ollama 0.40.13 · nemotron-3.5-super:120b · not onboarded
where
x3
server or device
ollama 0.40.13
build
nemotron-3.5-super:120b
8a58f3e6008244525e5d6e2df9fb0485e4dde9a88da61c25953818cf8c051f6d
Q4_K_M
matches the record
yes

Not onboarded yet: evh model-onboard nemotron-3.5-super-120b --deployment x3.

dgx · dgx · ollama 0.40.13 · nemotron-3.5-super:120b · onboarding pass 2026-10-31 · 29.8 tokens/s
where
dgx
server or device
ollama 0.40.13
build
nemotron-3.5-super:120b
8a58f3e6008244525e5d6e2df9fb0485e4dde9a88da61c25953818cf8c051f6d
matches the record
yes
checked
2026-10-31
onboarded on
dgx
probemeasurementflag
endpointprovider openai · base url http://100.69.49.126:11434/v1 · model nemotron-3.5-super:120b—
digest found8a58f3e6008244525e5d6e2df9fb0485e4dde9a88da61c25953818cf8c051f6d—
defaults 17.54 · tokens out 100 · reasoned: yes · finish stop—
chosens 0.84 · tokens out 25 · reasoned: no · finish stop · settings (reasoning effort none)—
tokens per s29.8—
deterministicyes—
json validyes—

What it can do, across its deployments: reasons: yes · json mode: yes · reasoning off reasoning_effort: none

02settings history

whenwhat changedwhy
2026-10-31reasoning_effort: (server default) → noneit reasoned by default on the onboarding probe (2026-10-31); off unless a task needs it (RUNBOOK §16): left at the server's default, one model reasons at length and the next not at all

03arms

armdeploymentgoalits settingsarm smokeresult
triage_local_dgx_nemotron_35_super_120b_v1 · rescored 5f2c057c
orrery_triage_v1_labelled
dgxTriage decisions on Orrery's error signalscall_timeout_s 600nonetriage_cost 0.677
triage_local_dgx_nemotron_35_super_120b_v2 · rescored 5f2c057c
orrery_triage_v1_labelled
dgxTriage decisions on Orrery's error signalsmax_tokens 1024, call_timeout_s 600pass 2026-10-31triage_cost 0.677