arm

db_bert_base_fy_n200_v1 baseline

One config on dbpedia_280, scored one way; its repeats averaged per item.

dataset: dbpedia_280
scored against: gold/dbpedia_280 gold
goal: Encyclopedia topic classification (DBpedia)
runs: 1
headline: correct 0.986
last run: 2026-09-30 09:10

Inspect it With the 29 arms scored the same way

01metrics

metric	mean	items	better
correct	0.986	280	higher
answer_words	1.000	280	neutral
confidence	0.997	280	neutral
correct_after_repair	0.000	280	neutral
cost_usd	$0.000000	280	lower
fmt_markdown	0.000	280	neutral
fmt_verbose	0.000	280	neutral
latency_ms	86.7	280	lower
parsed	1.000	280	higher

02cost and speed

cost per item: $0.000000
speed per item: p50 75 · p95 119 ms

Per item, over its items: cost as dollars and tokens (a local model is free but still uses tokens), speed as the median and the slow tail (p95). A goal that names this arm weighs them in its decision.

03runs

run	made	items	cost	how
`db_bert_base_fy_n200_v1_20260930T091006Z`	2026-09-30 09:10	280	$0.000000	measured

04config

config db_bert_base_fy_n200_v1 · adapter examples/classification-dbpedia-14/adapter.py · credentials are never shown

device: cpu
family: bert
label_order: ["Company", "EducationalInstitution", "Artist", "Athlete", "OfficeHolder", "MeanOfTransportation", "Building", "NaturalPlace", "Village", "Animal", "Plant", "Album", "Film", "WrittenWork"]
model: fabriceyhc/bert-base-uncased-dbpedia_14
precision: fp32
price_tier: free
provider: hf_local

05deploy sheet

measured by: db_bert_base_fy_n200_v1_20260930T091006Z on dbpedia_280
against: gold/dbpedia_280
model sent: fabriceyhc/bert-base-uncased-dbpedia_14
model record: fabriceyhc-bert-base-uncased-dbpedia_14
server: not recorded
build: none recorded (a hosted model has no digest)
settings sent: device: cpu
label_order: ["Company", "EducationalInstitution", "Artist", "Athlete", "OfficeHolder", "MeanOfTransportation", "Building", "NaturalPlace", "Village", "Animal", "Plant", "Album", "Film", "WrittenWork"]
model: fabriceyhc/bert-base-uncased-dbpedia_14
precision: fp32
provider: hf_local
not sent: bookkeeping: family, price_tier
declared: deployment.encoder_window: 512
deployment.label_order: ['Company', 'EducationalInstitution', 'Artist', 'Athlete', 'OfficeHolder', 'MeanOfTransportation', 'Building', 'NaturalPlace', 'Village', 'Animal', 'Plant', 'Album', 'Film', 'WrittenWork']
deployment.labels: ['Company', 'EducationalInstitution', 'Artist', 'Athlete', 'OfficeHolder', 'MeanOfTransportation', 'Building', 'NaturalPlace', 'Village', 'Animal', 'Plant', 'Album', 'Film', 'WrittenWork']
deployment.labels_sha256: d3a33437c1e2b2fe45fdb7a425b14796d89d31a0d8919d899149e27f5c6f899d
deployment.parser_sha256: 4ad032219af088a127d97f358471c648a50d9665e3b32cd2f3e2f2dca7d8ded2
deployment.provider: hf_local
adapter: examples/classification-dbpedia-14/adapter.py 58b55c964f8b
harness: 4068ea23007d

No capture here says what production ran (the adapter's production_ran).

Command: evh deploy-sheet --config db_bert_base_fy_n200_v1 [--capture C]

06conditions

data.items_sha256: a7419dc6a5876490c3ed1f96eae9398969a2f8b794e744d45ace5790bc0146f2
deployment.device: cpu
deployment.model: fabriceyhc/bert-base-uncased-dbpedia_14
deployment.quantization: fp32
deployment.source: adapter
fingerprint.version: 5
library.numpy: 1.26.4
library.openai: 3.19.2
library.torch: 2.14.0
library.transformers: 4.55.4
machine.cpu_count: 4
machine.platform: Linux/x86_64
machine.processor: x86_64
machine.python: 3.11.15
machine.release: 6.18.44-fc-v50
reference.sha256: e0564fe65fb011e37717e037a6ad662f44e796b7d7de8e62ed2344ba56fa7a8a
scorer.id: examples/classification-dbpedia-14/adapter.py
scorer.sha256: 58b55c964f8bb40746c359621beb25bfd0a071fca079961bdf15be1e7c0a77a8

07the same config, scored other ways

scored against silverscored by a judgewrote the reference it is scored againstscored against a label set, not a reference setunmarked rows are scored against gold

arm	scored against	headline	mean
db_bert_base_fy_n200_v1 · linux	gold/dbpedia_280 gold	correct	0.986

08rounds

Round r1 of Encyclopedia topic classification (DBpedia), closed: one of its arms.