eval-harness

Privacy

This site sets no cookies and has no forms.

Analytics

Page views and clicks on links are counted with a self-hosted instance of Umami. It sets no cookies and stores no personal data. Counts are aggregate: pages, referrers, countries, browsers and devices.

Cloudflare, which delivers this site, also measures visits and page speed with its Web Analytics. It sets no cookies either.

Server logs

The web server records requests (time, page, IP address, browser) to keep the site running and secure. That includes the catalog and its run inspector, which answer from the same server. Searchable logs are deleted after 30 days. Copies on the server are size-capped and overwritten as new requests come in. Logs are not shared.

The MCP server

When an agent calls a tool at https://evals.humancopilot.eu/mcp, the call is counted in the same Umami as an event: the tool's name, whether it answered, and how long it took. Umami is told the caller's IP address so it can count visitors and countries as it does for pages; it is not told the agent's own browser or client name, and never what the call asked for. The server's own log line for a call holds the tool, the names of its arguments, how it ended and its time: no address, no client name, no argument values. An error is reported to a self-hosted error tracker with the tool's name and where the code failed (no variables' values). The web server's request logs, above, cover these requests too.

Documentation

The documentation at /docs/ is served by this site's own server, so the server logs above cover it. A copy is also published on GitHub Pages (chipi.github.io/eval-harness), and GitHub keeps its own request logs for it under its privacy statement.

Your browser

The light/dark switch remembers your choice in your browser's local storage. It is not a cookie and is never sent anywhere.

Email

If you email me, I use your message only to reply.

Contact

marko@humancopilot.eu