Tools · Governance · 29 of 37

Rating canvas

1–5 scores. Mean and disagreement.

Need

What this desk is for.

The author grading the agent they wrote.

How

What runs in this tab.

1–5 scores. Mean and disagreement.

Role analog: AI Trainer and Evaluator · 2026 US year-1 replacement $181,300 (market, not payroll). Kernel runs here. This tab stays local. Not zg, not SignalR, not Copilot, not tiktoken.

Desks that sit this analog: AI Trainer and Evaluator. Unique pain, not a shared slogan.

Output A score 1–5Output B score 1–5

3.0Mean

2Disagreement

splitPair

Second annotator: open this page in another tab. Channel engos.tools.eval.

Talk Route in the workspace Save to a workspace All 37 tools

Governance cluster

Same cluster. Nothing deleted.

Governance

Injection heuristic

Named pattern hits. Heuristic, not a firewall, not a CVE feed.

Governance

Term distance mapper

Pairwise cosine on hash-ngram vectors. Not a bias certification.

Governance

Redact

IPv4, email, keys, bearer. String never leaves this tab.

Rating canvas

What this desk is for.

What runs in this tab.

Same cluster. Nothing deleted.

Injection heuristic

Term distance mapper

Redact

EngOS