@potatoannotator.bsky.social

@potatoannotator.bsky.social

20 Followers 12 Following

Judge evaluation cards reporting an LLM judge's verbosity bias, position-swap consistency, and Expected Calibration Error against human labels.
A clickable multi-agent interaction graph — agents as nodes and handoffs as directed edges — with the critical path marked and a problematic handoff flagged.
Think-Aloud review page showing a verbatim spoken-rationale transcript with a detected "voice label: Impolite" badge and per-session hesitation stats.
Boundary Lab probe reading "You said Polite. Would that survive this minimal edit?" over a colored text diff, with buttons: Still Polite, Label flips, Can't tell.
Potato's psychometrics dashboard showing an "annotator ability" bar chart with confidence-interval whiskers — one strong annotator well above the line and a weak one near zero.