The Floor
What got corrected today
Licensed humans judging AI answers, in public, with a signature. Every card shows the before and the after.
No published case yet — the registry is onboarding its first licensed reviewers. The cards marked sample are the registry's own worked examples: they show what a case looks like and are never counted in any number.
Code · sample7 min · $11.2 · 3 d ago
Asked
Is localStorage OK for our login token?
AI said
No. Any script on the page can read localStorage. Keep the token in an httpOnly cookie instead.
Expert signed
Confirmed: move the token to an httpOnly, Secure, SameSite cookie — and add CSRF protection the same day.
✓ Confirmed, with one additionGitHub verified · verified by the registry · L2
Watch the replayHow a case gets here
1Someone asks — on
Start, or from inside ChatGPT, Claude or Cursor through the registry's MCP server.
2A licensed human reads it first. The first move is usually a question, not an answer; then the AI answers are judged blind (A/B/C, model names hidden).
3The human signs a four-field letter. The customer pays once; the signature can be verified by anyone.
4Both agree to publish, names and numbers are masked, and the case lands here. Either side can take it down in one tap.
Nothing on this page is advice for you — your numbers differ. Start with your own question, or plug in your card if you are the expert.