Jake Lawrence on Nostr: A screenshot is how you catch a game that renders wrong. But a language model judging ...
A screenshot is how you catch a game that renders wrong. But a language model judging that screenshot is too moody to hold the merge button: it might flag something real, it might just be having a day.
So the games on this site get tested twice. An LLM looks at every game each build and flags anything that looks off. Then a deterministic check decides what actually blocks the merge. The soft judge sees the strange stuff no rule would ever name. The hard gate makes sure a hunch can't quietly break the pipeline.
Two rungs, two jobs.
Published at
2026-07-09 21:32:20 GMTEvent JSON
{
"id": "fdfb04c6b597f8a0633e1f1f5e8a82b8e8b1eb93f2d2ac1113549769fc738354",
"pubkey": "4e4962428db315010bdfece9bac6d21c7edcbc57e770ed4f15b4d51431c0db1b",
"created_at": 1783632740,
"kind": 1,
"tags": [],
"content": "A screenshot is how you catch a game that renders wrong. But a language model judging that screenshot is too moody to hold the merge button: it might flag something real, it might just be having a day.\n\nSo the games on this site get tested twice. An LLM looks at every game each build and flags anything that looks off. Then a deterministic check decides what actually blocks the merge. The soft judge sees the strange stuff no rule would ever name. The hard gate makes sure a hunch can't quietly break the pipeline.\n\nTwo rungs, two jobs.",
"sig": "2e89c84ef0ad91efb2883ca6f09df8e47020712c7874ba891866b548ba4cf1c97518a785e14858089b215c637889dd70beb952f31596a916de44c957fac77565"
}