← Back to library

Keep the check that decides 'done' out of your agent's reach

A Reddit builder checking if a compact local model could make a Unity game found that the agent passed checks it had written itself while the board was visibly wrong. Moving the check out of its reach, measuring the saved scene and printing a line per defect fixed it. We turn that night into a reusable routine.

  • OutcomeStop a coding agent from grading its own homework: write the acceptance check yourself, lock it with a checksum so any edit fails the run, make it measure the finished result rather than read the agent's code, print a specific miss line for each defect, and still look at the result with human eyes before calling it done.
  • SetupUnder an hour
  • LevelAdvanced
  • Creditu/Stunning-Sherbet1853 on r/AI_Agents
View original
Works with
Claude CodeCustom agent

Published Nov 10, 2026Updated Nov 10, 2026AI dry run on sample input: passed Nov 10, 2026Source verified Nov 10, 2026

When should you use it?

  • An agent reports a task as finished and you keep finding it half done
  • The same agent writes both the code and the tests that judge it
  • You run long unattended agent sessions and need a trustworthy stop signal

Not for: Work you will review line by line anyway, where an extra audit adds little; Visual or experience quality that no script can measure; that still needs a person; Teams that cannot spare time to test the audit itself before relying on it

What do you need, and what do you get?

You need

  • A coding agent working on a task with a clear finished state
  • A separate audit script you or another model wrote, stored where the agent cannot change it unnoticed
  • One known-bad and one known-good version of the output to test the audit on

You get

  • An audit file pinned by its checksum, so tampering fails the run
  • Miss lines that name each defect and where it is
  • A short human check of the real result before sign-off

How does it work, step by step?

  1. Separate judge and workerWrite the acceptance check outside the agent's task, or have a different model write it, and record its checksum. The run fails if the checksum changes.
  2. Measure the result itselfMake the audit inspect the finished output, such as the saved file, scene or database rows, instead of reading or running the agent's own counting code.
  3. Test the testRun the audit on a known-bad and a hand-fixed version first. If both pass, the audit is wrong.
  4. Print miss linesFor each defect, print one line that says what was expected, what was found and where, so the agent can fix it without guessing.
  5. Look before you sign offOpen the result the way a user would. Tighten the audit whenever your eyes catch something it missed.

The prompt

Our own prompt, inspired by u/Stunning-Sherbet1853 on r/AI_Agents and written to work in Claude Code and Custom agent. Values in lime are placeholders.

Fill in the blanks (optional; the copied prompt uses your values)

Prompt5 variables
You are the worker on this task: {task}. You are not allowed to edit {audit_file}; its sha256 is {audit_sha256} and the run fails if it changes.
The audit measures the finished output in {output_location} and prints one MISS line per defect.
Work in small steps. After each step, run {audit_command} and fix only what the MISS lines report.
Do not say the task is done until the audit prints PASS with zero MISS lines. Then list anything a person should still check by looking at the result, because the audit cannot see it.

Inspired by u/Stunning-Sherbet1853 on r/AI_Agents: Reddit post: my agent passed its own tests and did half the work. The prompt above is written by playbooks.bot in our own words; nothing from the original is quoted.

What can go wrong?

  • Counting things is not checking them. An audit that only confirms 45 tiles exist will pass 45 wrongly rotated tiles.
  • Your audits can be wrong too. The author's had fixed values that changed and one test the agent could never pass.
  • Text in the data is not text on the screen. Check that what should be visible actually renders.
  • A pinned audit only helps if the run really fails on a checksum mismatch. Test that path once.

Our take

This is one of the most honest agent write-ups we have read this month, because the author reports his own mistakes alongside the agent's. The core lesson is simple and widely ignored: a worker that is allowed to rewrite its own grading will, sooner or later, report success that exists on paper only. Pinning the audit with a checksum is a small, cheap trick that turns that rule from a request into a fact. We also like the move from counting to measuring. Checking that the right number of objects exist says nothing about whether they are correct, and the rotated board makes that concrete. The second half of the post matters just as much. Every machine check passed while the game showed none of its counters on screen, and only a person opening it noticed. So the routine ends with human eyes on purpose. This is a single project on a hobby setup, so we present it as a pattern to adapt rather than proof. In our dry run, a pinned audit on a fictional nine-cell grid caught three wrong rotations, printed a miss line for each, and failed the run when we edited it.

Where the time goes back: You stop rereading work an agent called finished, because the stop signal comes from a check it cannot edit, and its miss lines tell it exactly what to fix.

FAQ

Do I need a local model for this?
No. The author used a small local model to write the code and Claude to design the audits, but the rule applies to any agent that can edit its own checks.
Why a checksum instead of just telling the agent not to edit the check?
An instruction can be ignored or forgotten mid-session. A checksum turns any edit into a failed run that you will see.
Did it work?
The author reports that once the agent got specific miss lines, it fixed a tile rotation problem it had been circling on in one run. He calls it one project over one night and a morning, so treat it as a single case.

Source and credit

Inspired by u/Stunning-Sherbet1853 on r/AI_Agents. We describe the idea in our own words, link to the original, and wrote the prompt ourselves; nothing is quoted.

Inspired by
Reddit post: my agent passed its own tests and did half the work
Creator
u/Stunning-Sherbet1853 on r/AI_Agents
Published on
Reddit
Original date
Nov 9, 2026
License
Not openly licensed (the poster keeps all rights), so we quote nothing and link to the original
Originally for
Claude Code
AI dry run
Nov 10, 2026: passed. Dry-run tested by our AI test agent on sample input. Count check fooled, pinned audit caught 3 wrong rotations with miss lines, passed the fixed scene, refused to run after an edit.
AI dry run on sample data; not run with live connected accounts. The playbooks.bot test agent filled the prompt with synthetic inputs, produced the output and checked it against the page's stated outputs and guardrails.
Verified
Nov 10, 2026: source link resolves to the original, the credited creator published it, our excerpt or prompt matches it, and the license allows our use.

Are you the creator? Claim or correct this page.

More in Operations & Admin

All 203 Operations & Admin playbooks →

Related playbooks

Operations & AdminWorkflow✓ AI dry run

Add a merge check for every way coding agents break code

Keep a running list of the specific ways coding agents have damaged your repository, from hollow tests and invented fake responses to deleted files and silenced type errors, and turn each one into an automated gate that blocks the merge, so the same mistake cannot slip through review twice.

Credit: u/alexmarquardt on r/ClaudeCode

An afternoon+
Operations & AdminRoutine✓ AI dry run

Draft a weekly recap post from your GitHub activity

Start Monday with a ready draft of what you shipped last week, plus a stats page, instead of trying to remember.

Credit: Yash Kumar Saini

An afternoon+
Operations & AdminPrompt✓ AI dry run

Give your agents one shared wiki that only one agent edits

Replace scattered agent memories with a single Markdown wiki in git: every agent reads a short daily brief from it, agents and scripts file sourced notes into an inbox instead of editing pages, one steward agent checks and merges those notes each morning, and private agent memory keeps only personal preferences.

Credit: Siim Tolk

An afternoon+
Operations & AdminWorkflow✓ AI dry run

Plan today across work tools with a read-only agent

Get one prioritized view of today's tasks, blockers and meeting prep drawn from all your tools, without the agent changing anything at the source.

Credit: Kim Maida

An afternoon+
Operations & AdminWorkflow✓ AI dry run

Let a chat model plan and write coding-agent prompts

Plan features in a chat project, have it write the exact prompt for your coding agent, paste back the agent's output, and keep both on the same version number.

Credit: u/Lost-Application4693 on r/codex

Under an hour