When should you use it?
- You use AI to rewrite or polish academic text
- Your paper cites many sources
- You asked for scholarly sources only
Not for: Fiction or opinion writing; Drafts you have not cited yet
What do you need, and what do you get?
You need
- Original draft
- AI-edited draft
- Your reference list or source files
You get
- Before and after citation table
- List of removed, added or changed citations
- Claims that need rechecking
How does it work, step by step?
- Keep the originalSave your draft before any AI edit.
- List citations twiceExtract every citation from both versions.
- CompareFlag citations that disappeared, appeared or moved to a different claim.
- Verify new sourcesLook up any new source yourself to confirm it exists and says what is claimed.
- Check the sentenceRead each cited sentence against the source page.
The prompt
Our own prompt, inspired by u/ringringpssy on r/ChatGPT and written to work in ChatGPT and Claude. Values in lime are placeholders.
Fill in the blanks (optional; the copied prompt uses your values)
Here are two versions of my paper: original {original} and edited {edited}. List every citation in each version. Show a table of citations removed, added, or attached to a different sentence. For each added citation, say whether it appears in my reference list. Do not invent or suggest new sources.
Inspired by u/ringringpssy on r/ChatGPT: ChatGPT as research/academic assistant - my experience. The prompt above is written by playbooks.bot in our own words; nothing from the original is quoted.
What can go wrong?
- Invented sources can look real; search the title and DOI.
- Encyclopedia pages may not meet your course's rules.
- A model can misread a comparison; check it against both documents yourself.
Our take
The poster's experience points to a specific, checkable failure: polished rewrites that silently lose or fabricate citations. That makes the defense mechanical rather than a matter of trusting one model over another. Before any AI edit, save the draft and extract its reference list and every in-text citation marker. After the edit, extract them again and compare; anything removed needs a reason, and anything added needs to be looked up in the library database, not just on the web. For sentences that carry a citation, reread the cited passage, because models often keep the marker while changing the claim. The document comparison that went wrong is a good example of a task to split: have the model list each demand and quote the matching clause of the law side by side, then judge the match yourself. Telling the model to leave citation markers untouched helps but is not a guarantee. The model rankings in the post will change within months; the before-and-after audit will stay useful, and the saved versions protect you if a grader questions a source.
Where the time goes back: A citation diff takes minutes and catches the errors that cost marks.
FAQ
Which model should I use?
Can AI do the audit?
Source and credit
Inspired by u/ringringpssy on r/ChatGPT. We describe the idea in our own words, link to the original, and wrote the prompt ourselves; nothing is quoted.
- Inspired by
- ChatGPT as research/academic assistant - my experience
- Creator
- u/ringringpssy on r/ChatGPT
- Published on
- Original date
- Jun 17, 2026
- License
- Not openly licensed (the poster keeps all rights), so we quote nothing and link to the original
- Originally for
- Claude
- AI dry run
- Oct 23, 2026: passed. Dry-run tested by our AI test agent on sample input. PASS: Gates held on desk check; no live sends, bookings or purchases.
AI dry run on sample data; not run with live connected accounts. The playbooks.bot test agent filled the prompt with synthetic inputs, produced the output and checked it against the page's stated outputs and guardrails. - Verified
- Oct 23, 2026: source link resolves to the original, the credited creator published it, our excerpt or prompt matches it, and the license allows our use.
Are you the creator? Claim or correct this page.