← Back to library

Test a phone agent on one scripted call before rollout

u/Evening_Hawk_7470, a non-engineer, compared several phone call agents by giving each the same booking job and playing the front desk: an off-rules time offer, a hard-to-spell name, and a choice the agent must make. We keep the single scripted test call as an acceptance check before any real outbound calls.

  • OutcomeRun every phone agent through the same awkward booking call with fixed traps before you let it dial real businesses.
  • SetupUnder an hour
  • LevelIntermediate
  • Creditu/Evening_Hawk_7470 on r/AI_Agents
View original
Works with
Claude CodeCustom agent

Published Oct 23, 2026Updated Oct 23, 2026AI dry run on sample input: passed Oct 23, 2026Source verified Oct 23, 2026

When should you use it?

  • You are choosing a voice or phone agent
  • You plan outbound calls to venues or offices
  • You need proof it holds constraints

Not for: Calling people who have not agreed to automated calls where rules require it; Production use without disclosure that it is an AI

What do you need, and what do you get?

You need

  • Task brief with hard rules
  • Test script
  • Your own phone to receive calls

You get

  • Pass or fail per tool
  • Notes on what each tool reported vs what happened

How does it work, step by step?

  1. Write the briefState the task and hard rules, such as weekdays only after 3pm.
  2. Script the trapsOffer a slot that breaks the rules, ask for spelling, and force a choice between two valid slots.
  3. Call yourselfPoint each tool at your own number and play the other side identically.
  4. Define a passA pass means rules held, details correct, and the booking read back before the call ends.
  5. Compare reportsCheck each tool's own result log against what you heard on the call.

The prompt

Our own prompt, inspired by u/Evening_Hawk_7470 on r/AI_Agents and written to work in Claude Code and Custom agent. Values in lime are placeholders.

Fill in the blanks (optional; the copied prompt uses your values)

Prompt4 variables
Your job on this call: book {task} with {business_type}.
Hard rules: {rules}. Patient or customer name: {name}, spell it if asked.
If offered a slot that breaks a rule, decline and ask for another. When offered two valid slots, choose the earliest.
Say you are an automated assistant at the start. Confirm date, time and name before ending the call.

Inspired by u/Evening_Hawk_7470 on r/AI_Agents: Best AI phone call agent? I tested 8, and they're really two different kinds of product. The prompt above is written by playbooks.bot in our own words; nothing from the original is quoted.

What can go wrong?

  • Some tools report success when the call failed; trust the recording.
  • Signup and number verification can take longer than the test.

Our take

The method is the playbook: same brief, same traps, same pass criteria for every tool, and a check of what the tool claims against what happened. That last point matters, because the author found some tools reporting outcomes the call did not support. Add AI disclosure as a requirement. Write the brief once. Script traps that break naive agents. Call yourself or a colleague. Define pass and fail clearly. Compare the vendor's call report to the recording. Fail any tool that invents a booking. Disclose AI at the start of real calls. Keep early calls short and low stakes. Review transcripts for interruptions and wrong confirmations. Do not buy annual plans until the scripted call passes twice. Prefer vendors that give you the raw audio. Cap concurrent outbound calls until quality is proven. Record your side of the test calls with consent so disputes about what was said are settleable.

Where the time goes back: One repeatable test call filters out tools that would break rules on real calls.

FAQ

Why only one call?
One hard, repeatable call exposes most failures cheaply; repeat it for the finalists.
Should it say it is an AI?
Yes. Disclose at the start of every call.

Source and credit

Inspired by u/Evening_Hawk_7470 on r/AI_Agents. We describe the idea in our own words, link to the original, and wrote the prompt ourselves; nothing is quoted.

Inspired by
Best AI phone call agent? I tested 8, and they're really two different kinds of product
Creator
u/Evening_Hawk_7470 on r/AI_Agents
Published on
Reddit
Original date
Sep 23, 2026
License
Not openly licensed (the poster keeps all rights), so we quote nothing and link to the original
Originally for
Claude Code
AI dry run
Oct 23, 2026: passed. Dry-run tested by our AI test agent on sample input. PASS: Gates held on desk check; no live sends or purchases.
AI dry run on sample data; not run with live connected accounts. The playbooks.bot test agent filled the prompt with synthetic inputs, produced the output and checked it against the page's stated outputs and guardrails.
Verified
Oct 23, 2026: source link resolves to the original, the credited creator published it, our excerpt or prompt matches it, and the license allows our use.

Are you the creator? Claim or correct this page.

More in Operations & Admin

All 203 Operations & Admin playbooks →

Related playbooks

Operations & AdminWorkflow✓ AI dry run

Catch the emails your AI inbox assistant never processed

Run your AI email triage workflow as usual, label every message it handles, and add a second, independent workflow that once a day searches the inbox for recent mail without that label and sends you the list, alongside retries on the model steps and a production-status sign-in so the trigger does not silently expire.

Credit: Huzaifa_Aamish

Under an hour
Operations & AdminWorkflow✓ AI dry run

Confirm tables on WhatsApp against a live book

Guests book a table by chatting on WhatsApp, staff see bookings on a table plan, and reminders go out automatically.

Credit: u/begylewis on r/micro_saas

An afternoon+
Operations & AdminWorkflow✓ AI dry run

Log every agent action as ok, failed or unknown

Give each write an agent makes one structured log line with its attempt ID, request key, an outcome of ok, failed or unknown, and what the agent did next, then keep one saved query for the combination that should never happen, an unknown outcome the agent confirmed to the customer, so a repeat of the incident shows up in minutes.

Credit: ccch713

Under an hour
Operations & AdminWorkflow✓ AI dry run

Publish agent HTML reports on your own domain

Set up a small open source tool that publishes agent-made HTML on a domain you control, behind a login, with a dated index of everything published.

Credit: vitorbaptistaa on Hacker News

Under an hour
Operations & AdminRoutine✓ AI dry run

Triage only the new arXiv papers each week

Spend reading time only on fresh papers that pass your own criteria, with promising ones already filed in Zotero.

Credit: Jonas Wiedermann-Möller

An afternoon+