Guides
Chatbot testing guides
Practical, plain language guides for the people who own a customer-facing AI: how to test it, how to read the numbers, and what only a real person will notice. Use them with or without us.
How to Test a Chatbot With Real People
Scope, personas, scenarios, scoring and reading the results, step by step.
Read more about How to Test a Chatbot With Real People13 minute readHow to Test AI Agents Customers Talk To
Testing agents that take actions, across chat, voice and text.
Read more about How to Test AI Agents Customers Talk To12 minute readAI Agent Evaluation: Automated vs Human
Automated evals, simulations and human evaluation, explained for owners.
Read more about AI Agent Evaluation: Automated vs Human12 minute readLLM as a Judge vs Human Evaluation
What a model grading a model can and cannot tell you.
Read more about LLM as a Judge vs Human Evaluation12 minute readHow to Test a Voice Agent Before Go-Live
Real callers, accents, interruptions, noise and handoff.
Read more about How to Test a Voice Agent Before Go-Live10 minute readThe Chatbot Testing Checklist
A printable list of scenarios and personas for any chatbot.
Read more about The Chatbot Testing Checklist11 minute readChatbot KPIs and What They Miss
Containment, deflection, CSAT and the gaps between them.
Read more about Chatbot KPIs and What They Miss10 minute readWhat Is AI Drift? Why Good Agents Slip
Why a working agent changes after model updates, and how to catch it.
Read more about What Is AI Drift? Why Good Agents Slip13 minute readChatbot Failures: Real Cases and Lessons
Documented public failures and the human test that catches each.
Read more about Chatbot Failures: Real Cases and LessonsSee your AI the way your customers do
Tell us what your AI does and what worries you. We build a panel of real people around it and hand you every transcript, a score per criterion and a plain verdict. We never sell the fix.