LangWatch Scenario: voice agent testing demo

Learn how Scenario tests voice agents with caller personas and audio noise, then inspect a passing refund call and a failed password reset.

Player not loading? Watch on YouTube

LangWatch demonstrates Scenario, its voice-agent testing feature, against a customer support agent. A simulated caller tests a duplicate-charge complaint with an angry persona, coffee-shop noise and medium phone quality. The expected behavior is to acknowledge the problem and begin investigating; a judge marks the recorded call as passing after the agent asks for account details.

A second test fails. The agent correctly asks for identity verification before resetting a password, but the presenter says it does not complete the reset after the caller eventually provides the required information. LangWatch shows recordings and verdicts for review. The presenter says ten calls ran in a couple of minutes and that Scenario supports several voice-agent providers. The video does not demonstrate local deployment or offline operation.