NovaSynth by Noveum

NovaSynth is a testing product for voice and chat agents from Noveum, released on 17 September 2026. It generates synthetic users with goals, moods, accents and behaviours — a frustrated third-time caller about a refund, someone who talks over the agent and changes their mind mid-sentence, a caller who switches language, an attempt to make the agent reveal its system prompt — and puts them through the agent being tested. The calls are real telephony rather than mocked transcripts: it dials over SIP through Twilio, Plivo or Vobiz and over LiveKit real-time audio, and also supports Pipecat, LangChain and LangGraph, the OpenAI and Anthropic SDKs, and chat over HTTP. Personas and scenarios are generated from the agent's own context — its prompt, requirements and documentation — rather than hand-written, and can be run as a full persona-by-scenario matrix under one batch. During a run, reads against the agent's tools are replayed and writes are sandboxed, so a changed decision is exercised end to end without touching production systems. Every call is captured as a trace and scored, including the audio itself, against what Noveum describes as more than 30 voice metrics and more than 100 across its platform; concurrency can be raised to 2,000 lines for load testing. Noveum prices per organisation rather than per seat, on a shared credit system: Free at $0 with 2,500 credits a month, Pro at $69 a month, Growth at $99, Max at $199 and Scale at $599, with annual billing about 17% cheaper.