Vocode
A Python voice AI agent library under the MIT license, with self-hosted telephony, OpenAI and Anthropic integrations, and local speech options.
Vocode is an open source Python library for developers building voice AI agents, with a self-hosted telephony server and support for live conversations through a computer's microphone and speakers. It connects speech recognition, an LLM, and speech synthesis in one library. The code uses the MIT license.
Its modular design lets you choose speech providers separately from the language model. That matters if you want to use local speech components for one application and cloud services for another, or compare voices without replacing the rest of your application.
Vocode supports inbound calls to an AI agent and outbound calls managed by an agent. Agents can also dial into Zoom meetings, and a LangChain agent can place an outbound call to a real phone number. Beyond telephony, the library can serve as the voice layer for a personal assistant or an interactive application such as voice-controlled chess. A React SDK is also available.
Speech recognition integrations include Whisper and Whisper.cpp alongside cloud services such as Deepgram, AssemblyAI, Google Cloud, and Microsoft Azure. For generated speech, it supports Coqui and Bark as well as Eleven Labs, Cartesia, AWS Polly, and other providers. Its listed LLM integrations are OpenAI and Anthropic.
Self-hosting the telephony server doesn't make every part of the conversation local. When you choose cloud transcription, LLM, or speech synthesis services, those services process the corresponding audio or text outside your machine.
