Extended OpenAI Conversation
A Home Assistant AI agent that controls devices, creates automations, and retrieves history using OpenAI or compatible backends such as LocalAI.
Extended OpenAI Conversation is a custom component for Home Assistant users who want an AI assistant that can act on their home. It builds on OpenAI Conversation and adds device control, automation creation, and access to historical device states. It runs inside Home Assistant, while a separate model backend handles the conversation.
The backend can be OpenAI, Azure OpenAI, or an OpenAI-compatible server such as LocalAI. With OpenAI or Azure, conversation context goes to a cloud service and requires internet access and API credentials. LocalAI provides an alternative for running models on your own hardware. Home Assistant executes the device actions locally; where the model processes your messages depends on the backend you choose.
The assistant can control individual devices or several devices in one request, call Home Assistant services, and create automations through conversation. It can also retrieve device history to answer questions about past states. Custom functions connect it to Home Assistant scripts, external APIs, and information from web pages. These functions can combine several actions or delay an action until later.
Reusable skills add specialized knowledge and instructions for particular conversations. You can also choose which Home Assistant entities the agent sees and cap function calls within a conversation to limit repeated actions. For conversations through the interface or REST API, an optional setting includes the active user's name in the context sent to the model.
