Favicon of aichat

aichat

An open-source LLM CLI for macOS, Linux and Windows that connects to Ollama or cloud providers and supports document chat, shell commands and AI agents.

aichat brings Ollama and cloud AI services into the same terminal interface for developers and people who work at the command line. It runs locally on macOS, Linux and Windows, with Android support through Termux. Model processing happens through the backend you choose: Ollama supports local models, while providers such as OpenAI, Claude and Gemini process requests in the cloud.

You can ask individual questions or keep an ongoing conversation with retained context. The shell assistant turns plain-language requests into commands suited to your operating system and shell. Inputs can include local files, images, whole directories, URLs and output from other commands, so you can discuss material you already work with.

Document chat uses retrieval-augmented generation (RAG) to bring external documents into a conversation. For tasks that need actions as well as answers, aichat supports function calling and MCP tools. Its AI agents combine instructions, tools and documents; reusable roles and macros support recurring work.

A built-in local HTTP server exposes chat completion, embedding and reranking APIs. It also provides a browser playground for chatting with supported models and an arena for comparing their responses side by side. The same interface accepts OpenAI-compatible API providers alongside named services such as Groq, OpenRouter and Bedrock.

The project is written in Rust and is open source under the Apache License 2.0.

Similar to aichat