Command-Line Chat Clients for LLMs

DeepTutor is a self-hosted AI tutor for learners who want to study their own materials through a browser or CLI. It supports Docker deployment and uses configured model providers for its AI capabilities. Hosting the app locally is separate from model inference; requests to a remote provider leave the host.

Hermes Agent is a self-hosted AI agent from Nous Research for people who want an assistant that remembers past work and handles recurring tasks. It runs on macOS, Linux and native Windows, or on a server you control. Model connections include Nous Portal, OpenRouter, OpenAI and your own endpoint; choosing a hosted provider sends model requests to that service.

Exo Agent Framework is for developers building long-running AI agents that can revise their own code, tools and prompts. It preserves agent identity and history as their behavior changes across runs.

Waku Agent is a personal AI assistant that runs on your laptop, stores its memory locally and calls remote model providers. It's for developers who want to inspect and change the assistant's behavior in Python. The agent uses provider API credentials for reasoning; requests to cloud providers are processed by those services.

ChatOllama is an AI agent app with a command-line interface for people who want to use local models or hosted services from the same client. It discovers available models from connected providers, including installed models at an Ollama endpoint.

parrot.nvim is an AI coding and text editing assistant for Neovim users who want to request changes and chat without leaving their editor. It builds on an early fork of gp.nvim and lets you choose what context goes to the model.

Instrukt is a terminal app for developers who want to build and test AI agents on their own machine or server. It can index local code and documents, but its chat models run through OpenAI's API, which requires an API key and internet access. It doesn't provide local chat inference.

Inno Agent is a personal AI learning agent for ongoing tutoring and study. It keeps learning goals, misconceptions and study materials available across conversations, with records you can inspect and correct.

LocaLM runs AI models on your own hardware for chat and optional tasks such as coding, document questions and media generation. It's for people who want a single local tool and can choose which extra capabilities to add.

nanochat is a toolkit for researchers and developers who want to train an LLM and inspect the pipeline themselves. Its small Python codebase covers the stages between preparing a tokenizer and chatting with the resulting model.

OpenLLM is a self-hosted LLM server for developers connecting applications to models on their own hardware or servers. Its OpenAI-compatible interface lets existing clients use those models without adopting a separate API.

Agenvoy is a personal AI agent for people who want to automate research, file work, and recurring tasks on their own computer. It runs continuously and retains context between sessions.

nanobot is a self-hosted personal AI agent for people who want an assistant that can act on files and continue work across conversations. Its Python framework also suits developers building their own assistant integrations.

ShellGPT is an AI terminal assistant for developers and others who want help writing commands and code without leaving the shell.

Distributed Llama runs language models across your own networked computers. It's for people who want to share inference work and model memory across several devices instead of fitting the whole workload on one machine.

Letta is an AI agent platform whose App Server can run locally or on a self-hosted server. It's for people building assistants that retain context between conversations and use that memory in later interactions. Local agents can use Ollama or LM Studio with agent state and the model endpoint on your machine. Cloud model connections use remote providers.

Oterm is a terminal chat client for people who want to use local LLMs or hosted models without a browser interface. It keeps separate conversations and their settings so you can return to ongoing work.

Fabric organizes reusable AI prompts by task for people who want repeatable ways to analyze content, write, or work with code. Its community-contributed prompts, called Patterns, provide a starting point without requiring you to write each prompt yourself.

LLM is a command-line tool and Python library for developers who want to use language models in terminal workflows or applications. It supports models running on your machine alongside remote providers such as OpenAI, Anthropic and Google.

exxperts is a local AI agent app for people who want ongoing work to carry across conversations while deciding what the assistant remembers. Persistent workspaces called rooms keep each agent's memory, files and tools together.

tlm is a terminal assistant for people who want help writing shell commands or understanding commands they've found elsewhere. It uses local models through Ollama rather than a cloud AI service.

DwarfStar is a local LLM inference engine for people who want to run large DeepSeek, GLM and Qwen models on their own computers or servers. It focuses on selected models and hardware setups, and requires the project's own GGUF files rather than accepting arbitrary GGUF downloads.

gp.nvim brings AI chat and prompt-based editing into Neovim for developers and writers who want to work with their existing buffers. You can ask about selected text or code, then apply the response inside the editor.

Elia is a keyboard-focused terminal chat client for people who prefer to keep AI conversations alongside their command-line work. It connects to local LLMs and cloud services through the same interface.

node-llama-cpp is a library for developers adding local AI to JavaScript and TypeScript applications. It uses llama.cpp to run GGUF models on your hardware and works in Node.js, Bun and Electron.

MLX LM is a Python package for developers and researchers who want to generate text and adapt language models on Apple Silicon Macs. It uses MLX for local inference and training, with access through Python or a terminal.

QwenPaw is a personal AI assistant for people who want an agent on their own computer or server. It retains conversation history and a personal knowledge base across sessions.

aichat is a terminal AI assistant for people who want to discuss files, generate shell commands and use model-powered tools from the command line. It connects to Ollama, OpenAI, Claude, Gemini and OpenAI-compatible API providers.

RealChar lets you create AI companions with their own personalities and hold live voice or text conversations. It's for people who want to shape a character and host the app themselves while using external AI services for replies.

OneRAG is a self-hosted RAG framework for developers building chatbots that answer questions using their own documents. It combines document retrieval and AI answers, with replaceable components for different models and search needs.

Clawlet is a self-hosted personal AI agent for people who want an assistant on their own machine or server. It supports local models and can retrieve past context through optional memory search.

mods is an AI command-line tool for developers and shell users who want to ask questions about command output or pass model responses into pipelines. The project is archived and no longer maintained.