Tools tagged with "llama.cpp backend"

Zed is a desktop code editor for developers who want coding assistance from models running on their own machine or infrastructure they control. Its Agent and Inline Assistant can use Ollama, llama.cpp, LM Studio or a local OpenAI-compatible server. The editor connects to these model servers, which perform inference.

DB-GPT is a self-hosted AI data assistant for teams analyzing business data and developers building data applications. It connects plain-language questions to database queries and code-based analysis.

Airux Pocket AI runs AI conversations on Android phones for people who want offline chat and photo analysis without cloud inference. You don't need an account, and downloaded models run directly on your phone.

UGTLive translates text on your Windows screen for games, manga reading and language study. It places translations over the app you're viewing and requires an NVIDIA RTX 20, 30, 40 or 50 series GPU with at least 8 GB VRAM.

Home-LLM connects Home Assistant to language models for voice and chat control of smart devices. It's for Home Assistant users who want those requests handled on their own hardware.

Lexicon is a writing assistant and rich-text editor for people who want to proofread and revise drafts on their own computer. Grammar checks work without an AI model, while optional local AI tools help rewrite longer passages and whole documents.

NeuTTS is a collection of on-device text-to-speech models for developers building voice assistants and speech-enabled apps. It generates audio on your own hardware rather than sending speech generation to a cloud API.

Atomic Chat is a local LLM app for people who want to chat with models on their own device or use them with coding assistants and AI agents. It began as a fork of Jan by Menlo Research.

LLMKube manages self-hosted LLM inference for teams and homelab owners who need several machines to serve models together. It brings Linux GPU servers and Apple Silicon Macs into the same Kubernetes-managed fleet.

Falcon-H1 is a family of language models from the Technology Innovation Institute for developers building AI applications on their own hardware. Smaller models suit edge devices, while larger variants target server deployments.

OfflineLLM is an on-device AI chat app for Android users who want to run models locally without sending conversations to a cloud service. It works fully offline and has no network permissions.

Scarf gives people running the Hermes AI agent a native interface for conversations, project work and host management. It requires an existing Hermes installation; the iPhone companion, ScarfGo, connects directly to your hosts over SSH.

ChuanhuChatGPT is a self-hosted web interface for people who want to chat with local LLMs and cloud models in one application. It also supports document questions and automated agent tasks.

Ollama runs open models for people who want local AI applications, model chat or a backend for coding assistants. It provides a command-line interface and an API, with a choice between inference on your hardware and its cloud service.

Deep Agents is an AI agent framework for developers building assistants that carry out multi-step work. It provides planning and task execution defaults that you can customize without forking the project.

Qwen3 is a language model family from Alibaba Cloud's Qwen team for people building chat applications or running models on their own hardware. Its public weights include dense and mixture-of-experts models in smaller and larger sizes.

MartinLoop runs around coding agents to keep software jobs within agreed boundaries and check their results. It's for developers and engineering teams who want to delegate longer tasks while retaining limits, recovery information and a record of what happened.

Msty is a family of AI products for individuals, teams and organizations working with models and their own knowledge. Msty Studio is its workspace product, with separate products for agents and centralized model access.

Dagu turns existing scripts and runbooks into scheduled workflows for operations, data pipelines, and AI automation. You define dependencies and actions in YAML, then inspect runs and retry failures from its built-in Web UI.

Icebreaker is a local AI chat app for people who want to converse with language models running on their own hardware. It uses llama.cpp, with Hugging Face also part of its model stack.

Mikupad is a browser-based LLM frontend for writers and anyone who wants to edit and guide generated text. It connects to a separate model backend and keeps writing context attached to your prompts.

Newelle is a Linux desktop AI assistant for people who want to chat with local models and use AI to work with documents and files. It also supports external model providers.

npcpy is a Python library for developers and researchers building AI agents and applications with language models. It supports local LLM backends as well as cloud providers, so projects can choose where model requests run.

AgenticSeek is a local alternative to Manus AI for people who want an assistant to carry out research, coding and file tasks on their own hardware. It can break a request into steps and assign the work to specialized agents.

SmolChat is an Android app for chatting with language models on your phone. It gives people who want on-device AI a chat interface for their own GGUF model files, including small language models.

node-llama-cpp is a library for developers adding local AI to JavaScript and TypeScript applications. It uses llama.cpp to run GGUF models on your hardware and works in Node.js, Bun and Electron.

quackd lets robot builders give language-based goals to robots with existing movement and manipulation skills. It runs the planning on a computer while the robot's own controllers carry out the actions. Real-hardware use covers the LeRobot SO-101 arm; the other adapters have only run in simulators or mocks.

Aphelion is a desktop app for people who want character conversations, creative writing and coding help from models running on their own computer. It works offline after the first model download and doesn't require an account.

Claude Code Local lets developers use Claude Code with a model running on their own computer. It suits people who want to keep coding offline or continue working when they hit cloud usage limits.

Eclaire is a self-hosted AI assistant for people who want to ask questions about their saved information and act on it in one place. It brings documents, notes, photos, bookmarks and tasks into a shared library.

Oriveo Community Edition is a free, open-source AI chat client for people who want local models and cloud providers in the same app, with their conversation history stored on their own device. It runs on iOS, Android and the web, and you can self-host the web client. It doesn't require an Oriveo account.

LM Format Enforcer is an open-source Python library for developers who need a local LLM to return structured data their applications can parse. It constrains text during generation, so a prompt's formatting request doesn't have to carry the whole burden. The library uses the MIT license.

VoxCPM is a local text-to-speech system for developers and audio creators who want to generate speech with voices they can design or clone. It supports multilingual narration and control over how a voice delivers the text.

Home Generative Agent is a Home Assistant integration for people who want to control their smart home through conversation and get alerts about security issues. It can use fully local models, so home data doesn't have to leave your network.