Tools tagged with "llama.cpp backend"

Orpheus TTS generates speech for developers building voice applications or creating custom voices. Its Llama-based models support local inference and let you control how spoken text sounds.

avante.nvim adds AI coding assistance to Neovim for developers who want code questions and suggested edits inside their existing editor. It lets you choose a model backend and apply recommendations directly to source files.

ChatterUI is an Android chat app for people who want to use a local LLM on their phone or connect to a remote model. It supports assistant and character conversations, with control over reply generation and chat formatting.

Marbor is a self-hosted AI inference gateway for operators serving models across their own GPU fleet. It places requests using live hardware and model state to reduce cold loads and avoid deployments that can't serve the requested model.

Understory gives AI agents persistent knowledge across sessions in Markdown files you can read, edit, and track in Git. It's for people who want their agents' memory accessible outside a chat history.

OuteTTS is a local text-to-speech library for developers adding generated speech to their applications. It uses reference audio to reproduce a speaker's voice, including their style, emotion and accent.

Second Me is an open-source prototype for people who want to train and host an AI representation of themselves. It uses personal memories to shape a model around their identity and context.

LLM Router is a self-hosted AI gateway for teams connecting applications to local LLM servers and cloud providers. It puts a shared interface in front of your models so clients can use the same gateway across backends.

Deep Research is a self-hosted AI agent for people who want web research with traceable evidence and a library they control. It runs in Docker on your own machine or server, searches the web in successive rounds, and uses gaps in its findings to decide what to investigate next. Reports include citations, per-source notes with quoted evidence, and suggested follow-ups.

Soul-of-Waifu is an AI companion app for creating characters and roleplaying with them. A character carries the same personality and memories between conversations, RPG campaigns and a desktop companion.

kotaemon is an open source document chat app for people who want to ask questions across their files and inspect the evidence behind an answer. Developers can also use it to build custom document question-answering applications.

RamaLama runs AI models for local chat or a self-hosted REST API. It's for developers who want a container workflow for trying models on their own hardware and serving them in production.

Llama Desktop runs language models on your computer for private chat and use in other apps. It's for people who want a local ChatGPT alternative and developers connecting coding agents, editors or scripts to their own models.

WebBrain is an AI browser agent for people who want to ask questions about pages or delegate web tasks from a sidebar. It works in your existing browser, including signed-in tabs, and starts in read-only Ask mode.

GoModel is a self-hosted AI gateway for developers and platform teams sharing access to local models and cloud providers. It centralizes provider choice and usage policies behind APIs compatible with OpenAI and Anthropic SDKs.

QMD searches Markdown notes, meeting transcripts, documentation and knowledge bases on your own machine. It's for people who want to find material by its wording or meaning, and make that search available to an AI agent.

Augmentoolkit turns documents into datasets for training an LLM on a particular subject. It's for people building custom models around material such as research papers or fictional lore.

Translate Books With LLMs translates books, documents and subtitles using a local or cloud model. It's for readers and translators working with long texts who need formatting and terminology to carry through the translation.

Backyard AI is a desktop AI app powered by llama.cpp. The desktop app is deprecated and no longer supported, which limits its suitability for people choosing software for ongoing use.

Guidance is a Python library for developers who need language model responses in a defined format. It controls output during generation for applications that expect structured data or specific syntax.

Personal LLM runs AI chat on your phone for people who want to ask questions without sending them to a cloud model. Chat, photo analysis and document questions work offline after you download a model and any required image support files.

BitNet is Microsoft's local LLM inference framework for developers and researchers working with compatible 1-bit models. Its bitnet.cpp runtime focuses on faster inference and lower energy use on your own hardware.

GPT4All is a local AI chatbot for people who want language models and document conversations on their own computer. Model inference and LocalDocs processing run on the device without a cloud connection.

PrivateLM is an AI chat app for people who want to run models on their phone or tablet and choose when to use a cloud provider. It supports local inference on Android and iOS; the browser version requires cloud APIs.

Crush is a terminal AI coding assistant for developers who want an agent to work with their code and existing tools. The application runs on your machine; your chosen backend determines where model requests go.

MiniCPM is a family of compact language models for developers building local assistants and coding agents. It targets on-device workloads and hardware with limited computing resources.

Visions of Chaos combines generative AI tools with fractals and complex-system simulations in one application. It's for digital artists, educators and people who want to explore machine learning or mathematical patterns without working through the equations themselves. Its AI models run privately on your own hardware, without paid online APIs or backend usage logging and telemetry.

TradingAgents is an open-source Python framework for researchers and developers studying AI trading decisions. It assigns market analysis and risk assessment to separate LLM agents, then combines their findings into a proposed trade for a simulated exchange.

LEANN is a local vector database for people building AI search over personal data or knowledge collections. It reduces index storage by computing embeddings on demand rather than keeping every embedding on disk.

SenseVoice is a local speech recognition model for developers building voice apps or analyzing recordings. Its SenseVoiceSmall model adds information about the language, emotion and surrounding sounds to speech transcriptions.

jetson-containers is a Docker container build system for developers running local AI on NVIDIA Jetson. It assembles GPU software and its dependencies into containers for workloads that need a compatible CUDA stack.

Thuki is a floating AI assistant for Mac users who want help with the text or screen they're already viewing. It appears above other apps, including fullscreen windows, and automatically brings selected text into the conversation.

txtai is a Python framework for developers building search, chat with their data, and AI agents on their own hardware. It combines a searchable knowledge store with model workflows, so applications can retrieve context and act on it.

PasteGuard is a privacy proxy for teams that use AI with customer records, client files or project secrets. It runs locally or on your own server and checks requests before they reach a model provider.