Tools tagged with "llama.cpp backend"

QOwnNotes is a desktop notepad and todo manager for people who want to keep their notes in ordinary Markdown files on their own computer. It can use existing text files directly, so your notes remain accessible outside the app.

PrivateGPT is a self-hosted API layer for developers building applications around local models. It requires a separate inference server, such as Ollama, llama.cpp, vLLM or LocalAI; it doesn't run models itself.

Local Deep Research is a self-hosted AI research assistant for people investigating complex questions across web sources, academic papers and their own documents. It gathers evidence and writes reports with citations.

QwenPaw is a personal AI assistant for people who want an agent on their own computer or server. It retains conversation history and a personal knowledge base across sessions.

MiniMind is a toolkit for learners and developers who want to understand language models by training small ones on their own hardware. Its core training algorithms use native PyTorch code that you can inspect and change.

gptme is an AI agent for developers and people doing data analysis or other knowledge work in their own environment. It can act on files and use installed tools, with a choice of local models or cloud providers.

LLMux is a self-hosted AI gateway for developers who want to use local models and cloud providers through one interface while controlling where requests go. It blocks remote inference by default and logs permitted calls that leave the machine.

KittenTTS is a Python text-to-speech library for developers adding local speech generation to apps or producing spoken audio from text. It supports voice cloning without model training and doesn't require a GPU.

AI Runner is a desktop app for people who want an AI companion and an art workspace on their own hardware. Its local chat, voice and image tools work offline without an API key or subscription.

Local OpenAI LLM for Home Assistant connects conversation agents and AI tasks to models served through an OpenAI-compatible API. It's for Home Assistant users who want to choose their own model server for voice conversations and generation tasks.

Interpreter translates Japanese game text into English subtitles over the game window. It's aimed at retro-game players, with MeikiOCR tuned for Japanese game text and pixel fonts. The default MeikiOCR and Sugoi V4 models run locally without internet access after setup.

Paddler lets product and infrastructure teams serve AI models on their own servers and spread requests across multiple machines. It's built for applications that need text generation or embeddings while keeping inference within infrastructure the team controls.

claudectl manages multiple Claude Code sessions for developers who need to track parallel work and intervene when an agent gets stuck. Its terminal dashboard brings session activity, approvals and spending into one view.

Instructor is a library for developers who need to turn text into structured data using an LLM. Its focus is extraction, with typed outputs that applications can use and validation rules that check the model's responses.

HilbertRaum is a local AI workspace for people working with confidential documents, research, or personal archives. It lets you use AI without sending your files or conversations to an external service.

Surya is a local OCR toolkit for developers who need text and page structure from document images. It handles multilingual documents and preserves reading order for use in document-processing applications.

Hindsight is a memory system for developers whose AI agents need to carry facts and experience across sessions. It combines stored memories into observations and maintains answers to recurring questions as more information arrives.

Outlines is a Python library for developers who need LLM responses in a defined format. It constrains generation to produce structured data for tasks such as extracting service tickets from emails or limiting an answer to allowed choices.

Intel IPEX-LLM is a library for developers running or fine-tuning language models on Intel hardware. The project is archived and no longer maintained, and Intel has identified known security issues in the code.