Tools tagged with "llama.cpp backend"

llmfit helps people choosing models for their own computers compare what will fit in memory and how fast it might run. It checks your hardware before recommending models, so you can assess candidates before downloading them.

FreeLLMAPI gives developers one API for experimenting with cloud models and local backends. The router runs locally, but cloud inference still sends requests to the providers you enable.

DeepTutor is a self-hosted AI tutor for learners who want to study their own materials through a browser or CLI. It supports Docker deployment and uses configured model providers for its AI capabilities. Hosting the app locally is separate from model inference; requests to a remote provider leave the host.

Free Claude Code lets developers use coding agents with local models or a choice of cloud providers. It connects existing clients to a shared model catalog rather than requiring a separate coding workflow.

llama.vscode is a coding assistant for developers who want AI suggestions, chat, and an agent inside VS Code. It lets you use models on your own hardware or connect to external providers.

OmniRoute is an AI gateway for developers who want their coding assistants and other AI clients to share one set of provider connections. It routes requests across models and accounts when a service fails, reaches a rate limit or runs out of quota.

text-generation-webui, also called TextGen, runs language models on your own hardware for chat, writing and application integrations. You can use it as a desktop app or a self-hosted browser interface.

Local Agent Studio is a Windows desktop app for building AI agents and connecting them in visual workflows. It suits first-time agent builders and developers prototyping private automation. Local and cloud agents can work together in the same workflow, with progress visible for each step.

Nemotron is NVIDIA's family of AI models for developers building agents that reason, write code and use tools. Teams can evaluate and adapt the models using published weights, training data and training recipes.

Garak is an LLM vulnerability scanner for developers and security teams assessing models or dialogue systems. It attempts to provoke unwanted responses so teams can identify weaknesses in the systems they test.

Locally Uncensored is a desktop AI studio for people who want to chat, create media and work on code on their own PC. It includes mainstream models and variants with fewer refusal restrictions.

SUB/WAVE is a self-hosted internet radio station for people who want to broadcast music from their own library. An AI DJ picks tracks and speaks between them while every listener hears the same live Icecast stream.

Vyact is a desktop workspace for people who want a local LLM to help with files, writing and code. It brings conversations and searchable documents together, with optional connections to email services and Chrome.

KoboldCpp runs language models on your own hardware for chat, creative writing and roleplay. It's a fork of llama.cpp with a bundled KoboldAI Lite browser interface.

llmserve is a terminal app for people who keep local LLM models across several folders or inference tools. It brings model discovery and server management into one interface so you can choose an existing model and an available backend.

DocsGPT helps teams search company documents and build AI assistants that answer from those materials. It can run inside your network with local models, including an air-gapped deployment where documents and questions stay within that network.

Lollms WebUI is a local AI interface for writing, coding assistance and media generation through a choice of models. The project receives minimal maintenance, and its interface has no built-in user authentication.

Xinference serves AI models on your own computer or servers for developers and researchers building applications around models they control. It brings chat, document search and media generation into one platform.

WritHer is a voice dictation app for people who want to write in Windows desktop apps and manage everyday tasks by speaking. It works offline after the initial model downloads, without an account.

wllama lets developers add local LLM inference to browser apps without a separate inference server. It brings llama.cpp to JavaScript and TypeScript projects through WebAssembly, so models run on the user's device.

Transcribe Offline turns recordings and live speech into text for people who need to review conversations without uploading audio to a cloud service. It pairs transcript editing with audio playback in a desktop app.

Sidekick is a native macOS app for people who want AI answers grounded in their documents and research materials. Its built-in llama.cpp engine runs GGUF models such as Qwen3.5 without a separate model runner.

Libre WebUI is a self-hosted AI workspace for individuals and teams who want chat, document research and AI agent tasks on infrastructure they control. You can use local models or connect a remote provider of your choice.

PocketPal AI runs language models on phones and tablets for people who want an assistant they can use without sending conversations to a server. Core chat works offline after a model download and doesn't require an account.

LLM Farm is an app for on-device AI conversations and comparing language models on Apple hardware. It suits people who want offline chat or need to assess which model fits a project.

ZeroClaw is a personal AI agent for people who want an assistant running on their own computer or server. It can use a shell and browser, respond through messaging apps and perform scheduled tasks.

OpenCommit is a command-line tool for developers who want AI to write commit messages from their Git changes. It can create the commit after you review the proposed message and also fits into an IDE's existing Git workflow.

LM Studio runs downloaded language models for conversations and tasks on your computer. Its Bionic agent helps people create documents, write software and carry out work using local or frontier open models.

Fast Agent is a terminal coding assistant and Python toolkit for developers building AI agents and automated workflows. You can choose local LLMs or hosted providers and use the same toolkit for interactive work, scripting, and evaluation.

Agent Zero is a self-hosted AI agent framework for people who want an assistant to carry out research, coding, and document work on a computer. You can watch its actions and intervene in the same desktop with your mouse and keyboard.

Priv AI is an on-device assistant for people who want to chat with AI and use it to examine personal health and financial information. It works offline after a model download and doesn't require an app account.

Lemonade is a local AI server for people who want to chat with models on their own hardware or use them in apps and agents. It includes a built-in interface for direct use and APIs for connecting other software.

Zeraix is a local AI desktop for people who want models to work with their files and carry out multi-step tasks. It combines chat, project tools, and agents in one workspace.

Voice-Clone-Studio brings voice cloning and speech production into one browser interface for people making podcasts, audiobooks and dialogue recordings. It combines several engines with tools for preparing samples and training custom voices.