Tools tagged with "llama.cpp backend"

llama.rn is a library for developers adding local LLM features to React Native apps on iOS and Android. It brings llama.cpp inference onto the device, so an app can process model requests on the user's hardware.

CloverPal is an Android app for private AI conversations and character roleplay on your phone. It runs models on-device, so you can chat offline once you've downloaded or imported a model.

LocaLM runs AI models on your own hardware for chat and optional tasks such as coding, document questions and media generation. It's for people who want a single local tool and can choose which extra capabilities to add.

Pocket AI Lab runs AI models on an iPhone and helps you judge which ones the phone can handle. It's for people who want private chat on their device and want to check memory and storage before downloading model weights.

Marker is a local document converter for developers and teams preparing PDFs, scans and Office files for document processing or AI workflows. It extracts text while retaining structure such as tables, equations and page layout.

MiniCPM-V is a family of local vision-language models for developers building applications that interpret images and video. It can run on phones and other hardware you control.

llama-swap is a local AI proxy for people who want several models available to their apps without keeping them all loaded. It starts the server a request needs and replaces the active server when another model is requested.

Docker Model Runner lets developers run AI models on their own computers or servers and connect them to applications. It combines local inference with model distribution through container registries.

Nexa SDK is an on-device AI framework for developers building apps that run models on users' hardware. It covers language, vision and audio tasks through a shared interface for local inference.

gptel is an Emacs LLM client for people who want model responses alongside their writing and code. It connects to local inference backends including Ollama, llama.cpp, Llamafile and GPT4All. The client runs in Emacs; cloud connections such as OpenAI, Anthropic and Gemini send requests to those providers and require their credentials.

Manifest LLM Gateway connects AI agents and apps to local models, cloud providers and subscriptions through a shared endpoint. It's for builders and teams who want to choose where requests go, handle provider failures and track inference usage.

llama-cpp-python is for developers adding local LLM inference to Python applications or connecting existing API clients to models on their own hardware. It brings llama.cpp into a Python library and a self-hosted server.

Pictaria Server helps Immich users explore their photo library, choose photos to keep and organize albums through a browser dashboard on their own hardware.

OpenDev is an AI coding agent for developers who want concurrent work across a codebase and control over which models handle each task. It can plan changes, execute them and iterate autonomously, with a terminal interface and a browser interface for monitoring work.

Graphiti is a Python framework for developers building AI agents that need to remember information as it changes. It turns conversations, structured records and unstructured text into a queryable graph with a history of facts.

MindMac is a native macOS AI chat client for people who want local models and cloud providers in one app. Its inline mode lets you get writing help inside Notes, Mail and browsers without switching to a separate chat window.

Yi is a family of language models from 01.AI for developers and researchers who want to run English and Chinese AI on their own hardware. It includes chat models for conversation and base models you can adapt to specific tasks.

HuggingChat UI is a browser-based ChatGPT alternative for people and teams who want to host their own chat service. It's the application behind Hugging Face's hosted HuggingChat, and it connects to a separate model backend.

NobodyWho Chat is an on-device AI assistant for people who want help with writing, brainstorming, coding and questions without sending their conversations to a hosted model. Language-model inference runs on the phone, and chat works offline without an account.

Harbor helps people experiment with local LLMs by connecting model backends, chat interfaces and supporting services. Its CLI and companion app manage those connections in a shared development environment.

Maid is an Android AI chat app for people who want to chat with models on their phone and access remote models from the same interface. Local conversations work without an internet connection.

FunASR is a speech-to-text toolkit for developers building transcription services and voice applications. It supports offline recordings and live speech on local hardware or self-hosted servers, with capabilities that depend on the model and runtime.

Atomic Agent is a local AI agent for people who want an assistant to work with their browser, files and code on their own hardware. Its model and task loop can run offline, while sessions and memory stay on disk. It's free and open source under the MIT license.

Layla is an AI assistant for people who want private chat, a personal companion or character roleplay on their phone. It runs local models on Android and iOS, so you can keep using it offline after downloading a model.

lm-evaluation-harness is a Python framework for researchers and developers comparing language models on shared benchmarks. Public prompts help make results comparable across model checkpoints and research papers.

LocalAI is a self-hosted AI runtime for developers and teams that want to run models on their own hardware. It brings language, speech, vision and media generation into one server that existing AI applications can connect to.

DarkMoon runs autonomous penetration tests for security teams, DevSecOps engineers and red teamers. It discovers a target's technology stack, assigns specialist AI agents and tests vulnerabilities across connected systems.

Ellama is an AI assistant for Emacs users who want help with writing and code inside their editor. It handles requests about selected text as well as longer conversations and coding tasks that need several steps.

Twinny is an AI coding assistant for developers who want completion and help with their repository inside VS Code, using models on their own hardware or a chosen server.

biniou brings AI chat and media creation into one browser interface on your own computer or server. It's for people who want to work with several kinds of generative AI without switching between separate apps.

MinerU is a local document parser for people preparing files for AI workflows. It handles scanned PDFs, academic papers and other documents containing OCR text, tables, figures or complex layouts.

Maat Agent is a coding assistant for developers who want testable evidence before accepting AI edits. It runs in a terminal or an Electron desktop app on macOS, Windows and Linux, and checks the actual project files against acceptance criteria set before work begins. Failed checks send their output back to the model for another attempt; if the work still fails, the agent reports failure.

Adrian is a runtime security tool for teams whose AI agents can use tools or act on external systems. It checks planned actions against the agent's intended task and can intervene before an unsafe action runs.

llamafile packages a language model and its runtime in a single executable for people who want to run models locally or share a ready-to-run model with others. Recipients don't need to install a separate runtime.