Tools tagged with "OpenAI-compatible API"

Surya is a local OCR toolkit for developers who need text and page structure from document images. It handles multilingual documents and preserves reading order for use in document-processing applications.

Whisper Desktop turns audio and video recordings into transcripts and subtitles on your computer. It's for people working with interviews, lectures, podcasts or videos who want a desktop interface for transcription and captioning.

HolaOS is a desktop AI workspace with a self-hostable runtime for teams that want agents to work with their apps and files. Claude Code, Codex and its built-in agent share tools and project memory. Workspace storage is local. Default built-in model access uses your HolaOS account and hosted inference; you can also configure your own provider or compatible endpoint.

LunarGate is a self-hosted AI gateway for teams whose apps use multiple model providers. It gives those apps one OpenAI-compatible endpoint and keeps routing, retries and fallback rules in your infrastructure. The gateway is open source under the MIT license and runs on macOS and Linux, with a container image also available.

Hindsight is a memory system for developers whose AI agents need to carry facts and experience across sessions. It combines stored memories into observations and maintains answers to recurring questions as more information arrives.

GLaDOS is a local AI voice assistant for people who want a conversational companion modeled on the personality core from Valve's Portal games. It combines a custom voice and dry humor with awareness of its surroundings.

OpenHuman is a personal AI assistant for people who want agents to act across their work apps and carry out repeatable tasks. Its orchestration engine manages multiple agents and workflows in one place.

Mosec is a self-hosted model serving framework for developers turning trained machine learning models into APIs. It runs on Linux and macOS, on your own hardware or cloud servers, and is open source under the Apache 2.0 license. Its main focus is handling concurrent requests while making better use of CPU and GPU resources.

Paperless-AI is an extension for Paperless-ngx users who want to sort incoming documents automatically and ask questions about their archive. The project is no longer maintained.

Codel is a self-hosted AI agent for people who want software to carry out multi-step tasks and projects using a terminal, web browser, and text editor. It chooses and performs the next action itself, with task execution inside a sandboxed Docker environment. You access its interface through your browser.

Text Generation Inference (TGI) serves LLMs on your own hardware for developers building chat apps and text generation services. The project is archived and no longer receives updates.

Verba is a self-hosted document chatbot for people who want to ask questions across their files and knowledge bases. The project is archived and no longer maintained, so it won't receive bug fixes or security patches.

TensorZero is a self-hosted platform for developers who need to compare and improve models in LLM applications. The project is archived and no longer maintained.

Clawlet is a self-hosted personal AI agent for people who want an assistant on their own machine or server. It supports local models and can retrieve past context through optional memory search.

NVIDIA RAG Blueprint is a reference framework for developers building AI question answering over enterprise data. It retrieves relevant material from your documents to ground answers and can cite the retrieved sources.

mods is an AI command-line tool for developers and shell users who want to ask questions about command output or pass model responses into pipelines. The project is archived and no longer maintained.

Voxtral Small is an audio and text model for developers building self-hosted speech applications. The separate mistral-inference library is archived and no longer maintained; this model runs with vLLM or Hugging Face Transformers.