Tools tagged with "OpenAI-compatible API"

Vela is a desktop AI writing editor for novelists and web fiction authors who need to manage a long story's characters, settings and chapters. It brings planning, drafting and revision into one workspace.

Reverify helps developers and reverse engineers check AI-generated claims against actual binary files and code behavior. It returns verified, refuted or inconclusive verdicts with evidence, so an assistant's proposed explanation can be checked before you rely on it.

Nanobrowser is a browser AI agent for people who want to delegate repetitive web tasks and research. It carries out actions inside the browser while letting you choose the models that handle the work.

Bolt.diy is an AI coding assistant for building full-stack Node.js web applications with your choice of model. It's a fork of Bolt.new that combines generated code with an editable development workspace.

Jev Chat helps people interpret tense or ambiguous conversations and choose a reply. It estimates the other person's intent and the risk of friction before suggesting wording, though its assessments can be wrong.

Eclaire is a self-hosted AI assistant for people who want to ask questions about their saved information and act on it in one place. It brings documents, notes, photos, bookmarks and tasks into a shared library.

vLLM Production Stack is an open source LLM serving stack for teams running models on Kubernetes GPU clusters. It lets applications move from a single vLLM instance to a distributed deployment without changing application code.

Unmute gives text LLMs a spoken conversation interface using Kyutai speech recognition and speech synthesis. It's for developers who want to self-host voice chat while choosing their own language model.

TrustLLM is a research toolkit for teams comparing language models beyond answer quality. It evaluates local LLMs and models accessed through APIs for behaviors such as hallucination, harmful responses, bias, and information leakage.

Oriveo Community Edition is a free, open-source AI chat client for people who want local models and cloud providers in the same app, with their conversation history stored on their own device. It runs on iOS, Android and the web, and you can self-host the web client. It doesn't require an Oriveo account.

LibreDB Studio is a self-hosted database IDE for developers and database teams who want browser access to data inside their own network. It can run beside the database, with an interface that also works on phones and tablets.

WhisperWriter turns microphone speech into typed text in your active window. It's for people who want dictation in their desktop apps, with a choice of transcription on their own computer or through an API.

Claude Code Router is a local gateway for developers using coding agents such as Claude Code, Codex and OpenCode. It keeps provider selection and request routing in one app, while the selected cloud provider processes model requests remotely. Those requests leave your machine.

LM Format Enforcer is an open-source Python library for developers who need a local LLM to return structured data their applications can parse. It constrains text during generation, so a prompt's formatting request doesn't have to carry the whole burden. The library uses the MIT license.

MCP Context Forge is a gateway and registry for teams connecting AI clients to multiple tools, agents and services. It gives them one place to discover available services, control access and inspect calls.

OpenCompass is an LLM evaluation framework for researchers and developers comparing models for their applications. It lets you assess models on your own hardware alongside cloud APIs in the same experiment.

Izwi is a local voice AI app and runtime for people and teams processing speech on their own hardware or inside infrastructure they control. It brings audio tools and voice conversations into a desktop app, browser interface, CLI and inference server.

VoxCPM is a local text-to-speech system for developers and audio creators who want to generate speech with voices they can design or clone. It supports multilingual narration and control over how a voice delivers the text.

Witsy is a desktop AI assistant for people who want to chat with models, work with documents and write across applications. You can choose local models or cloud providers, with feature availability depending on the backend.

Home Generative Agent is a Home Assistant integration for people who want to control their smart home through conversation and get alerts about security issues. It can use fully local models, so home data doesn't have to leave your network.

Meetily records calls and turns them into live transcripts and meeting summaries. It's for people who want to keep meeting recordings on their own computer without adding a recording bot to the call.

QOwnNotes is a desktop notepad and todo manager for people who want to keep their notes in ordinary Markdown files on their own computer. It can use existing text files directly, so your notes remain accessible outside the app.

ReadAny is an AI e-book reader for people who want to question a book, find an idea they remember imperfectly and keep notes alongside their reading. It combines a personal library with answers tied to book passages.

MacParakeet is a speech-to-text app for people who want to dictate across Mac apps, transcribe recordings and capture meetings while keeping speech recognition on their own hardware.

EmbedAnything is a local embedding pipeline for developers building semantic search and retrieval-augmented generation (RAG) applications. It turns documents and media into vectors for indexing in a vector database.

CodePilot is a desktop AI workspace for coding, project work and everyday tasks. It brings Claude Code, Codex and a built-in agent into one app for people who want to work with files and conversations across local models and cloud services.

PrivateGPT is a self-hosted API layer for developers building applications around local models. It requires a separate inference server, such as Ollama, llama.cpp, vLLM or LocalAI; it doesn't run models itself.

Local Deep Research is a self-hosted AI research assistant for people investigating complex questions across web sources, academic papers and their own documents. It gathers evidence and writes reports with citations.

aichat is a terminal AI assistant for people who want to discuss files, generate shell commands and use model-powered tools from the command line. It connects to Ollama, OpenAI, Claude, Gemini and OpenAI-compatible API providers.

Alexandria Audiobook turns books into audio with separate narrator and character voices. It's for people who want to choose the cast and correct individual passages before exporting an audiobook.

MiniMind is a toolkit for learners and developers who want to understand language models by training small ones on their own hardware. Its core training algorithms use native PyTorch code that you can inspect and change.

Bloks is a desktop workspace for people who want personal AI agents working on their own computer. Its messaging-style interface gives agents individual chats and shared rooms for collaborative work.

gptme is an AI agent for developers and people doing data analysis or other knowledge work in their own environment. It can act on files and use installed tools, with a choice of local models or cloud providers.

LLMux is a self-hosted AI gateway for developers who want to use local models and cloud providers through one interface while controlling where requests go. It blocks remote inference by default and logs permitted calls that leave the machine.