Tools tagged with "OpenAI-compatible API"

Tellama is a local LLM chat app for Android users who want conversations to stay on their phone. Chat with an installed compatible model works offline, and you don't need an account.

Open Multi Agent is a TypeScript framework for developers building self-hosted AI agent teams. It lets you coordinate work across agents, require human decisions before consequential actions, and inspect what happened afterward.

RESTai is a self-hosted AI platform for developers and teams building document assistants, agents and AI services for other applications. Its web interface manages projects with separate models, prompts and tools, plus a chat playground for testing them.

KoboldCpp runs language models on your own hardware for chat, creative writing and roleplay. It's a fork of llama.cpp with a bundled KoboldAI Lite browser interface.

OpenZiti LLM Gateway is a self-hosted API proxy for developers and teams connecting AI applications to inference servers across private networks and cloud services. Its optional zrok integration uses OpenZiti for identity-based access and end-to-end encryption, so clients and backends can connect across network boundaries without opening inbound ports.

Chatterbox TTS Server turns text into speech on your own computer or server. It's for people making narration and audiobooks, or adding speech to apps through an API.

AgentFlow is a Python framework for developers coordinating coding agents across tasks that depend on one another. It runs Codex, Claude, Kimi, and Pi agents in workflows that can split work and bring the results back together.

PapersGPT is an AI research assistant inside Zotero for researchers working through a paper library. It helps answer questions across saved research and turn findings into notes with citations back to the papers.

Unstract is a self-hosted, no-code platform for teams that need structured data from documents whose layouts vary. It uses LLMs to extract JSON from PDFs, images, scans and office files without building a template for each vendor or form. Its use cases include finance, insurance, healthcare and KYC document processing.

next-wiki is a self-hosted wiki for people and teams who want AI-assisted knowledge management with a record of where information came from. It keeps original sources separate from AI-written material and reviewed pages, so an assistant's synthesis remains traceable to its evidence. It's open source under Apache 2.0 and runs as a browser app on your own Docker host with PostgreSQL.

Klaat Code is a terminal AI coding agent for developers who want an assistant to read code, make changes, and run commands in their projects. Its default model routing runs through hosted Klaatu, which receives your messages; file edits and shell commands happen on your machine.

PyGPT is a desktop AI assistant for people who want to chat with models, work with their documents and delegate tasks from one application. It supports local AI through Ollama alongside cloud providers.

MTPLX is a native Mac app, command-line tool and local LLM server for people running chat or coding models on Apple Silicon. It uses a model's own multi-token prediction heads to accelerate generation without a separate draft model.

Agently is a Python AI agent framework for developers building assistants and service backends with local Ollama models or hosted model APIs. It runs within your application, without requiring a separate orchestration service. Model requests go to the endpoint you choose, so using a remote provider sends the request data outside your machine.

LiteLLM is an AI gateway for platform teams managing model access across applications and providers. It puts cloud and self-hosted models behind a shared interface so developers can switch providers without rewriting their integration.

haiku.rag lets you search your own documents and ask questions with answers you can check against the original pages. It's for people building a private document library or giving an AI assistant access to their files.

Anything Analyzer is a desktop protocol analyzer for developers and security researchers investigating APIs, authentication and request signing. It brings browser and app traffic into one session for inspection and AI analysis.

Mirrai is an AI companion for people who want to revisit unfinished conversations through a persona based on someone's chat history. It simulates their communication style, with a farewell process that gives the experience an optional endpoint.

Avibe gives coding agents a shared workspace for people who want to manage ongoing work and review results from their browser or phone. Agent execution stays on your machine, while inference uses your configured provider; OpenCode can also use local or OpenAI-compatible endpoints.

Xinference serves AI models on your own computer or servers for developers and researchers building applications around models they control. It brings chat, document search and media generation into one platform.

FastLLM is an open-source inference engine for people running large language models on their own machines or self-hosted servers. Its main draw is hardware flexibility: large mixture-of-experts (MoE) models can spread their weights across GPU memory, system RAM and disk when they don't fit entirely on a graphics card.

WritHer is a voice dictation app for people who want to write in Windows desktop apps and manage everyday tasks by speaking. It works offline after the initial model downloads, without an account.

AIdea for Zotero is an AI assistant for researchers who want to ask questions about papers and translate reading material inside Zotero. Its side panel works in the library view and the PDF or EPUB reader.

HippoRAG is a Python memory and retrieval framework for developers building LLM applications that need to connect facts across documents. It uses a knowledge graph to find related information for questions that require several pieces of evidence.

wllama lets developers add local LLM inference to browser apps without a separate inference server. It brings llama.cpp to JavaScript and TypeScript projects through WebAssembly, so models run on the user's device.

Paritok is a self-hosted gateway for developers whose coding agents send large file reads, tool output and conversation histories to an LLM. It reduces that input before the request reaches the upstream model.

Sidekick is a native macOS app for people who want AI answers grounded in their documents and research materials. Its built-in llama.cpp engine runs GGUF models such as Qwen3.5 without a separate model runner.

ZeroClaw is a personal AI agent for people who want an assistant running on their own computer or server. It can use a shell and browser, respond through messaging apps and perform scheduled tasks.

OpenVoiceOS is a voice assistant platform for people building smart speakers or adding voice control to their own devices. Its core is a fork of MycroftAI/mycroft-core, and most classic Mycroft skills remain compatible.

SQL Chat is a SQL client for people who want to work with databases using natural language. Its chat interface lets you ask for data and request database changes without writing every SQL statement yourself.

LM Studio runs downloaded language models for conversations and tasks on your computer. Its Bionic agent helps people create documents, write software and carry out work using local or frontier open models.

TabbyAPI is a self-hosted LLM API server for people who want to run ExLlamaV3 models on their own hardware. It’s built for personal projects and small groups; its maintainers don’t recommend it for production servers.

Fast Agent is a terminal coding assistant and Python toolkit for developers building AI agents and automated workflows. You can choose local LLMs or hosted providers and use the same toolkit for interactive work, scripting, and evaluation.

Revornix is an AI knowledge workspace for people who collect articles, research papers and recordings and want to ask questions across their library. It connects saved material in a personal knowledge graph and uses those relationships to inform its answers.