Tools tagged with "OpenAI-compatible API"

Pico MLX Server is a macOS app for people who want to run MLX models locally and use them with an existing AI chat client. It gives MLX Server a graphical interface and exposes local models through an OpenAI-compatible API. The project is open source under the MIT license and requires macOS Sonoma or later.

Nanocoder is a terminal AI coding assistant for developers who want to choose which model works on their code. It can use local models through Ollama or send requests to a hosted provider through an OpenAI-compatible API.

Agency Orchestrator coordinates specialist AI roles for developers and solo builders working on product plans, research or content. A task description can become a team that divides the work and combines its results.

Claw Orchestrator gives developers one interface for multiple coding agents and checks their results independently. You define acceptance criteria, and the runtime executes the checks and keeps the evidence on disk.

search2ai is a self-hosted search gateway for developers adding web access to AI agents and chat clients. It connects your chosen search services through one interface, with backup providers when requests fail.

OpenVINO Model Server is a self-hosted inference server for developers and teams serving AI models on their own machines or servers. It uses OpenVINO to run workloads on x86 CPUs, including Xeon, with acceleration for Intel integrated and discrete GPUs and NPUs. It's open source under Apache 2.0.

FastChat is a self-hosted LLM platform for developers and researchers who want to serve chat models on their own hardware and compare their responses. It powers Chatbot Arena and includes a locally hosted side-by-side comparison interface. The Python code is open source under Apache 2.0; model licenses apply separately, including Llama's license for Vicuna.

FunASR is a speech-to-text toolkit for developers building transcription services and voice applications. It supports offline recordings and live speech on local hardware or self-hosted servers, with capabilities that depend on the model and runtime.

Codanna helps developers and AI coding agents explore a repository and assess which code a change could affect. It connects code search with function relationships, so an assistant can get context around a match in one response.

MDFlux is a desktop app for turning documents into structured Markdown for AI workflows, research, or text editing. It suits people who need usable text from mixed files and scanned archives while keeping conversion on their own machine.

WhisperSubTranslate is a free desktop app for creating translated SRT subtitles from video speech. It's for people who want to subtitle videos on their own computer, with offline transcription and translation after downloading the models.

Open Interpreter is a locally installed terminal coding agent for developers on macOS, Linux and Windows. It's a fork of OpenAI's Codex that focuses on adapting agent behavior to lower-cost models. Commands run on your computer inside native sandboxing; model requests go to your selected provider, so local installation alone doesn't mean local inference.

Aider is a terminal coding assistant for developers who want an LLM to make changes in a new or existing project. It works with local models and cloud services, and keeps code edits reviewable through Git.

LLPhant is a PHP framework for developers adding AI capabilities to Symfony and Laravel applications. It supports local model services and cloud providers, so you can choose where model requests run.

lm-evaluation-harness is a Python framework for researchers and developers comparing language models on shared benchmarks. Public prompts help make results comparable across model checkpoints and research papers.

ThunderAI is an AI email assistant for Thunderbird users who want help writing messages and managing their inbox. You can process email text with a local model or send it to a cloud provider.

LMMS Eval is a Python toolkit for researchers and model teams comparing AI models on text, image, video and audio tasks. It uses a shared evaluation pipeline to reduce differences caused by separate benchmark implementations.

NVIDIA NemoClaw is a self-hosted stack for people who want to run AI agents with controls over network access and credentials. It supports OpenClaw, Hermes and LangChain Deep Agents Code inside NVIDIA OpenShell sandboxes.

LibreChat is a self-hosted ChatGPT alternative for people and teams who want to use different AI providers in one chat workspace. It lets you switch models while keeping conversations in the same interface.

chatz is a self-hosted AI chat app that can display live charts, tables and status panels inside conversations. It's for individuals and teams who want to host their own chat interface, choose their model providers and connect tools. The app is open source under the MIT license.

TranscriptionSuite is a speech-to-text app for people recording lectures, transcribing conversations or dictating documents on their own hardware. Transcription works offline after the app and model downloads, keeping audio and transcripts local.

LocalAI is a self-hosted AI runtime for developers and teams that want to run models on their own hardware. It brings language, speech, vision and media generation into one server that existing AI applications can connect to.

OpenClaw.NET is a self-hosted AI agent runtime for a personal assistant or a shared team gateway. It's an independent .NET implementation inspired by OpenClaw, with compatibility for supported parts of that ecosystem.

Open Notebook is an alternative to Google's NotebookLM for researchers, students and professionals working with their own materials. It brings research and notes together while letting you choose what context an AI model can access.

CLODEx IDE is a desktop AI coding assistant for developers working on changes across multiple sessions. It keeps task history and workspace context across restarts, so you can return to unfinished work without rebuilding the task from chat messages.

Tessera is a self-hosted literature review workspace for researchers who want to find papers, keep reading notes and compare findings in one browser interface.

KServe serves LLMs and predictive machine learning models on your own Kubernetes infrastructure. It's for teams that need to put models from different frameworks into production through one serving platform.

Ellama is an AI assistant for Emacs users who want help with writing and code inside their editor. It handles requests about selected text as well as longer conversations and coding tasks that need several steps.

Twinny is an AI coding assistant for developers who want completion and help with their repository inside VS Code, using models on their own hardware or a chosen server.

LLM X is a browser chat interface for people running models on their own hardware. It brings multiple model servers into one place and lets you compare their responses within a conversation.

Lumina Note is a Markdown note-taking app for people who want AI help with writing and organizing a note collection. Its agent can work across the vault with your permission, while notes remain plain files you can edit and back up outside the app.

LiteRT-LM is Google's open-source framework for developers building apps that run language models on the user's device. It uses LiteRT for local inference across mobile devices, desktops and browsers, with GPU and NPU acceleration. The project uses the Apache 2.0 license.

fx is a coding agent for developers who prefer working in a terminal and researchers who want to embed an agent in their own software. Its shell-style interface keeps tool activity alongside the conversation and preserves terminal scrollback.

Auto Browser lets AI agents operate a live browser that a human can take over when a login or fragile page needs attention. It's built for internal dashboards, account workflows and operator-assisted browser QA.