Tools tagged with "OpenAI-compatible API"
1.5KUpdated 1 week agoMIT
macOS · Windows · Web#Agent Skills#Code execution#Hybrid search
Inno Agent is a personal AI learning agent for ongoing tutoring and study. It keeps learning goals, misconceptions and study materials available across conversations, with records you can inspect and correct.
19.4KUpdated 4 days agoApache-2.0
Web · Browser Extension#OpenAI-compatible API#Streaming inference#Structured output
WebLLM is an engine for developers building browser-based AI assistants and Chrome extensions. It runs language models on the user's device, so applications don't need a separate inference server to process prompts.
420Updated 2 days agoApache-2.0
macOS · Windows · Linux · Web#Batch processing#Guardrails#Human approval
ResumeForge is a Chinese-first workspace for job seekers who want to keep resumes, vacancies and interview preparation together on their own computer. It separates confirmed experience from AI-written wording to help catch invented claims.
257Updated 1 day agoApache-2.0
#Human approval#MCP#Multi-user access
Mattermost Agents adds AI assistants to a Mattermost workspace for teams working through long discussions and meeting recordings. Teams can use models on their own infrastructure or connect to a cloud provider.
679Updated 1 day agoBSD-3-Clause
macOS · Windows · Linux · iOS · Web#Agent Skills#GGUF#MLX
TensorSharp runs local AI models for .NET developers and people who want chat, media generation and agent tools on their own hardware. You can embed it in a C# application or use its CLI, browser interface or companion app, TensorAgent.
249Updated 4 days agoAGPL-3.0
macOS · Linux#Code execution#Git integration#Human approval
Orbi is a self-hosted AI coding agent for developers and teams who want GitHub backlog tasks carried through to reviewed pull requests and tagged releases. It runs on Linux or macOS, on your own computer or server. The macOS launchd scheduler is documented but has not yet been verified on real hardware. The open source core is free under AGPL-3.0.
46.9KUpdated 2 days agoAGPL-3.0
macOS · Docker · Web#Code execution#Hybrid search#LM Studio integration
AstrBot is an AI chatbot platform for personal assistants, customer support bots and team automation inside messaging apps. You can host it on your own computer or server and choose a local or cloud model backend.
475Updated 4 weeks agoMIT
Web#Batch processing#Code execution#LLM tracing
Procedura generates 3D assemblies for people who want to revise the resulting model in code. Each assembly is a parametric program with named parts and defined connections, so you can edit its source and compile the geometry again.
2KUpdated 4 months agoMIT
Windows#Code execution#Knowledge graphs#MCP
Context+ is a local MCP server for developers who want coding assistants to find relevant code and understand the effects of a change across a large project. It works with Claude Code, Cursor, VS Code, Windsurf and OpenCode.
16Updated 6 days agoApache-2.0
Docker#Guardrails#llama.cpp backend#LM Studio integration
LLM Router is a self-hosted AI gateway for teams connecting applications to local LLM servers and cloud providers. It puts a shared interface in front of your models so clients can use the same gateway across backends.
2Updated 3 months agoMIT
Docker · Web#llama.cpp backend#LM Studio integration#MLX
Deep Research is a self-hosted AI agent for people who want web research with traceable evidence and a library they control. It runs in Docker on your own machine or server, searches the web in successive rounds, and uses gaps in its findings to decide what to investigate next. Reports include citations, per-source notes with quoted evidence, and suggested follow-ups.
685Updated 1 day agoGPL-3.0
Docker#Batch processing#Multilingual#OpenAI-compatible API
RSSBox helps people follow foreign-language news through translated RSS feeds. It combines translation, article filtering and daily digests for readers who want to manage multiple sources in one self-hosted service.
8.5KUpdated 21 hours ago
#Distributed execution#Multimodal input#OpenAI-compatible API
NVIDIA Dynamo is a self-hosted inference framework for teams serving generative AI models across multiple GPUs or server nodes. It coordinates inference engines so teams can manage capacity, response latency and cached context across a cluster.
24.5KUpdated 2 days agoMIT
macOS · Windows · Linux#Hybrid search#Knowledge graphs#Multimodal input
RAG-Anything is a Python framework for developers building question-answering systems over documents that mix prose with visual or structured content. Built on LightRAG, it suits research papers, technical manuals and financial reports where answers depend on figures, tables or formulas.
1.3KUpdated 1 month agoGPL-3.0
Android#LLM tracing#MCP#Ollama integration
GPT Mobile is an Android AI chat app for people who want to compare model responses in one conversation. It connects to your chosen providers using your own API keys and can work with models served through Ollama.
437Updated 5 months agoMIT
Windows · Linux#Multilingual#Ollama integration#OpenAI-compatible API
VoiceFlow is a dictation app and meeting recorder for developers and anyone who wants to turn speech into text without cloud transcription. It inserts dictated words into text fields across your computer and transcribes recorded calls locally.
1.8KUpdated 1 day agoMIT
macOS · Windows#GGUF#Hugging Face integration#llama.cpp backend
Llama Desktop runs language models on your computer for private chat and use in other apps. It's for people who want a local ChatGPT alternative and developers connecting coding agents, editors or scripts to their own models.
1.7KUpdated 1 day ago
Windows · Browser Extension#Human approval#llama.cpp backend#LM Studio integration
WebBrain is an AI browser agent for people who want to ask questions about pages or delegate web tasks from a sidebar. It works in your existing browser, including signed-in tabs, and starts in read-only Ask mode.
1.3KUpdated 1 day agoMIT
macOS · Windows · Linux · Docker · Web#Guardrails#llama.cpp backend#LLM tracing
GoModel is a self-hosted AI gateway for developers and platform teams sharing access to local models and cloud providers. It centralizes provider choice and usage policies behind APIs compatible with OpenAI and Anthropic SDKs.
1.1KUpdated 1 month agoMIT
#Agent Skills#Code execution#Human approval
Pydantic DeepAgents is a terminal coding assistant and Python framework for developers who want to use or build their own AI agents. Both share a Pydantic AI foundation for carrying out tasks across files and tools.
1.6KUpdated 2 weeks agoApache-2.0
Docker · Web#Context compression#MCP#Multi-user access
DEEIX Chat is a self-hosted AI workspace for individuals and teams that want one place to use multiple model providers. It combines everyday chat with controls for organizations managing shared model access and usage.
4.8KUpdated 20 hours agoMIT
Web#AI red teaming#Browser automation#OpenAI-compatible API
PyRIT is an open-source Python framework for testing generative AI systems, with a self-hosted CoPyRIT browser interface. Its backend serves the interface locally, and Docker deployment is available. Targets and scorers use configured endpoints, including Ollama or cloud providers. The documented OpenAI configuration sends requests to OpenAI; hosting the testing interface locally does not make every model local.
1.7KUpdated 1 week agoApache-2.0
macOS#Batch processing#MLX#Multimodal input
vllm-mlx is a local LLM inference server for developers who want to connect AI apps and coding assistants to models running on an Apple Silicon Mac. One process exposes both OpenAI-compatible and Anthropic-compatible APIs. It's open source under Apache 2.0 and runs on macOS with at least 8 GB of unified memory.
3.7KUpdated 2 days agoMIT
macOS · Windows · Linux · Web#Guardrails#Human approval#Multilingual
Vibe-Research is a local financial research workbench for individual investors, with a Chinese-language browser interface and backend on your computer. It saves documents, research records and task state locally, while subscription services or model APIs supply AI reasoning. Relevant document passages go to the selected model, so local storage doesn't make the workflow offline.
3Updated 5 months agoMIT
macOS · Windows · Linux#Multilingual#Ollama integration#OpenAI-compatible API
Murmur is a desktop dictation app for people who want to speak into the apps they already use. It turns speech into text and inserts it at the cursor.
28.8KUpdated 21 hours agoApache-2.0
Docker · Web#Batch processing#LLM tracing#MCP
MLflow helps developers and teams inspect AI applications, compare changes and track model experiments. It brings agent debugging and evaluation into a platform you can run locally or on your own servers.
7.1KUpdated 3 weeks agoApache-2.0
Docker#Guardrails#LLM tracing#Multi-agent workflows
Plano is a self-hosted AI gateway for developers building applications with multiple agents. It handles shared routing, orchestration and monitoring outside the agents, so developers don't need to build those functions into each one.
11.4KUpdated 21 hours agoApache-2.0
macOS · Linux · iOS · Android · Web#Code execution#Guardrails#Human approval
Omnigent coordinates AI agents for developers and teams who want to combine coding assistants, control their access, and supervise work in shared sessions. It runs locally or on a self-hosted server, with remote cloud sandboxes as another option.
8.2KUpdated 18 hours agoMIT
macOS · Windows#Agent Skills#Code execution#Human approval
Osaurus runs AI agents on your Mac for tasks such as reviewing documents, organizing files, and writing code. It keeps agent memory on your computer, so you can change models without losing the context of your work.
1.9KUpdated 2 days ago
macOS · Windows · Linux · iOS · Android · Web#Agent Skills#Code execution#Human approval
Halo is a desktop AI workstation for people who want agents to write code, manage files and handle recurring work through a visual interface. You can switch between Claude Code and Codex within the same app.
2.6KUpdated 1 day agoAGPL-3.0
macOS · Windows · Linux · Docker · Web#Batch processing#llama.cpp backend#LM Studio integration
Translate Books With LLMs translates books, documents and subtitles using a local or cloud model. It's for readers and translators working with long texts who need formatting and terminology to carry through the translation.
86Updated 19 hours agoApache-2.0
macOS · Windows · Linux · Web#Distributed execution#MCP#OpenAI-compatible API
SwarmLLM is a ChatGPT alternative for people who want to run AI models on their own hardware. It can use a single computer or combine several machines to handle a model that won't fit on one.
843Updated 3 months agoMIT
Docker#LM Studio integration#Multi-user access#Multimodal input
llmcord is a self-hosted Discord bot for people who want to share AI conversations with friends or a community. It connects Discord chats to local models or remote providers. Conversation history stays in Discord, even when the model runs on your own hardware.
2.3KUpdated 2 days agoApache-2.0
#Ollama integration#OpenAI-compatible API#Tool calling
any-llm is a Python library for developers building applications that need to work with different LLM providers. A shared interface reduces the provider-specific code needed to switch between local servers and cloud APIs.