Tools tagged with "OpenAI-compatible API"

400+ tools
A self-hosted AI learning agent with editable learner memory, a study wiki and scheduled review, supporting Ollama alongside cloud model providers.

1.5KUpdated 1 week agoMIT

macOS · Windows · Web#Agent Skills#Code execution#Hybrid search

Favicon of WebLLM

WebLLM

2 videos
An open-source local LLM engine that runs models in the browser with WebGPU acceleration, an OpenAI-compatible API and custom MLC models.

19.4KUpdated 4 days agoApache-2.0

Web · Browser Extension#OpenAI-compatible API#Streaming inference#Structured output

A local AI resume builder links job tracking and interview practice, with offline exports and support for Ollama or LM Studio.

420Updated 2 days agoApache-2.0

macOS · Windows · Linux · Web#Batch processing#Guardrails#Human approval

An AI agent plugin for self-hosted Mattermost summarizes conversations and recordings, with support for Ollama, vLLM and cloud providers.

257Updated 1 day agoApache-2.0

#Human approval#MCP#Multi-user access

A local AI inference engine for GGUF models, with C# integration, browser chat, and Ollama- and OpenAI-compatible APIs on Windows, macOS and Linux.

679Updated 1 day agoBSD-3-Clause

macOS · Windows · Linux · iOS · Web#Agent Skills#GGUF#MLX

Self-hosted AI coding agent for GitHub Issues. Runs on Linux or macOS with local models or OpenAI-compatible APIs; free under AGPL-3.0.

249Updated 4 days agoAGPL-3.0

macOS · Linux#Code execution#Git integration#Human approval

Favicon of AstrBot

AstrBot

2 videos
A self-hosted AI chatbot platform that connects messaging apps to Ollama, LM Studio or cloud models, with agent tools and knowledge bases.

46.9KUpdated 2 days agoAGPL-3.0

macOS · Docker · Web#Code execution#Hybrid search#LM Studio integration

Favicon of Procedura

Procedura

1 video
A local AI 3D modeling tool creates editable parametric assemblies from text or reference images using local or cloud model backends.

475Updated 4 weeks agoMIT

Web#Batch processing#Code execution#LLM tracing

A local MCP server gives coding assistants semantic code search, dependency tracing and linked memory, with Ollama or OpenAI-compatible APIs.

2KUpdated 4 months agoMIT

Windows#Code execution#Knowledge graphs#MCP

A self-hosted AI gateway connects Ollama, vLLM, llama.cpp, LM Studio and cloud APIs, with optional PII masking, routing and provider failover.

16Updated 6 days agoApache-2.0

Docker#Guardrails#llama.cpp backend#LM Studio integration

Self-hosted AI research agent with cited reports, a searchable library, and local LLM support through Ollama, LM Studio, llama.cpp, or MLX. MIT licensed.

2Updated 3 months agoMIT

Docker · Web#llama.cpp backend#LM Studio integration#MLX

A self-hosted RSS translator that filters articles, creates AI daily digests, and publishes translated feeds in RSS or JSON.

685Updated 1 day agoGPL-3.0

Docker#Batch processing#Multilingual#OpenAI-compatible API

A self-hosted inference framework that coordinates NVIDIA GPU clusters with SGLang, TensorRT-LLM or vLLM and provides an OpenAI-compatible API.

8.5KUpdated 21 hours ago

#Distributed execution#Multimodal input#OpenAI-compatible API

Favicon of RAG-Anything

RAG-Anything

2 videos
A Python RAG framework builds searchable document collections from text, images, tables and equations, using LightRAG and vision models.

24.5KUpdated 2 days agoMIT

macOS · Windows · Linux#Hybrid search#Knowledge graphs#Multimodal input

An open-source Android AI chat client that gets replies from multiple models at once, supports Ollama, and stores chat history locally.

1.3KUpdated 1 month agoGPL-3.0

Android#LLM tracing#MCP#Ollama integration

Offline voice-to-text and meeting recorder for Windows and Linux, with local Whisper transcription and optional summaries via Ollama or cloud providers.

437Updated 5 months agoMIT

Windows · Linux#Multilingual#Ollama integration#OpenAI-compatible API

A local LLM runner for macOS and Windows 11 that provides offline chat, GGUF model support and OpenAI- and Anthropic-compatible APIs.

1.8KUpdated 1 day agoMIT

macOS · Windows#GGUF#Hugging Face integration#llama.cpp backend

An AI browser extension that reads pages and automates tasks in Chrome, Firefox and Edge, with offline local models or cloud APIs.

1.7KUpdated 1 day ago

Windows · Browser Extension#Human approval#llama.cpp backend#LM Studio integration

A self-hosted AI gateway connects local and cloud models through OpenAI- and Anthropic-compatible APIs, with caching, failover and usage tracking.

1.3KUpdated 1 day agoMIT

macOS · Windows · Linux · Docker · Web#Guardrails#llama.cpp backend#LLM tracing

A self-hosted coding assistant and Python agent framework that branches runs to compare approaches and supports local models through Ollama.

1.1KUpdated 1 month agoMIT

#Agent Skills#Code execution#Human approval

A self-hosted AI workspace combines multi-provider chat, file retrieval and MCP tools with team administration under the Apache 2.0 license.

1.6KUpdated 2 weeks agoApache-2.0

Docker · Web#Context compression#MCP#Multi-user access

Favicon of PyRIT

PyRIT

1 video
AI red teaming framework with a self-hosted browser GUI, multi-turn attacks and response scoring. Configure Ollama or cloud model endpoints.

4.8KUpdated 20 hours agoMIT

Web#AI red teaming#Browser automation#OpenAI-compatible API

Favicon of vllm-mlx

vllm-mlx

1 video
Local LLM inference server for Apple Silicon Macs with OpenAI and Anthropic APIs, MLX GPU acceleration, and an Apache 2.0 license.

1.7KUpdated 1 week agoApache-2.0

macOS#Batch processing#MLX#Multimodal input

A local AI financial research workbench for Windows 11, macOS and Linux. Keeps original documents locally and sends relevant passages to your AI provider.

3.7KUpdated 2 days agoMIT

macOS · Windows · Linux · Web#Guardrails#Human approval#Multilingual

A local dictation app that runs Whisper on macOS, Windows and Linux, with text cleanup, searchable history and optional remote transcription.

3Updated 5 months agoMIT

macOS · Windows · Linux#Multilingual#Ollama integration#OpenAI-compatible API

Favicon of MLflow

MLflow

6 videos
An open-source, self-hosted AI engineering platform for agent tracing, LLM evaluation and model tracking, with Ollama support and an AI gateway.

28.8KUpdated 21 hours agoApache-2.0

Docker · Web#Batch processing#LLM tracing#MCP

A self-hosted AI gateway that coordinates agents, routes LLM requests and captures OpenTelemetry traces, with an Apache 2.0 license.

7.1KUpdated 3 weeks agoApache-2.0

Docker#Guardrails#LLM tracing#Multi-agent workflows

Favicon of Omnigent

Omnigent

4 videos
An open-source AI agent framework that combines Claude Code, Codex and custom agents, with local sandboxes, access policies and shared sessions.

11.4KUpdated 21 hours agoApache-2.0

macOS · Linux · iOS · Android · Web#Code execution#Guardrails#Human approval

A local AI agent app for Mac that works offline, remembers conversations across models, and asks before editing your files.

8.2KUpdated 18 hours agoMIT

macOS · Windows#Agent Skills#Code execution#Human approval

A desktop AI workstation runs Claude Code and Codex on macOS, Windows and Linux, with API-based model access, browser automation and remote control.

1.9KUpdated 2 days ago

macOS · Windows · Linux · iOS · Android · Web#Agent Skills#Code execution#Human approval

An open-source AI book translator that supports EPUB, PDF, DOCX, TXT and SRT, with local models through Ollama and optional cloud providers.

2.6KUpdated 1 day agoAGPL-3.0

macOS · Windows · Linux · Docker · Web#Batch processing#llama.cpp backend#LM Studio integration

A local LLM chat app that pools computers to run larger models, with OpenAI-compatible and Anthropic APIs on Windows, Linux and Apple Silicon Macs.

86Updated 19 hours agoApache-2.0

macOS · Windows · Linux · Web#Distributed execution#MCP#OpenAI-compatible API

A self-hosted Discord LLM bot connects shared conversations to Ollama, LM Studio or OpenAI-compatible cloud APIs and lets people branch discussions.

843Updated 3 months agoMIT

Docker#LM Studio integration#Multi-user access#Multimodal input

A Python LLM library that connects to Ollama, custom OpenAI-compatible servers and cloud providers through a shared API, under Apache 2.0.

2.3KUpdated 2 days agoApache-2.0

#Ollama integration#OpenAI-compatible API#Tool calling

Favicon of LogotyperLogotyper
Got an idea for an AI tool? I'm Eugene, the designer and developer behind Localhosted. I'll help you build it, from the first sketch to launch.
Start your project
Favicon of Logotyper
Favicon of LogotyperLogotyper
Got an idea for an AI tool? I'm Eugene, the designer and developer behind Localhosted. I'll help you build it, from the first sketch to launch.
Start your project
Favicon of Logotyper