Tools tagged with "OpenAI-compatible API"

PicoClaw is a self-hosted personal AI assistant that can use local models through Ollama or vLLM. It's aimed at people who want an agent on their own hardware, including small Linux boards and Android phones. Hosted providers are optional, but choosing OpenAI, Anthropic, Google Gemini or DeepSeek sends model requests to those services and requires internet access and API keys.

Kelivo is an LLM chat client for people who want local and cloud models in one app while keeping conversation history on their device. It connects to Ollama, self-hosted OpenAI-compatible services and providers including OpenAI, Gemini, Claude, DeepSeek and OpenRouter.

OpenPipe ART is a Python framework for developers who want to train multi-step AI agents on the tasks their applications actually perform. It uses reinforcement learning through GRPO (Group Relative Policy Optimization) to improve model behavior based on experience and task rewards. It's open source under Apache 2.0.

WhisperLive turns speech into text as audio arrives, using OpenAI's Whisper models. It's for developers and teams who want to run transcription on their own machine or server and connect it to live audio or recorded files.

AI Notebook is a desktop research notebook for asking questions about your own documents and checking the passages behind the answers. It suits people who want a local NotebookLM alternative with their research and notes in one workspace.

Octipus is a self-hosted AI workspace for people who want agents to work on code, research, and recurring tasks while keeping the results open to review. A lead agent can use tools itself or assign bounded work to specialist agents. You can inspect the sources, changes, checks, and execution records behind an answer.

olmOCR converts scanned and image-based documents into text for researchers and developers preparing LLM datasets. It handles pages whose layout makes ordinary text extraction difficult.

Magnitude is a local LLM engine for people who want to run AI agents on their own hardware. It adapts model execution to your machine and connects to coding assistants you already use.

GPT4All is a local AI chatbot for people who want language models and document conversations on their own computer. Model inference and LocalDocs processing run on the device without a cloud connection.

NextChat is an AI chat interface for people who want to use self-deployed LLMs and cloud models in one application. It connects to LocalAI and RWKV-Runner, and supports OpenAI, Claude, Google Gemini and DeepSeek.

Obsidian Local GPT is an AI writing assistant for people who keep their notes in Obsidian. It helps you work with selected text and related notes, using local models or a remote AI service.

Crush is a terminal AI coding assistant for developers who want an agent to work with their code and existing tools. The application runs on your machine; your chosen backend determines where model requests go.

Dive is a desktop AI agent for people who want a language model to work with files, shell commands and connected tools. It supports models with function calling and acts as a host for Model Context Protocol (MCP) servers.

Navigator is a self-hosted AI workspace for individuals and teams who want assistants to carry out tasks through connected tools. It combines chat with custom agents and reusable visual workflows.

MiniCPM is a family of compact language models for developers building local assistants and coding agents. It targets on-device workloads and hardware with limited computing resources.

OpenCrust is a self-hosted AI assistant platform for people who want agents to handle tasks through their messaging apps. Named agents can pass work to one another and retain conversation memory between sessions.

Helix is a paid, self-hosted platform for engineering teams coordinating coding agents. Agents work on separate tasks in parallel, while the team shares a view of their progress and reviews their work.

TradingAgents is an open-source Python framework for researchers and developers studying AI trading decisions. It assigns market analysis and risk assessment to separate LLM agents, then combines their findings into a proposed trade for a simulated exchange.

llm-fw inspects model requests for developers and teams using AI tools, SDKs and agents. It blocks suspected prompt injection and removes outgoing secrets before forwarding approved traffic to the model endpoint.

RecurseChat is a Mac app for people who want private AI conversations and answers drawn from their own documents. Local models run without an internet connection or a separate server.

PentAGI automates authorized penetration testing for security engineers, researchers and red teams. Its specialized AI agents turn a target and a plain-language goal into testing work you can follow through a web interface.

LEANN is a local vector database for people building AI search over personal data or knowledge collections. It reduces index storage by computing embeddings on demand rather than keeping every embedding on disk.

NVIDIA Cosmos provides world models for developers building robots, autonomous vehicles and industrial vision systems. It supports reasoning about physical scenes, generating training data and learning actions before real-world deployment.

SenseVoice is a local speech recognition model for developers building voice apps or analyzing recordings. Its SenseVoiceSmall model adds information about the language, emotion and surrounding sounds to speech transcriptions.

Dictate Keyboard is a voice keyboard for people who prefer speaking to typing in Android apps. It builds on FlorisBoard and lets you choose where speech recognition happens.

Aiursoft Ollama Gateway gives teams controlled access to shared local LLM servers. It connects AI applications and coding assistants to Ollama or OpenAI-compatible backends through a central gateway.

OpenUI is an AI UI builder for developers prototyping web components. Describe an interface in plain language, inspect the rendered result, and ask for changes before taking the code into a project.

ThinkRAG answers questions about your own documents using a knowledge base on your laptop. It's for researchers, students and other knowledge workers who want to find information across their files, with particular attention to Chinese text.

DataTrove is a Python library for teams preparing large text datasets, including LLM training corpora. It combines reusable processing blocks with custom cleanup logic, so teams can apply their own rules across large workloads.

aionrs is a command-line AI agent for developers who want an assistant to work on local projects. It can carry out coding tasks across multiple steps using a model provider you choose.

subgen creates subtitles from audio and video for personal media libraries. It's useful for films and shows that lack usable subtitles, with automatic generation tied to your media server.

LLaMA-Factory is a local model training platform for developers and researchers who want to adapt pretrained models to their own tasks. Its web UI lets you fine-tune models without writing code.

Deltafin runs full Kimi K3 on a single device for researchers and developers exploring large models on their own hardware. It preserves the original expert weights and complete expert bank, but responses are slow and long conversations take substantially longer than short completions.

JoyCaption generates image descriptions for people preparing datasets to train or fine-tune diffusion models. It can caption images on your own GPU, reducing the work of writing training descriptions by hand.