Tools tagged with "OpenAI-compatible API"

Kiln is a desktop workbench for teams building and testing AI applications. Engineers, QA staff and subject matter experts can work with the same tasks and datasets, including contributing ratings and examples without writing code.

HiKid is a desktop app for children in non-English-speaking countries to practice speaking and listening. Kids talk with an AI in English through a microphone, without needing to type.

marimo is a Python notebook for data analysis, machine learning, and interactive experiments. It keeps results consistent as code changes, reducing the manual reruns and hidden state that can make notebooks hard to trust.

PasteGuard is a privacy proxy for teams that use AI with customer records, client files or project secrets. It runs locally or on your own server and checks requests before they reach a model provider.

Pooled runs a single open model across laptops, desktops and phones in browser tabs. It lets people combine their devices' memory to use a model that wouldn't fit on one device, for shared chat or coding tasks.

LocaLM runs AI models on your own hardware for chat and optional tasks such as coding, document questions and media generation. It's for people who want a single local tool and can choose which extra capabilities to add.

Whisper Local is a free, MIT-licensed dictation app for Windows and macOS, aimed at people who want voice typing without cloud processing. It's an alternative to Wispr Flow and Dragon that inserts speech into the active text field, including in chat apps, browsers and code editors. It doesn't require an account or API key.

GPT Pilot is a local AI coding agent for developers who want to build applications under human supervision. The project is no longer maintained, and its model calls rely on external providers.

Open-LLM-VTuber is an AI companion for people who want to talk with a customizable animated character. Local language and speech models let it work fully offline, with conversations staying on your device.

Marker is a local document converter for developers and teams preparing PDFs, scans and Office files for document processing or AI workflows. It extracts text while retaining structure such as tables, equations and page layout.

Haystack is a Python framework for developers building AI agents, document search and applications that answer questions using their own data. Its pipelines give teams control over the information a model receives and the steps that produce an answer.

TTS WebUI is a self-hosted browser interface for people creating speech and music or processing audio with AI models. It brings these tasks into one place, with model choices for different kinds of audio work.

llama-swap is a local AI proxy for people who want several models available to their apps without keeping them all loaded. It starts the server a request needs and replaces the active server when another model is requested.

Chidori is an AI agent framework for developers building long-running workflows that need crash recovery or human approval. Agents use ordinary async TypeScript, with saved runs that developers can revisit for debugging and testing.

Docker Model Runner lets developers run AI models on their own computers or servers and connect them to applications. It combines local inference with model distribution through container registries.

OlliteRT lets you use an Android phone as a private AI server for apps on your local network. It's for people who want to run models locally for chat clients or home automation without a cloud inference service.

Nexa SDK is an on-device AI framework for developers building apps that run models on users' hardware. It covers language, vision and audio tasks through a shared interface for local inference.

RuoYi AI is a self-hosted AI assistant platform for teams building assistants that answer questions about their documents or perform tasks with external tools. It has separate user and admin interfaces.

Sonar serves language and multimodal models for developers and teams running AI applications on their own hardware. It builds on vLLM and works with Hugging Face-compatible models.

OGX, formerly Llama Stack, is an AI application server for developers building chat apps, document search and AI agents. It brings model access and the services those applications need into a server you can host yourself.

TensorRT-LLM is an inference library for developers serving LLMs on their own NVIDIA GPUs. It supports application-level inference and server deployments, with performance optimizations for workloads spread across one or several machines.

Flexible GraphRAG is a self-hosted platform for teams building document search and AI chat that use both text and relationships between entities. It extracts knowledge graphs from documents and combines graph retrieval with vector similarity and full-text search. You can run it standalone or in Docker. It's open source under Apache 2.0.

gptel is an Emacs LLM client for people who want model responses alongside their writing and code. It connects to local inference backends including Ollama, llama.cpp, Llamafile and GPT4All. The client runs in Emacs; cloud connections such as OpenAI, Anthropic and Gemini send requests to those providers and require their credentials.

Kokoro-FastAPI generates speech on your own machine or server using Kokoro-82M. It's for developers adding narration to reading apps, audiobooks or voice assistants through an OpenAI-compatible speech API.

OpenLLM is a self-hosted LLM server for developers connecting applications to models on their own hardware or servers. Its OpenAI-compatible interface lets existing clients use those models without adopting a separate API.

Anarlog, formerly Hyprnote, is a desktop AI meeting notetaker for people who want to keep sensitive conversations on their own hardware. It's an open-source Granola alternative that combines personal notes with meeting transcripts.

Abogen turns books, documents and subtitle files into narrated audio for readers making audiobooks and creators producing voiceovers. It can generate matching captions or follow timestamps for timed narration.

Agenvoy is a personal AI agent for people who want to automate research, file work, and recurring tasks on their own computer. It runs continuously and retains context between sessions.

Riffado turns recordings from Plaud Note, Note Pro, and NotePin devices into searchable transcripts and summaries. It's for recorder owners who want control over AI processing and storage. Recording sync requires a Plaud account and access to Plaud's cloud, so the full workflow isn't offline.

TrendRadar collects news and trending topics for people tracking public opinion, industry developments, or specific interests. It brings feeds and platform rankings into one place so you can follow relevant stories without checking each site separately.

nanobot is a self-hosted personal AI agent for people who want an assistant that can act on files and continue work across conversations. Its Python framework also suits developers building their own assistant integrations.

Octop is a self-hosted AI assistant for households and small teams that want personal agents in a shared deployment. Each user can switch between specialists with separate workspaces, model connections and scheduled tasks.

RealtimeTTS is a Python text-to-speech library for developers building voice assistants and other apps that need spoken responses before the full text is ready. It accepts both complete text and incoming LLM output.

Atomic is a personal knowledge base for people who want to find connections across their notes and saved reading. It organizes Markdown notes, web clips, and articles into a knowledge graph you can search and explore.