Tools tagged with "OpenAI-compatible API"

Hollama is an LLM chat interface for people who want to use Ollama or OpenAI servers through a browser. It supports multiple server connections, so you can keep access to different model servers in one app.

Grist is a relational spreadsheet for teams building shared data tools beyond a flat grid. Linked tables, typed columns and custom layouts let users organize records into applications for their own workflows.

llama.cpp is a local LLM inference engine for developers building AI applications or running models on hardware they control. It supports language and vision-language models, with command-line tools and a server API for using the engine directly or connecting other software.

Soup is a local LLM fine-tuning tool for developers and teams adapting models to their own datasets. It brings training, evaluation and export into one workflow that runs on your own hardware without requiring a cloud service.

Manifest LLM Gateway connects AI agents and apps to local models, cloud providers and subscriptions through a shared endpoint. It's for builders and teams who want to choose where requests go, handle provider failures and track inference usage.

llama-cpp-python is for developers adding local LLM inference to Python applications or connecting existing API clients to models on their own hardware. It brings llama.cpp into a Python library and a self-hosted server.

Pictaria Server helps Immich users explore their photo library, choose photos to keep and organize albums through a browser dashboard on their own hardware.

MS Agent is an open source Python agent framework with a self-hosted web server for working on local projects. It's for developers building research assistants and coding workflows that continue across sessions. Code execution and project file work run locally; the default model integration uses ModelScope's API and requires an API key and internet access.

OpenDev is an AI coding agent for developers who want concurrent work across a codebase and control over which models handle each task. It can plan changes, execute them and iterate autonomously, with a terminal interface and a browser interface for monitoring work.

AI Documentation Generator analyzes repositories and writes documentation for developers who need to understand an unfamiliar codebase or prepare it for new contributors. It's open source under the MIT license and runs as a Python application, in Docker, or through a Claude Code plugin.

Graphiti is a Python framework for developers building AI agents that need to remember information as it changes. It turns conversations, structured records and unstructured text into a queryable graph with a history of facts.

WhisperLiveKit is a self-hosted speech-to-text server for meeting transcripts, live captions and apps that need speech recognition as people talk. It processes audio on your own machine or server.

Askimo is an AI desktop app for people who want to ask questions about their files and delegate work from the same place they chat. It supports local LLM backends and cloud providers, including Ollama, LM Studio, OpenAI, Claude and Gemini.

smolagents is a Python AI agent library for developers building software that uses tools and calculations to complete tasks. Its CodeAgent writes and executes Python actions, combining tool calls with loops and conditional logic.

MindMac is a native macOS AI chat client for people who want local models and cloud providers in one app. Its inline mode lets you get writing help inside Notes, Mail and browsers without switching to a separate chat window.

fcitx5-vinput adds voice typing to Fcitx5 on Linux. It's for people who want to dictate text and use spoken instructions to edit it, with a choice between local speech recognition and cloud services.

jcode is a terminal AI coding assistant for developers who want to choose their model provider and carry useful context between conversations. It supports local and self-hosted model endpoints alongside cloud services.

MLX Omni Server lets developers use local models through both OpenAI-compatible and Anthropic-compatible APIs on an Apple Silicon Mac. It's for applications built around those SDKs that need inference on hardware the developer controls. Apple's MLX framework provides hardware acceleration, and all AI processing stays on the Mac.

Prompty is a prompt format and developer toolkit for building AI applications. It keeps prompt text, model settings, inputs and tool definitions in a portable Markdown file that developers can share across editors and language runtimes.

Conduit is a native mobile AI client for people who want access to their self-hosted models and agents from an iPhone or Android phone. It can connect through Open WebUI or directly to a model endpoint.

Marginalia is a research agent for people whose papers, notes and working files are spread across a mixed document library. It reads relevant parts of the original files before writing answers with citations.

OpenRLHF is a self-hosted Python framework for researchers and teams training language models with human feedback or custom rewards. It supports fine-tuning and reinforcement learning on your own GPU hardware, including training agents that interact with an environment.

HuggingChat UI is a browser-based ChatGPT alternative for people and teams who want to host their own chat service. It's the application behind Hugging Face's hosted HuggingChat, and it connects to a separate model backend.

Oleafly is a desktop editor for researchers writing papers, theses and other long documents in LaTeX, Typst or Markdown. It brings the manuscript, PDF preview and research tools into one workspace, with projects stored as ordinary files you own.

MacWhisper turns recordings into editable transcripts for people working with interviews, lectures, podcasts and meetings. Local transcription works offline and keeps the audio on your Mac.

WeChat Bot is a self-hosted AI agent for people who want automated replies across messaging apps and tools to examine their WeChat conversations. It builds on Wechaty and can use local models through Ollama or external AI services.

Unlimited-OCR is an OCR model for developers building document extraction workflows on their own hardware or servers. It handles individual document images and multi-page inputs, including PDFs converted to page images.

FastDeploy is a self-hosted inference toolkit for teams deploying language and vision-language models on Linux servers. Built on PaddlePaddle, it supports offline inference and online serving.

Scriberr transcribes recordings locally for people who want to review meetings and voice notes without uploading audio to a cloud service. It combines transcription with playback, annotations and optional questions about the recorded conversation.

Presenton is an AI presentation maker for teams turning reports and source documents into decks, and developers adding slide generation to their apps. It can reuse an existing PowerPoint design so generated presentations follow your own layouts.

LLM Wiki is a desktop AI knowledge base for people building a research library or personal reference collection. It creates lasting, linked pages from your documents and updates them as your sources change.

Harbor helps people experiment with local LLMs by connecting model backends, chat interfaces and supporting services. Its CLI and companion app manage those connections in a shared development environment.

Page Assist is a browser extension for people who run AI models locally and want to use them while browsing. It lets you ask questions about a page without leaving it or open a separate tab for longer conversations.

Curator is a Python library for developers building LLM training datasets or extracting structured records from existing data. It supports pipelines that generate data in stages and process many model requests.