Tools tagged with "OpenAI-compatible API"

Resume AI helps job seekers write resumes for specific roles and keep them alongside their job applications. It combines resume editing with an application board, so each role can have its own saved drafts.

Utsuwa is an AI companion for people who want a virtual character that remembers their conversations. It combines a 3D avatar with voice chat and optional relationship progression inspired by dating sims.

MCP Gateway & Registry gives platform teams a shared catalog and access gateway for the tools their AI agents and coding assistants use. It addresses scattered server connections, credentials and access policies across an organization.

Atomic Chat is a local LLM app for people who want to chat with models on their own device or use them with coding assistants and AI agents. It began as a fork of Jan by Menlo Research.

LLMKube manages self-hosted LLM inference for teams and homelab owners who need several machines to serve models together. It brings Linux GPU servers and Apple Silicon Macs into the same Kubernetes-managed fleet.

MLX VLM is a Python package for developers and researchers who want to run multimodal models on their own Mac. It supports local inference and fine-tuning through MLX.

Falcon-H1 is a family of language models from the Technology Innovation Institute for developers building AI applications on their own hardware. Smaller models suit edge devices, while larger variants target server deployments.

CliRelay is an AI gateway for teams that want to manage coding assistants through a shared service on their own server. It builds on CLIProxyAPI and brings subscription accounts and provider API keys under central control.

MLX Audio is a Python library for developers building speech and audio applications on Apple Silicon Macs. It runs models locally using Apple's MLX framework, with support for generated speech, transcription and audio processing.

LocalWriter adds AI writing assistance inside LibreOffice Writer for people who want to draft and revise text within their documents. It works with selected passages and requires a separate language model runner.

Langroid is a Python framework for developers building applications where AI agents divide up a task. Each agent can maintain its own conversation and use documents or tools, then delegate work to other agents.

Agentgateway is an open-source proxy for platform teams connecting applications and agents to models, tools and other agents. It brings routing and access controls together across AI protocols and ordinary service traffic.

MetaGPT is a Python AI agent framework for developers who want to generate software projects using local models through Ollama or remote model APIs. The framework runs on your machine and writes a project repository locally. Its example configuration uses OpenAI, which sends model requests to that provider and requires API credentials.

Vane is a self-hosted AI search engine for people who want answers backed by sources they can check. It combines web research with a choice of local or cloud models and saves search history locally.

Zep Community Edition is a self-hosted memory service for developers building AI agents and conversational assistants. It turns chat history into connected facts so an assistant can recall context across conversations and distinguish current preferences from older ones.

Jan is a desktop AI chat app for people who want to run models on their own computer while retaining the option to use cloud providers. Local model use works offline; choosing a hosted model sends requests to that provider.

GuideLLM benchmarks LLM deployments so engineering and ML teams can assess capacity and response times under expected traffic. It can test self-hosted servers through OpenAI-compatible or vLLM-native interfaces.

NullClaw runs AI agents on your own hardware or server for coding work and automated background tasks. It's aimed at developers who want an assistant that can carry out multi-step jobs with controls over its access and actions.

Fabric organizes reusable AI prompts by task for people who want repeatable ways to analyze content, write, or work with code. Its community-contributed prompts, called Patterns, provide a starting point without requiring you to write each prompt yourself.

Nox is a security scanner for developers building LLM applications, RAG systems and agents with tool access. It traces untrusted input into model calls and model output into dangerous operations, including paths across functions and files.

Super Agent Party is an AI companion platform for people who want a desktop character that can also carry out tasks. It combines character conversations with agents that operate applications and interact through messaging or live streams.

PotPlayer ChatGPT Translate translates existing subtitles inside PotPlayer during video playback. It's for viewers who want AI translation with a choice of a local model or a hosted API.

Slotstream runs Qwen3.8-Flash-Next on Apple Silicon Macs with too little RAM to hold the whole model. It's aimed at Macs with 16 to 64 GB of memory, for people who want local chat, answers about pictures or a backend for coding assistants.

Nativ is a macOS app for people who want AI chat and coding tools to use models running on their own Mac. It combines a chat workspace, model library, and local inference server.

VideoLingo is a video translation app for creators and educators producing bilingual subtitles or dubbed videos. Its self-hosted browser interface brings transcription, translation and subtitle preparation into one workflow, though the selected providers determine which processing stays local.

PenguinHarness builds runnable AI agent applications from plain-language requirements on your computer or server. It's for developers who want agents to handle app creation, evaluation, tuning and deployment.

KubeAI is a Kubernetes operator for teams serving AI models on their own infrastructure or cloud clusters. It manages model servers and adjusts capacity to demand, including starting models from zero running replicas.

Obsidian Copilot is an AI plugin for writers and researchers who want to work with the notes already in their vault. Its agents can find relevant material, draft notes and organize research inside Obsidian.

Ollama runs open models for people who want local AI applications, model chat or a backend for coding assistants. It provides a command-line interface and an API, with a choice between inference on your hardware and its cloud service.

DeskTranslate translates text visible in games, videos, menus and images for people who want to read it without switching applications. It can translate a single selection or follow changing dialogue in a chosen screen region.

Atlas Note combines a self-hosted note library with AI search and answers that cite your notes. It's for people keeping meeting records, project notes or personal reference material who want to find related information without remembering exact wording. The browser interface runs on your own Docker-hosted server, and the project is open source under the MIT license.

LLM is a command-line tool and Python library for developers who want to use language models in terminal workflows or applications. It supports models running on your machine alongside remote providers such as OpenAI, Anthropic and Google.

exo is a local LLM runner for people who want to run models too large for a single machine's memory. It joins devices into a cluster and runs inference on your own hardware.

SeekerClaw runs a personal AI agent on Android phones for people who want recurring tasks, device control and Solana wallet actions through Telegram or Discord. The agent stays active in the background and uses Claude, OpenAI, OpenRouter or an OpenAI-compatible gateway for its AI engine.