AI Agent Frameworks, MCP Servers and SDKs

Plano, formerly Arch Gateway, is a self-hosted AI gateway for developers building applications with multiple agents or model providers. It puts routing, guardrails and request tracing in a separate service, so each agent doesn't need its own implementation of that infrastructure. It's open source under Apache 2.0.

Unstructured is a local document processing library for developers building LLM applications and document ingestion pipelines. It turns PDFs, Word documents, HTML, emails and images into document elements that applications can use. The Python library is open source under Apache 2.0 and runs on your own hardware, including through Docker images for x86_64 and Apple Silicon.

Morphik Core is a self-hosted multimodal retrieval engine for developers building AI applications around visually rich documents. It searches diagrams, schematics, charts, and datasheets alongside text, so applications can retrieve information that text extraction alone can miss. You can run it on your own server, including through Docker, or use Morphik's hosted service.

Prompt flow is an MIT-licensed, open-source toolkit for developers who build LLM applications and need to test their behavior before deployment. Its development tools run locally, while an optional cloud version in Azure AI supports team collaboration. Feature development has ended.

LiteRT is Google's open-source framework for developers building AI into apps that run on users' own devices. It succeeds TensorFlow Lite and covers model conversion, optimization and local inference. It's licensed under Apache 2.0.

gptme is a self-hosted AI agent that works directly in your terminal, with access to your files and installed tools. It's for developers who want a coding assistant in their own environment, and people who want an agent for data analysis or other knowledge work. The software is free under the MIT license and doesn't require a gptme account.

Laminar is an open-source platform for developers who need to see why an AI agent failed and check whether a fix worked. You can self-host it with Docker or on Kubernetes, including AWS and GCP, or use its managed cloud service. It uses the Apache 2.0 license.

xberg, formerly Kreuzberg, is a local document extraction engine for developers building AI search, document processing, and retrieval-augmented generation applications. It reads PDFs, Office files, scanned images, email, and nested archives, extracting text, tables, images, and metadata through one shared engine. It's open source under MIT.

CopilotKit is a self-hostable SDK for developers building AI agents into web and mobile apps, Slack, or Microsoft Teams. Agents can display interactive charts and forms using an app's own components, read shared app state, and take actions through frontend tools, APIs, or MCP tools.

Higress is a self-hosted AI gateway for developers and teams managing model APIs and the tools their AI agents call. It puts LLM traffic and MCP servers behind a shared entry point, with authentication, traffic controls and monitoring. The open-source edition uses the Apache 2.0 license and runs locally in Docker without registration. Alibaba Cloud also offers a fully managed gateway.

ScrapeGraphAI is an AI web scraping tool for developers who want to describe the data they need in plain language. Its open-source Python library runs on your own infrastructure under the MIT license. A separate managed API runs in ScrapeGraphAI's cloud.

MetaMCP is a self-hosted gateway for developers and teams who want to give AI clients access to several MCP servers through one endpoint. It runs on your own machine or server with Docker and is open source under the MIT license. You choose which tools clients see.

Curator is a Python library for developers preparing LLM training datasets or extracting structured records from existing data. It supports local inference through Ollama and vLLM alongside cloud model APIs, so the same data pipeline can use models on your hardware or a hosted provider. It's open source under Apache 2.0.

llama.rn brings llama.cpp into React Native apps so developers can run local LLM inference on iOS and Android. It's an MIT-licensed library for building AI features into a mobile app, with model processing on the device. It uses GGUF models and requires React Native's New Architecture.

OpenLLMetry adds LLM tracing to the OpenTelemetry monitoring stack a team already uses. It's for developers who need to follow model calls alongside database activity and API requests in their AI applications. The extensions run within your application and send standard OpenTelemetry data to your chosen monitoring destination.

Docker MCP Gateway gives developers one local connection point for the tools their AI applications use. It runs MCP servers in isolated Docker containers and shares their configuration across clients such as Claude Code, Cursor and Zed. This reduces repeated setup when several coding assistants need access to the same databases, APIs or development tools.

LangBot is a self-hosted AI agent platform for teams that want bots in the messaging apps their customers, coworkers or communities already use. It connects Slack, Discord, Telegram, WeChat and other chat services to models and AI workflows, with a browser dashboard for managing bots across platforms.

ChatDev is a self-hosted platform for building teams of AI agents through a visual workflow editor. It's for people who want agents to collaborate on research, data analysis or software projects without writing the orchestration code themselves. You define each agent's role and how information passes between them.

Postgres MCP Pro is a self-hosted MCP server that gives AI assistants access to PostgreSQL alongside tools for diagnosing slow queries and testing index recommendations. It's for developers and database maintainers who want their assistant to work with the database's actual schema, query statistics and execution plans. It runs through Docker or Python and is open source under the MIT license.

GitHub MCP Server is GitHub's official connector for developers who want their AI assistant to work with repositories and project activity. It gives compatible coding assistants access to GitHub through the Model Context Protocol (MCP), so they can retrieve context and take actions requested in natural language. The code is open source under the MIT license.

MetaGPT organizes AI agents into a software development team, with roles for product management, architecture, project management and engineering. It's a self-hosted Python framework for developers who want to generate software projects from plain-language requirements or build their own collaborative agents.

LiveKit Agents is a framework for developers building voice assistants, phone agents, and apps that combine speech with video or text. Agents join LiveKit rooms as participants, so they can interact with people through web and mobile apps or telephone calls. The Apache 2.0 project lets you run the entire stack on your own servers, including the LiveKit media server.

CAMEL is an open-source Python framework for developers and researchers building systems where AI agents work together. Its focus is on agent roles, communication, and behavior across extended tasks, with applications in synthetic training data, task automation, and simulated societies. It uses the Apache 2.0 license.

Rasa is an AI agent platform for product teams building customer-facing text and voice assistants. Teams can deploy agents on their own infrastructure and choose their models and data arrangements. Its CALM engine combines language model understanding with business flows whose code enforces rules, so an assistant can handle conversational wording while following defined processes.

ECC is a free, MIT-licensed open source toolkit that adds repeatable engineering workflows to coding assistants. It runs alongside your chosen agent and works with self-hosted models or cloud providers through that agent's supported endpoints. It's for developers who want planning, testing and review to follow a consistent process across coding sessions.

any-llm is a Python library for developers who want the same application to work with local LLM servers and cloud providers. It connects to Ollama and custom OpenAI-compatible endpoints, alongside OpenAI, Anthropic, Mistral and Azure / Microsoft Foundry. A shared interface reduces the provider-specific code needed to try another model or change where inference runs.

Chrome DevTools MCP gives AI coding assistants access to a live Chrome browser through a locally running MCP server. It's for developers who want their agent to inspect how a web app behaves, investigate errors and measure performance alongside its coding work. It works with clients such as Claude Code, Cursor, Copilot and Antigravity.

rerankers is a Python library for developers building search and retrieval systems who want to compare reranking models without rewriting their integration each time. It takes a query and candidate documents, then ranks their relevance through a shared interface across local models and hosted services. It's open source under Apache 2.0.

mcpo makes MCP tools accessible to AI agents and apps that accept OpenAPI servers, including Open WebUI. It's a self-hosted proxy for developers who want to use existing MCP servers with those apps without writing a separate adapter for each tool. You can run it locally or on your own server with Python or Docker. It's open source under the MIT license.

Latitude is a self-hosted AI agent monitoring platform for teams that need to find production failures and check that fixes work. It connects recurring problems to the sessions that caused them, then can dispatch Claude Code or Cursor with enough context to make a fix and open a pull request.

Distilabel is an open-source Python framework for engineers building datasets to train or evaluate AI models. It pairs synthetic data generation with LLM feedback, so a pipeline can create examples and judge their quality. It uses the Apache 2.0 license.

LLPhant is an MIT-licensed PHP framework for adding language models, embeddings and vector databases to Symfony and Laravel applications. It requires PHP 8.1 or later and is installed through Composer.

AstrBot brings AI assistants into messaging apps such as Telegram, Discord, Slack, QQ and WeCom. It's an open source platform under AGPL-3.0 for people building personal companions, customer support bots or team automation. You can run it on your own computer or server, including through Docker, or use its desktop app for browser-style chat.

Skills (mattpocock) is an MIT-licensed collection of engineering workflows for developers using Claude Code, Codex and other AI coding agents. Its small, separate skills work with any model and can be combined or adapted to your project, so you can choose specific practices without adopting an entire development process.

TEN Framework is a self-hosted framework for developers building voice AI agents and multimodal conversational apps. It focuses on low-latency, real-time conversations and supports both RTC and WebSocket connections. You can run its agent examples locally with Docker or deploy them on your own server.

Cheshire Cat is a self-hosted Python framework for people learning how AI agents work or building custom assistants for research and creative projects. It pairs a local web chat interface with an API, so you can test an agent in conversation and use it inside another application. It's open source under GPL-3.0.