AI Agent Frameworks, MCP Servers and SDKs

OpenLLMetry helps developers trace LLM applications alongside their existing database and API activity. It extends OpenTelemetry, so teams can send AI application traces to the monitoring system they already use.

YoMo is a self-hosted framework for developers building AI agents that call application tools. It supports distributing inference and tool execution across locations closer to an application's users.

PapersGPT is an AI research assistant inside Zotero for researchers working through a paper library. It helps answer questions across saved research and turn findings into notes with citations back to the papers.

Unstract is a self-hosted, no-code platform for teams that need structured data from documents whose layouts vary. It uses LLMs to extract JSON from PDFs, images, scans and office files without building a template for each vendor or form. Its use cases include finance, insurance, healthcare and KYC document processing.

next-wiki is a self-hosted wiki for people and teams who want AI-assisted knowledge management with a record of where information came from. It keeps original sources separate from AI-written material and reviewed pages, so an assistant's synthesis remains traceable to its evidence. It's open source under Apache 2.0 and runs as a browser app on your own Docker host with PostgreSQL.

Hermes Notes is a self-hosted personal knowledge base for people who want their notes and project work in one connected system. It runs on your laptop or a server you control, with a browser interface and PostgreSQL storage. It's open source under the MIT license and built for personal use or a trusted small group, rather than a public service for unrelated users.

Agently is a Python AI agent framework for developers building assistants and service backends with local Ollama models or hosted model APIs. It runs within your application, without requiring a separate orchestration service. Model requests go to the endpoint you choose, so using a remote provider sends the request data outside your machine.

LiteLLM is an AI gateway for platform teams managing model access across applications and providers. It puts cloud and self-hosted models behind a shared interface so developers can switch providers without rewriting their integration.

haiku.rag lets you search your own documents and ask questions with answers you can check against the original pages. It's for people building a private document library or giving an AI assistant access to their files.

Anything Analyzer is a desktop protocol analyzer for developers and security researchers investigating APIs, authentication and request signing. It brings browser and app traffic into one session for inspection and AI analysis.

Link gives AI agents persistent memory so you don't have to repeat preferences, project decisions and context in every session. Multiple agents can read the same local Markdown files, which you can inspect in an editor or Obsidian.

Dograh is an open source voice AI platform for teams building agents that answer or place phone calls. It's a self-hosted alternative to Vapi and Retell, with control over conversation flows and a choice of AI providers.

Waku Agent is a personal AI assistant that runs on your laptop, stores its memory locally and calls remote model providers. It's for developers who want to inspect and change the assistant's behavior in Python. The agent uses provider API credentials for reasoning; requests to cloud providers are processed by those services.

Unity MCP connects AI assistants to the Unity Editor so game developers can ask an assistant to make changes directly in a project. It works with local LLMs and MCP clients including Claude, Codex, Cursor and VS Code.

HippoRAG is a Python memory and retrieval framework for developers building LLM applications that need to connect facts across documents. It uses a knowledge graph to find related information for questions that require several pieces of evidence.

wllama lets developers add local LLM inference to browser apps without a separate inference server. It brings llama.cpp to JavaScript and TypeScript projects through WebAssembly, so models run on the user's device.

NeMo Guardrails is a Python toolkit for developers building AI assistants that need rules for what they say and which actions they take. It adds checks around conversations, document-based answers and tool use.

OwnPilot is a self-hosted AI assistant for people who want personal records and agents that can carry out tasks in one web interface. It supports local model backends as well as cloud providers.

Strix is an AI penetration testing tool for developers and security teams assessing code, web applications and APIs. Its free, open source edition runs locally with Docker under the Apache 2.0 license. It supports local models through Ollama or LM Studio, as well as remote providers such as OpenAI and Anthropic; cloud-backed runs send model requests to the selected provider.

Cognee gives AI agents memory across sessions so they can reuse project context, decisions, and lessons from earlier work. It's for developers building agents and teams whose knowledge sits across documents, code, and conversations.

ZeroClaw is a personal AI agent for people who want an assistant running on their own computer or server. It can use a shell and browser, respond through messaging apps and perform scheduled tasks.

Hatice is a self-hosted coding agent orchestrator for developers who want agents to work through issue-tracker tasks. It assigns issues to Claude Code agents and manages work across multiple turns.

LangGraph is an AI agent framework for developers building applications on their own machines, including workflows that use local models through LangChain's ChatOllama integration. Ollama can run models such as gpt-oss locally. LangGraph also works with remote model providers, so where model requests go depends on the connection your application uses.

Agent S is a computer-use AI agent framework for developers and researchers building desktop automation. It takes natural-language tasks and operates desktop and web applications through their screen interfaces, without requiring an API integration for each app.

Fast Agent is a terminal coding assistant and Python toolkit for developers building AI agents and automated workflows. You can choose local LLMs or hosted providers and use the same toolkit for interactive work, scripting, and evaluation.

Nexent is a self-hosted AI agent platform for people and teams who want to build agents by describing tasks in plain language. It generates executable agents without requiring code or a visual workflow editor.

Stagehand is an open-source browser agent SDK for developers automating websites and collecting structured data in local Chrome. Model inference is separate from browser execution: direct provider calls send model context remotely, while a custom callback can connect a self-hosted model. Local runs require Chrome.

Microsoft Agent Framework is an AI agent framework for developers building locally hosted applications in Python or C#/.NET. It supports local development and self-hosting of the application, while integrations such as Azure OpenAI and OpenAI send model requests to those providers. Self-hosting the app doesn't make those calls offline or remove provider costs.

AgentArk is a self-hosted AI agent runtime for people who want a personal assistant that remembers preferences and carries out ongoing work under their control. It runs through Docker on macOS, Windows and Linux, with a browser interface for chat, tasks and action review. It's free and open source under Apache 2.0.

Agent Zero is a self-hosted AI agent framework for people who want an assistant to carry out research, coding, and document work on a computer. You can watch its actions and intervene in the same desktop with your mouse and keyboard.

DataDreamer is a Python library for researchers and developers who need to create training datasets and adapt LLMs to specific tasks. It connects data preparation and model training in reproducible workflows.

Kitter is a local agent skill manager for developers who work across several projects. It keeps shared skills in one library while letting each project use its own selection, reducing the need to maintain separate copies.

OpenMAIC is a self-hosted AI classroom platform for learners and educators building lessons from a topic or their own materials. AI teachers and classmates explain concepts and discuss questions during the lesson.

LLM Compressor prepares models for deployment with vLLM by reducing their storage and memory requirements through quantization. It's for developers working with local checkpoints or models from Hugging Face repositories.