AI Agent Frameworks, MCP Servers and SDKs

Liger Kernel is a Python library for developers training or fine-tuning LLMs on their own hardware. Fused kernels reduce memory use during model operations and post-training.

DSPy is a Python framework for developers building language model applications with local backends such as Ollama on a laptop or SGLang on a GPU server. It connects application code to those model servers, which handle inference on your hardware. It also supports cloud providers, so where model requests go depends on the backend you choose.

Adala is a Python framework for AI engineers and data scientists who want to run data-labeling and evaluation workflows in their own process. It works with local pandas DataFrames and ground-truth examples, but the documented OpenAI and OpenRouter configurations send task inputs to cloud models. Those connections need internet access and an API key.

Waggle is a local MCP server for developers coordinating AI agents across coding tools. It lets agents pass references to plans, reports and other artifacts while keeping a record of who created them and what recipients read.

OpenHarness is a Python framework for developers and researchers building AI agents that can act on files, use tools and retain work across sessions. It includes ohmo, a personal agent that handles coding tasks through Feishu, Slack, Telegram or Discord.

Loop.js is an AI agent framework for developers who want repeated attempts at a task with a separate check of the result. You define the goal and completion criteria, and the engine coordinates work until the verifier accepts it or a stopping condition ends the run.

MCP Agent is a Python framework for developers building AI agents that use tools through Model Context Protocol (MCP). It handles connections to MCP servers and provides reusable workflows for coordinating agents across a task.

Qwen Code is an AI coding assistant for developers who want an agent to review code, fix bugs and carry out work in a project. You can use it in a terminal, editor, desktop app or browser.

Ollama JavaScript is a library for developers adding model chat, generation or retrieval features to JavaScript applications. It connects those applications to an Ollama server, including one running locally.

Pyserini is an open-source Python toolkit for researchers and developers comparing document search methods or building the retrieval stage of a ranking or RAG system. It runs as a Python package on your own hardware and lets you search existing benchmark indexes or build indexes from your own documents. Its license is Apache 2.0.

Codex iOS Assistant connects Codex on your Mac to your iPhone so the assistant can perform phone actions and retrieve phone context. It's for people who want to bring information from their phone into their work with Codex.

Hypha is a TypeScript AI agent framework for developers building applications that need controlled tool use and recoverable work. It separates an agent's planning and tool choices from the execution layer that decides which actions may proceed.

Instrukt is a terminal app for developers who want to build and test AI agents on their own machine or server. It can index local code and documents, but its chat models run through OpenAI's API, which requires an API key and internet access. It doesn't provide local chat inference.

Project Orchestrator coordinates AI coding agents for developers working across tasks or related repositories. It gives agents a shared record of code, plans and decisions so each task can draw on earlier work.

AG2 is an open-source Python framework for developers building cooperating AI agents on their own machines or servers. Its Ollama integration lets agents use a local LLM; it also supports OpenAI, Anthropic and Gemini APIs, which send model requests to those providers. It runs on macOS, Windows and Linux under the Apache 2.0 license.

SpecStory saves AI coding conversations so developers can recover decisions, find past solutions, and carry context into another task. Its CLI and editor extensions keep session history locally across projects and coding tools.

RubyLLM is an AI framework for Ruby and Rails developers building chat and agent features into their applications. Its shared API lets you switch between local and hosted models without writing a separate integration for each provider.

Google ADK is an AI agent framework for developers building applications that carry out multi-step tasks. Agents can run on your own infrastructure and use locally running models through adapters, or connect to hosted providers such as Gemini.

XERJ is a local search engine for developers building AI agents that need to retrieve code, documents or stored knowledge without reading whole files into their context. It runs on a laptop or self-hosted server.

BAML is a programming language for developers building AI agents, with a documented Ollama client for models running locally and tracing that runs on your machine. The OllamaClient integration is documented for the canary toolchain. The standard OpenAI connection sends model requests to OpenAI; installing BAML locally does not make that connection offline.

ArtifactFS makes large Git repositories available as local working directories before all their file contents download. It's for developers building AI agent environments, sandboxes and CI jobs where a full clone would delay work.

Pathway's Live Data Framework is a Python framework for developers building RAG applications and analytics over changing data. It runs locally or on your own servers, including through Docker. Its incremental engine updates results as data arrives, so applications can work with changing documents and events.

Agent QA is a source-available AI testing agent for developers and software teams testing web, Android and iOS apps. You describe a user journey and its expected results in plain English. It tests the real interface and carries observations from earlier runs into later ones, so it can account for how your app behaves.

Octogent is a local web dashboard for developers coordinating several Claude Code sessions on one codebase. Its UI and API run on your machine, where it stores job context and transcripts. The supported workflow requires Claude Code. With its standard cloud connection, prompts and model outputs go to a remote provider; Octogent hosts the dashboard and task coordination.

Sim is an AI agent workspace for teams building automations and managing their use across an organization. It brings workflow creation, shared data and run monitoring into one place. You can self-host the workspace, but chat uses a Sim-managed service and requires sign-in to obtain a Chat API key.

SimpleMem is a memory system for developers building AI agents that need to recall past conversations and stored media without passing the full history to a model each time.

Magic Context is a memory and context plugin for developers using OpenCode, Pi and OMP. It carries project knowledge across sessions and compresses older conversations in the background to avoid interrupting the agent's work.

Reef is self-hosted infrastructure for developers who want AI agents to learn from their interactions. It connects live requests and feedback to changes in model weights or the prompts, rules, and skills that guide an agent.

FastAPI MCP is a Python library for developers who want AI applications to use an existing FastAPI service through the Model Context Protocol (MCP). It creates tools from API endpoints, so developers don't have to build a separate MCP interface for each one.

Agent Service Toolkit is a Python template for developers building their own AI agent services. It brings together agent logic, an API and a browser chat interface so you don't have to build each part from scratch.

Engram keeps project knowledge between coding sessions so developers don't have to repeat past decisions, bug fixes, and conventions to their AI agent. It works with existing coding assistants through MCP.

Understory gives AI agents persistent knowledge across sessions in Markdown files you can read, edit, and track in Git. It's for people who want their agents' memory accessible outside a chat history.

WebLLM is an engine for developers building browser-based AI assistants and Chrome extensions. It runs language models on the user's device, so applications don't need a separate inference server to process prompts.

Inkeep Agents is an AI agent builder for teams creating chat assistants and automated workflows. It supports collaboration between people who prefer a visual editor and developers who work in code.