Open-Source LLM Observability and Tracing

Paperclip coordinates AI agents for people managing work across development, research, marketing and other business functions. It gives the team a shared structure and keeps its work tied to organization goals.

LangWatch helps AI teams test agent behavior before release and investigate production failures. Teams can reproduce a failed conversation and check how an agent handles it again.

CC Switch is a desktop manager for developers who use multiple AI coding assistants or API providers. It brings their settings into one interface and preserves existing plugins, hooks and other custom settings when switching providers.

HarnessX is a Python framework for developers building AI agents whose behavior they can reuse and adapt. It separates model choice from tool use, memory and context handling, so changing an agent's role doesn't require rewriting it.

Higress is an AI gateway for teams building AI apps and agents that need shared controls across model requests and tool calls. It brings model APIs, MCP services and Kubernetes inference workloads behind one entry point.

Future AGI helps teams test AI agents, investigate production failures and compare prompt changes. It brings evaluation and monitoring into the same platform so teams can connect poor responses to the steps that caused them.

Open Multi Agent is a TypeScript framework for developers building self-hosted AI agent teams. It lets you coordinate work across agents, require human decisions before consequential actions, and inspect what happened afterward.

OpenLLMetry helps developers trace LLM applications alongside their existing database and API activity. It extends OpenTelemetry, so teams can send AI application traces to the monitoring system they already use.

LiteLLM is an AI gateway for platform teams managing model access across applications and providers. It puts cloud and self-hosted models behind a shared interface so developers can switch providers without rewriting their integration.

NullHub is a self-hosted management console for people running NullClaw and its supporting tools. It brings agent instances, workflow runs and task queues into one browser dashboard.

ccusage is a local command-line tool for developers who want to see how many tokens their coding agents use and what that usage costs. It reads the agents' local usage records, so you can compare activity across tools in one place.

Waggle is a local MCP server for developers coordinating AI agents across coding tools. It lets agents pass references to plans, reports and other artifacts while keeping a record of who created them and what recipients read.

Claw Admin is a web dashboard for people managing OpenClaw Gateway and Hermes Agent. It puts agent conversations, behavior controls and activity monitoring in one browser interface.

Hypha is a TypeScript AI agent framework for developers building applications that need controlled tool use and recoverable work. It separates an agent's planning and tool choices from the execution layer that decides which actions may proceed.

Kong Gateway gives platform teams a shared place to manage API, LLM and MCP requests. It helps teams apply access and traffic policies across services and AI applications on infrastructure they control.

Marbor is a self-hosted AI inference gateway for operators serving models across their own GPU fleet. It places requests using live hardware and model state to reduce cold loads and avoid deployments that can't serve the requested model.

BAML is a programming language for developers building AI agents, with a documented Ollama client for models running locally and tracing that runs on your machine. The OllamaClient integration is documented for the canary toolchain. The standard OpenAI connection sends model requests to OpenAI; installing BAML locally does not make that connection offline.

Kibitz helps developers follow several Claude Code or Codex sessions and direct work from one place. It turns agent activity into readable commentary, reducing the need to switch between terminal tabs to see what each session is doing.

Sim is an AI agent workspace for teams building automations and managing their use across an organization. It brings workflow creation, shared data and run monitoring into one place. You can self-host the workspace, but chat uses a Sim-managed service and requires sign-in to obtain a Chat API key.

Agent Flow helps developers inspect how Claude Code and Codex carry out tasks. It turns local agent activity into a visual record for tracing failures, repeated work and slow tool calls.

unleashd, listed as Buddies in its repository, is a local workspace for developers coordinating multiple coding agents. It keeps each agent's identity and memory across conversations, so a team can continue work with earlier context.

LLM Router is a self-hosted AI gateway for teams connecting applications to local LLM servers and cloud providers. It puts a shared interface in front of your models so clients can use the same gateway across backends.

ASSERT is a local-first Python framework for developers testing AI agents and LLM applications against their own requirements. It turns written expectations into evaluations for quality, safety, and regression testing.

Archestra Community Edition is a self-hosted AI platform for teams managing access to company tools and models. It gives coding assistants, internal agents, and staff chat a shared place to enforce policies and track activity.

GoModel is a self-hosted AI gateway for developers and platform teams sharing access to local models and cloud providers. It centralizes provider choice and usage policies behind APIs compatible with OpenAI and Anthropic SDKs.

Sandbox Agent lets developers control coding agents from their own applications through a shared API. It's for teams building agent-powered software that needs remote sessions and isolated code execution without a separate integration for each agent.

ServiceStack AI Server is a self-hosted gateway for developers and teams whose applications use several AI providers. It runs in a Docker container and gives apps one API integration for local models, cloud LLMs and media processing. Teams can change providers without changing their client integrations.

Obelisk makes past coding agent sessions searchable for developers who need to recover decisions or revisit earlier work. A desktop browser and an agent skill give people and coding assistants access to the same local history.

MLflow helps developers and teams inspect AI applications, compare changes and track model experiments. It brings agent debugging and evaluation into a platform you can run locally or on your own servers.

Plano is a self-hosted AI gateway for developers building applications with multiple agents. It handles shared routing, orchestration and monitoring outside the agents, so developers don't need to build those functions into each one.

TokensBurned tracks AI coding activity for developers who want usage statistics on their GitHub profile. Its client processes records locally, but the profile cards depend on a hosted service that receives aggregate data.

Helix is a paid, self-hosted platform for engineering teams coordinating coding agents. Agents work on separate tasks in parallel, while the team shares a view of their progress and reviews their work.

CascadeFlow is a library for developers who need to control AI agent spending and behavior during a run. It works inside the application, assessing model calls, tool calls and sub-agent handoffs before deciding how execution should continue.

AgentSight is a local AI agent monitoring tool for developers investigating failed runs, slow steps or unexpected changes. It connects prompts and model calls to what agents actually do on the machine, including activity their own logs may miss.