Tools tagged with "LLM tracing"

BrowserOS neo is a secondary Chromium browser for AI agents handling web tasks that require signed-in accounts. Agents work in their own tabs while you continue browsing, with a live view of their actions.

agentmemory gives AI coding agents persistent, searchable context from earlier work. It's for developers who want project decisions, past errors and useful lessons to remain available across sessions and different agents.

agent-desktop lets developers give AI agents control of macOS apps such as Finder, Safari and Xcode. It identifies controls through the app's accessibility tree, so agents can act on buttons and text fields by their UI structure.

Paperclip coordinates AI agents for people managing work across development, research, marketing and other business functions. It gives the team a shared structure and keeps its work tied to organization goals.

LangWatch helps AI teams test agent behavior before release and investigate production failures. Teams can reproduce a failed conversation and check how an agent handles it again.

OpenAI Agents SDK is a Python framework for developers building tool-using agents with local models or cloud APIs. It supports gpt-oss through Ollama, with LM Studio also documented as a local model option. OpenAI models use the remote Responses API by default and require an API key, even when the agent runtime and workspace run on your machine.

Exo Agent Framework is for developers building long-running AI agents that can revise their own code, tools and prompts. It preserves agent identity and history as their behavior changes across runs.

HarnessX is a Python framework for developers building AI agents whose behavior they can reuse and adapt. It separates model choice from tool use, memory and context handling, so changing an agent's role doesn't require rewriting it.

Mini SWE Agent is a command-line AI coding assistant for developers tackling GitHub issues and everyday coding tasks. Its small Python core also suits researchers who want to inspect and modify an agent for model evaluations.

iCode is a terminal development workspace for developers who want to work with AI agents and inspect their changes. It brings conversations, agent workflows and a working shell into one interface.

Future AGI helps teams test AI agents, investigate production failures and compare prompt changes. It brings evaluation and monitoring into the same platform so teams can connect poor responses to the steps that caused them.

Open Cowork is a desktop AI agent for Windows and Apple Silicon macOS that uses cloud model APIs to carry out tasks on your computer. It's a Claude Cowork alternative for people who want a graphical interface for document work and app automation. The app is free and open source under MIT, but the agent needs an API key and internet access; model requests go to your chosen provider.

Open Multi Agent is a TypeScript framework for developers building self-hosted AI agent teams. It lets you coordinate work across agents, require human decisions before consequential actions, and inspect what happened afterward.

Potpie's open-source CLI gives developers and coding assistants a local store of project context, backed by a daemon and a browser graph explorer. It's for teams that need agents to understand code alongside engineering decisions and project history. With Claude Code’s standard cloud connection, prompts and model outputs travel to a remote model provider over the network.

Apache Maka is an AI agent workspace for people who want an agent to work on tasks on their machine and keep an inspectable record of its actions. It suits developers who need to review commands, file edits and approvals, or continue work after an interruption.

OpenLLMetry helps developers trace LLM applications alongside their existing database and API activity. It extends OpenTelemetry, so teams can send AI application traces to the monitoring system they already use.

Agently is a Python AI agent framework for developers building assistants and service backends with local Ollama models or hosted model APIs. It runs within your application, without requiring a separate orchestration service. Model requests go to the endpoint you choose, so using a remote provider sends the request data outside your machine.

Waku Agent is a personal AI assistant that runs on your laptop, stores its memory locally and calls remote model providers. It's for developers who want to inspect and change the assistant's behavior in Python. The agent uses provider API credentials for reasoning; requests to cloud providers are processed by those services.

Avibe gives coding agents a shared workspace for people who want to manage ongoing work and review results from their browser or phone. Agent execution stays on your machine, while inference uses your configured provider; OpenCode can also use local or OpenAI-compatible endpoints.

NeMo Guardrails is a Python toolkit for developers building AI assistants that need rules for what they say and which actions they take. It adds checks around conversations, document-based answers and tool use.

NullHub is a self-hosted management console for people running NullClaw and its supporting tools. It brings agent instances, workflow runs and task queues into one browser dashboard.

Flawless provides CISRE, a self-hosted AI SRE platform for teams investigating Kubernetes incidents. It connects evidence collection and diagnosis with approved changes and checks that the affected resource has recovered.

LightRAG is a self-hosted framework for developers building AI assistants that answer questions across documents. It connects related facts across files, including material where relationships matter, such as legal and financial records.

Stagehand is an open-source browser agent SDK for developers automating websites and collecting structured data in local Chrome. Model inference is separate from browser execution: direct provider calls send model context remotely, while a custom callback can connect a self-hosted model. Local runs require Chrome.

Microsoft Agent Framework is an AI agent framework for developers building locally hosted applications in Python or C#/.NET. It supports local development and self-hosting of the application, while integrations such as Azure OpenAI and OpenAI send model requests to those providers. Self-hosting the app doesn't make those calls offline or remove provider costs.

Waggle is a local MCP server for developers coordinating AI agents across coding tools. It lets agents pass references to plans, reports and other artifacts while keeping a record of who created them and what recipients read.

MCP Agent is a Python framework for developers building AI agents that use tools through Model Context Protocol (MCP). It handles connections to MCP servers and provides reusable workflows for coordinating agents across a task.

Hypha is a TypeScript AI agent framework for developers building applications that need controlled tool use and recoverable work. It separates an agent's planning and tool choices from the execution layer that decides which actions may proceed.

SpecStory saves AI coding conversations so developers can recover decisions, find past solutions, and carry context into another task. Its CLI and editor extensions keep session history locally across projects and coding tools.

Marbor is a self-hosted AI inference gateway for operators serving models across their own GPU fleet. It places requests using live hardware and model state to reduce cold loads and avoid deployments that can't serve the requested model.

BAML is a programming language for developers building AI agents, with a documented Ollama client for models running locally and tracing that runs on your machine. The OllamaClient integration is documented for the canary toolchain. The standard OpenAI connection sends model requests to OpenAI; installing BAML locally does not make that connection offline.

AIPOCH Open-Science is a desktop AI research workbench for scientists who want to keep investigations, analysis and supporting evidence in one project. Its agents work with research files and executable tools to produce outputs you can inspect alongside the records behind them.

h5i gives AI agents tools to investigate vulnerabilities in web applications you own or are authorized to test. Teams can review the evidence behind findings and turn confirmed attack flows into security regression checks.

Sim is an AI agent workspace for teams building automations and managing their use across an organization. It brings workflow creation, shared data and run monitoring into one place. You can self-host the workspace, but chat uses a Sim-managed service and requires sign-in to obtain a Chat API key.