Tools tagged with "LLM tracing"

WebVoyager is a Python AI agent that controls a browser on your machine or a Linux server to carry out tasks on live websites. It's a research project for developers studying browser automation. Model decisions depend on OpenAI's cloud API, which receives page observations and requires an API key and internet access; the local browser doesn't provide local model inference.

Understory gives AI agents persistent knowledge across sessions in Markdown files you can read, edit, and track in Git. It's for people who want their agents' memory accessible outside a chat history.

Agent Flow helps developers inspect how Claude Code and Codex carry out tasks. It turns local agent activity into a visual record for tracing failures, repeated work and slow tool calls.

Inkeep Agents is an AI agent builder for teams creating chat assistants and automated workflows. It supports collaboration between people who prefer a visual editor and developers who work in code.

unleashd, listed as Buddies in its repository, is a local workspace for developers coordinating multiple coding agents. It keeps each agent's identity and memory across conversations, so a team can continue work with earlier context.

Procedura generates 3D assemblies for people who want to revise the resulting model in code. Each assembly is a parametric program with named parts and defined connections, so you can edit its source and compile the geometry again.

Text Embeddings Inference is a self-hosted server for developers building semantic search and retrieval applications. It turns text into embeddings through a REST API and can run offline once model weights are downloaded.

ASSERT is a local-first Python framework for developers testing AI agents and LLM applications against their own requirements. It turns written expectations into evaluations for quality, safety, and regression testing.

Archestra Community Edition is a self-hosted AI platform for teams managing access to company tools and models. It gives coding assistants, internal agents, and staff chat a shared place to enforce policies and track activity.

tRPC Agent Go is an open-source framework for developers building agent services with local automation in Go. It can execute skill scripts in an isolated workspace and includes deployable HTTP servers for agent interfaces. The documented OpenAI and DeepSeek workflows require a provider API key, so running the service yourself doesn't make those model calls local.

GPT Mobile is an Android AI chat app for people who want to compare model responses in one conversation. It connects to your chosen providers using your own API keys and can work with models served through Ollama.

GoModel is a self-hosted AI gateway for developers and platform teams sharing access to local models and cloud providers. It centralizes provider choice and usage policies behind APIs compatible with OpenAI and Anthropic SDKs.

Sandbox Agent lets developers control coding agents from their own applications through a shared API. It's for teams building agent-powered software that needs remote sessions and isolated code execution without a separate integration for each agent.

Agent Squad is a framework for developers building assistants that divide work among specialized AI agents. It handles agent selection and conversation context so users can switch topics without starting a separate chat.

Obelisk makes past coding agent sessions searchable for developers who need to recover decisions or revisit earlier work. A desktop browser and an agent skill give people and coding assistants access to the same local history.

MLflow helps developers and teams inspect AI applications, compare changes and track model experiments. It brings agent debugging and evaluation into a platform you can run locally or on your own servers.

Plano is a self-hosted AI gateway for developers building applications with multiple agents. It handles shared routing, orchestration and monitoring outside the agents, so developers don't need to build those functions into each one.

ZeroToken is a local browser automation server for people using AI agents to repeat web tasks such as collecting reports, logging into sites or testing browser workflows. It turns recorded actions into scripts so later runs don't need an LLM to reason through every step again.

NVIDIA NeMo Data Designer is a Python framework for developers and data teams creating synthetic datasets with controlled variation and relationships between fields. It can start with an empty dataset or build on your own seed data. The framework is open source under Apache 2.0.

CascadeFlow is a library for developers who need to control AI agent spending and behavior during a run. It works inside the application, assessing model calls, tool calls and sub-agent handoffs before deciding how execution should continue.

AgentSight is a local AI agent monitoring tool for developers investigating failed runs, slow steps or unexpected changes. It connects prompts and model calls to what agents actually do on the machine, including activity their own logs may miss.

Rig is a Rust library for developers building AI agents and LLM applications. It provides a shared interface across model providers and vector stores for applications that need to work with different backends.

FastGPT is an AI agent builder for teams creating document-based assistants and business workflows. It suits internal knowledge search, customer support and applications that combine answers with actions.

Laminar helps developers inspect AI agent runs, find recurring failures and test fixes. It connects production traces with debugging and evaluation tools.

MASFactory is a Python framework for developers building workflows in which several AI agents collaborate. It combines natural-language design, code authoring and visual editing so teams can define the work and inspect how agents carry it out.

OpenRath is a Python runtime for developers building multi-agent workflows that need an inspectable record of their work. It keeps context and evidence together so engineering and research teams can trace how a result was produced.

Chidori is an AI agent framework for developers building long-running workflows that need crash recovery or human approval. Agents use ordinary async TypeScript, with saved runs that developers can revisit for debugging and testing.

Agno is a framework and runtime for developers building customer-facing or internal AI agents. It combines agent development, service hosting and a web interface for managing runs on infrastructure you control.

Pipecat is an open-source Python framework for developers who want to run voice and video agent applications locally or on their own servers. It hosts the conversation pipeline, while speech and model processing depend on the services you choose. Integrations such as Soniox, OpenAI and Cartesia send the relevant requests to those providers.

Jido is an Elixir framework for developers who want to run cooperating agents inside their own application or self-hosted server. Its BEAM runtime handles agent state, tool execution and coordination. AI is optional: the core supplies the runtime, while jido_ai adds model integration separately.

MCPJam helps MCP server developers check how their tools and apps behave across AI clients before deployment. It combines hands-on debugging with repeatable tests for differences between ChatGPT, Claude, Cursor, and Copilot.

Flexible GraphRAG is a self-hosted platform for teams building document search and AI chat that use both text and relationships between entities. It extracts knowledge graphs from documents and combines graph retrieval with vector similarity and full-text search. You can run it standalone or in Docker. It's open source under Apache 2.0.

Memori's BYODB edition is a memory library for developers who want agents to retain context in their own SQLite file or self-managed database. It generates embeddings locally, but its default Advanced Augmentation sends conversation messages and summaries to Memori's cloud API for memory extraction. The documented OpenAI connection also sends model requests to OpenAI.

Wren AI is a self-hosted context and query engine for developers and data teams building AI analytics. It queries your databases using business definitions you control. Model execution depends on the connected agent: using Claude Code’s standard cloud connection sends prompts and model responses to its remote provider, even when Wren's engine runs on your servers.