Tools tagged with "LLM tracing"

43 tools

Chainlit

An open-source Python framework for AI chat apps you can self-host, with customizable interfaces, OAuth and integrations including LangGraph and HuggingFace.

12.5KUpdated 1 month agoApache-2.0

Web#LLM tracing#Multi-user access#Streaming inference

Chainlit is an open-source Python framework for developers building conversational AI apps with their own application logic. You can run the app on your own server and give users a browser chat interface. It's a framework for creating an app, rather than a ready-made chatbot with a fixed model.

AI Bots for Chat AppsLLM Libraries and SDKsSelf-Hosted Chat Web UIs

Agenta

A self-hosted AI agent workspace with Ollama support, shared files, and approval controls. Run it on your servers or use the hosted cloud service.

4.8KUpdated 1 day ago

Docker · Web#Git integration#Human approval#LLM tracing

Agenta is an MIT-licensed, open source workspace for teams that want AI agents to handle tasks in chat and continue recurring work in the background. You can self-host it with Docker Compose or Helm to keep agents and workspace data on your infrastructure, or use Agenta Cloud as a hosted service.

AI Bots for Chat AppsAI Code ReviewComputer and Browser Agents

BAML

An open-source programming language for AI agents that runs on macOS, Linux and Windows, with typed model calls, local tracing and built-in evaluations.

9.4KUpdated 1 day agoApache-2.0

macOS · Windows · Linux · iOS · Android · Web#Batch processing#LLM tracing#Structured output

BAML is a programming language for developers building AI agents, with typed model calls and local tracing built into the language. It runs standalone on macOS, Linux and Windows, or alongside an existing application. The language is open source under Apache 2.0, and works offline.

Agent FrameworksLLM Evaluation and TestingLLM Libraries and SDKsLLM Observability and Tracing

OpenAI Agents SDK

3 videos

Open-source Python AI agent framework under MIT. Coordinate agents and tools, use local or hosted sandboxes, and connect to OpenAI or other model providers.

29.8KUpdated 1 day agoMIT

macOS · Windows · Linux#Code execution#Guardrails#Human approval

OpenAI Agents SDK is an open-source Python framework for developers building AI apps that need to use tools, delegate tasks, or work across multiple steps. Its runtime manages agent turns and conversation state while letting developers express workflows in ordinary Python. It uses the MIT license.

Agent FrameworksLLM Libraries and SDKsVoice Agent Frameworks

Arize Phoenix

2 videos

Self-hosted AI observability platform for tracing and evaluating LLM apps. Run it locally or in Docker, with Ollama integration and OpenTelemetry support.

11.7KUpdated 24 hours ago

Docker · Web#LLM tracing#MCP#Ollama integration

Arize Phoenix is a self-hosted platform for developers who need to understand why an AI agent failed and test changes before shipping them. It runs on a laptop, in Docker, or on Kubernetes. Self-hosting keeps traces on your infrastructure; Phoenix Cloud provides a hosted alternative. Phoenix uses the Elastic License 2.0 (ELv2), a source-available license.

Experiment Tracking and MLOpsLLM Evaluation and TestingLLM Observability and TracingMCP Servers and Agent SkillsPrompt Management and Playgrounds

MLflow

4 videos

Self-hosted AI engineering platform for tracing agents, evaluating LLMs, and tracking models. Apache 2.0 licensed, with Ollama support.

28.2KUpdated 1 day agoApache-2.0

Docker · Web#Batch processing#LLM tracing#MCP

MLflow brings agent tracing, LLM evaluation, and model experiment tracking into a platform you can run locally or on your own servers. It's for developers and teams who need to understand failures, compare changes, and monitor AI applications in production. It's open source under Apache 2.0.

Experiment Tracking and MLOpsLLM Evaluation and TestingLLM Gateways and RoutersLLM Observability and TracingPrompt Management and Playgrounds

NeMo Guardrails

1 video

A self-hosted LLM guardrails toolkit for Python apps. Control conversations, check model responses, and connect to LLaMa-2, Falcon or OpenAI models.

7.2KUpdated 24 hours ago

Docker#Guardrails#LLM tracing#Tool calling

NeMo Guardrails is an open-source Python toolkit for developers who need control over how an AI assistant responds and uses tools. It runs within your application or as a self-hosted server, including in Docker. The library uses the Apache 2.0 license.

Guardrails, Security and SandboxingLLM Evaluation and TestingLLM Libraries and SDKs