Kestra

Kestra coordinates AI, data and infrastructure workflows for teams that need to connect tasks and track their execution. It can run existing scripts and containers, so workflows can span tools written in different languages.

• Workflow authoring: Build flows in a visual editor or YAML, keep definitions in Git, and deploy them through CI/CD.
• Schedules and events: Start workflows on a schedule or in response to events, webhooks and messages, with retries and timeouts to handle failures.
• AI automation: Coordinate agents, retrieval-augmented generation pipelines and model evaluation; a built-in AI Copilot can help write workflow definitions.
• Data and infrastructure integrations: Connect ingestion and transformation tools such as Airbyte, dbt and Spark with infrastructure tasks using Terraform and Ansible.
• Execution inspection: Review workflow runs and inspect the values and files that tasks pass downstream through the browser interface.

The free, open-source core uses Apache 2.0 and supports self-hosting on Docker or Kubernetes. Kestra also offers a managed cloud service and a commercial enterprise edition. Self-hosting the orchestrator doesn't make every connected task local: workflows that call OpenAI, Anthropic, Gemini or other external services send requests to those providers.