Kestra is an open-source orchestrator designed to bring Infrastructure as Code (IaC) best practices to all workflows — from those orchestrating mission-critical applications, IT operations, business processes, and data pipelines, to simple Zapier-style automations.
You can use Kestra to:
- run workflows on-demand, event-driven or based on a regular schedule
- programmatically interact with any system or programming language
- orchestrate microservices, batch jobs, ad-hoc scripts (written in Python, R, Julia, Node.js, and more), SQL queries, data ingestion syncs, dbt or Spark jobs, or any other applications or processes
This tutorial will guide you through key concepts in Kestra. We'll start with the same "Hello world" flow from the Quickstart Guide, and we'll gradually introduce new concepts including namespaces
, tasks
, parametrization with inputs
and scheduling using triggers
.
We'll then dive into parallel
task execution, error handling, as well as custom scripts and microservices running in isolated containers. Let's get started!
Fundamentals
Start by building a "Hello world" example.
Inputs
Inputs allow you to make your flows more dynamic and reusable.
Outputs
Outputs allow you to pass data between tasks and flows.
Triggers
Triggers automatically start your flow based on events.
Flowable
Run tasks or subflows in parallel, create loops and conditional branching.
Errors and Retries
Handle errors with automatic retries and notifications.
Docker
Run custom Python, R, Julia, Node.js and Shell scripts in isolated containers.
Was this page helpful?