Submit Tool

Apache Airflow

Open-source platform for scheduling and monitoring data workflows

Free Automation
Visit Tool →

Workflows are Python files that define tasks and dependencies. A web interface shows runs, logs, and failures. Hosted versions exist from cloud providers and Astronomer.

Airflow handles orchestration, not the data processing itself. It takes effort to run well at scale.

Prefect and Dagster are newer alternatives. Airflow suits data engineers who orchestrate batch pipelines.

// alternatives to Apache Airflow see all →

Prefect Open-source Python workflow orchestration for data and ML pipelines
Dagster Data orchestration platform built around data assets
dbt Cloud Analytics engineering platform for data transformation

// related tools in Automation

Ansible Open-source automation for configuration management and deployment
Dagster Data orchestration platform built around data assets
Bardeen Browser automation that turns repetitive web tasks into playbooks
SAP Signavio Process mining and business process management
Celonis AI process mining platform for operations teams