MANNING
Bas Harenslak
Julian de Ruiter
Pipeline as DAG
Task 1
Task 2
Task 3
Task 4
Schedule interval = @daily
DAG file
(Python)
Dependency between tasks,
indicating task 3 must run
before task 4
Which schedule to use
for running the DAG
Represents a
task/operation
we want to run
Data Pipelines with Apache Airflow
Data Pipelines
with Apache Airflow
BAS HARENSLAK
AND JULIAN DE RUITER
MANNING
SHELTER ISLAND