Author DAGs

Author DAGs on the Airflow SDK — operators, dbt, variables & connections, alerting, map-reduce, and worked examples.

Everything about writing DAGs for Leoflow. A DAG is a dag.py on the Airflow Task SDK plus a leoflow.yaml for packaging and bindings, compiled to one immutable artifact.

New to authoring? Start with DAG authoring for the project layout and compile model, then reach for the guide that matches your task below.


DAG authoring

Author a DAG: leoflow.yaml plus dag.py compiled to one immutable artifact.

Python authoring & Airflow compatibility

How Leoflow relates to the Airflow Python API: you write standard Apache Airflow Task SDK code, and Leoflow adds a thin runtime plus a packaging file — it never re-implements Airflow’s Python surface.

Airflow operators & sensors

Use Airflow operators and sensors from your DAGs on Leoflow.

dbt projects as DAGs

Render a dbt project into a Leoflow DAG with native model-level tasks.

Variables & Connections

Expose Variables and Connections to your task pods.

On-failure alerting

Notify on run failure from leoflow.yaml — Slack or a generic webhook, no extra task and no Python.

Map-reduce for ML

Fan-out plus reduce as a Python list comprehension — native map-reduce for ML/AI.

Examples

Runnable example DAGs covering the common authoring patterns.

Case study: 1 GB ETL on staging

A worked 1 GB ETL that shares data between tasks through the per-run staging volume.

The Lite web editor

Edit and run DAGs from the browser in Leoflow Lite.