A collection of utilities to make Airflow smoother.
| Name | Repo | Docs | PyPI | Description |
|---|---|---|---|---|
| airflow-balancer | Utilities for tracking hosts and ports and load balancing DAGs | |||
| airflow-config | Hydra/Omegaconf/Pydantic based DAG configuration and generation | |||
| airflow-ha | High Availability (HA) DAG Utility | |||
| airflow-priority | Priority tags (e.g. P1-P5) for DAGs |
|||
| airflow-cron | Utilities for running long-running or always-on jobs with cron | |||
| airflow-supervisor | Utilities for running long-running or always-on jobs with supervisor | |||
| airflow-systemd | Utilities for running long-running or always-on jobs with systemd | |||
| airflow-nomad | Utilities for running long-running or always-on jobs with nomad |
| Name | Repo | Docs | PyPI | Description |
|---|---|---|---|---|
| airflow-pydantic | Pydantic models of Airflow data structures | |||
| cron-pydantic | Pydantic models for cron | |||
| supervisor-pydantic | Pydantic models for supervisor | |||
| systemd-pydantic | Pydantic models for systemd | |||
| nomad-pydantic | Pydantic models for nomad |
| Name | Repo | Docs | PyPI | Description |
|---|---|---|---|---|
| airflow-common | Common operator patterns and utility dags | |||
| airflow-crontab | Airflow DAGs from crontab syntax | |||
| airflow-laminar | Convenience meta library that depends on a compatible collection of the above libraries |
See Validation DAGs for working examples utilizing all of the above.