Airflow

Describes Airflow, an open-source workflow automation and scheduling system that can be used to author and manage data pipelines.

Airflow uses workflows made of Directed Acyclic Graphs (DAGs) of tasks. You can use DAGs to collect tasks together and organize dependencies and relationships between them to determine how they should run.

The version of Airflow in HPE Ezmeral Runtime Enterprise 5.5.0 is 2.3.4.

For more information, see https://airflow.apache.org/ at Apache Documentation.

Airflow Base Entities

  • af-base-postgres

  • af-base-nfs

Airflow Limitations

Airflow has the following limitations:

  • Airflow clusters can be installed only into the tenant namespace.
  • Airflow does not support multiple authentication locations.