Airflow 2.5.1.100 - 2405 (EEP 8.1.2) Release Notes
The following notes relate specifically to the HPE Ezmeral Data Fabric Distribution for Apache
Airflow. You may also be interested in the Apache Airflow home page.
Airflow Version | 2.5.1.100 |
Release Date | May 2024 |
HPE Version Interoperability | See EEP Components and OS Support. |
Source on GitHub | https://github.com/mapr/airflow |
GitHub Release Tag | 2.5.1.100-eep-812 |
Maven Artifacts | https://repository.mapr.com/maven/ |
Package Names | Navigate to http://package.ezmeral.hpe.com/releases/MEP/, and select your EEP (MEP) and OS to view the list of package names. |
Documentation |
New in This Release
This release updates the Airflow component to version 2.5.1.100.
Fixes
This HPE release includes the following fixes on the base release:
Commit | Date (YYYY-MM-DD) | Comment |
88c0ef18fd | 2024-03-19 | AIRFLOW-210: Created scheduler log directory for next day to avoid race condition issues |
0fd7e86056 | 2024-02-26 | AIRFLOW-205: Added additional log information for case when the recorded pid doesn't equal to task pid |
f5eec18873 | 2023-10-17 | AIRFLOW-185: Check and create scheduler log directory before scheduling |
Known Issues and Limitations
- Airflow is not supported on FIPS-enabled nodes.
- Starting with EEP 8.1.1, Apache PySpark is removed from the default Airflow
dependencies. To use the Spark JDBC operator/hook from Apache, install PySpark as
follows:
- Run
<airflow_home>/build/env/bin/activate
. - Run
pip install pyspark==<spark_version>
. - Run
deactivate
. -
NOTEThis process does not affect the Ezmeral Spark provider.
- Run
Resolved Issues
- None.