Airflow 2.5.1.100 - 2405 (EEP 8.1.2) Release Notes
The following notes relate specifically to the HPE Data Fabric Distribution for Apache
Airflow. You may also be interested in the Apache Airflow home page.
| Airflow Version | 2.5.1.100 |
| Release Date | May 2024 |
| HPE Version Interoperability | See Ecosystem Pack Components and OS Support. |
| Source on GitHub | https://github.com/mapr/airflow |
| GitHub Release Tag | 2.5.1.100-eep-812 |
| Maven Artifacts | https://repository.mapr.com/maven/ |
| Package Names | Navigate to http://package.ezmeral.hpe.com/releases/MEP/, and select your EEP (MEP) and OS to view the list of package names. |
| Documentation |
New in This Release
This release updates the Airflow component to version 2.5.1.100.
Fixes
This HPE release includes the following fixes on the base release:
| Commit | Date (YYYY-MM-DD) | Comment |
| 88c0ef18fd | 2024-03-19 | AIRFLOW-210: Created scheduler log directory for next day to avoid race condition issues |
| 0fd7e86056 | 2024-02-26 | AIRFLOW-205: Added additional log information for case when the recorded pid doesn't equal to task pid |
| f5eec18873 | 2023-10-17 | AIRFLOW-185: Check and create scheduler log directory before scheduling |
Known Issues and Limitations
- Airflow is not supported on FIPS-enabled nodes.
- Starting with EEP 8.1.1, Apache PySpark is removed from the default Airflow
dependencies. To use the Spark JDBC operator/hook from Apache, install PySpark as
follows:
- Run
<airflow_home>/build/env/bin/activate. - Run
pip install pyspark==<spark_version>. - Run
deactivate. -
NOTEThis process does not affect the Ezmeral Spark provider.
- Run
Resolved Issues
- None.