Airflow 2.6.1.0 - 2307 (EEP 9.1.2) Release Notes
The following notes relate specifically to the HPE Data Fabric Distribution for Apache
Airflow. You may also be interested in the Apache Airflow home page.
| Airflow Version | 2.6.1.0 |
| Release Date | July 2023 |
| HPE Version Interoperability | See Ecosystem Pack Components and OS Support. |
| Source on GitHub | https://github.com/mapr/airflow |
| GitHub Release Tag | 2.6.1.0-eep-912 |
| Maven Artifacts | https://repository.mapr.com/maven/ |
| Package Names | Navigate to http://package.ezmeral.hpe.com/releases/MEP/, and select your EEP(MEP) and OS to view the list of package names. |
| Documentation |
New in This Release
- This release updates the Airflow component to version 2.6.1.0.
- Airflow 2.6.1 impersonation requires the same group for Airflow and impersonating
users or changes in
airflow.cfgfile_task_handler_new_folder_permissions to 0o777 file_task_handler_new_file_permissions to 0o666 - Added
ticket_locationdag parameter for overwriteMAPR_TICKETFILE_LOCATION. This allows you to use non-standard ticket locations for impersonation.
Fixes
None.
Known Issues and Limitations
- Airflow is not supported with FIPS-enabled nodes.
- The Installer can install Airflow, but cannot set up MySQL as the backend database for Airflow. The default Airflow database is SQLite.
- Apache PySpark is removed from the default Airflow dependencies. To use the Spark JDBC
operator/hook from Apache, install PySpark as follows:
- Run
<airflow_home>/build/env/bin/activate. - Run
pip install pyspark==<spark_version>. - Run
deactivate. -
NOTEThis process does not affect the Ezmeral Spark provider.
- Run
Resolved Issues
- None.