Airflow 2.6.1.0 - 2307 (EEP 9.1.2) Release Notes

The following notes relate specifically to the HPE Ezmeral Data Fabric Distribution for Apache Airflow. You may also be interested in the Apache Airflow home page.
Airflow Version 2.6.1.0
Release Date July 2023
HPE Version Interoperability See EEP Components and OS Support.
Source on GitHub https://github.com/mapr/airflow
GitHub Release Tag 2.6.1.0-eep-912
Maven Artifacts https://repository.mapr.com/maven/
Package Names Navigate to http://package.ezmeral.hpe.com/releases/MEP/, and select your EEP(MEP) and OS to view the list of package names.
Documentation

New in This Release

  • This release updates the Airflow component to version 2.6.1.0.
  • Airflow 2.6.1 impersonation requires the same group for Airflow and impersonating users or changes in airflow.cfg
    file_task_handler_new_folder_permissions to 0o777 
file_task_handler_new_file_permissions to 0o666
  • Added ticket_location dag parameter for overwrite MAPR_TICKETFILE_LOCATION. This allows you to use non-standard ticket locations for impersonation.

Fixes

None.

Known Issues and Limitations

  • Airflow is not supported with FIPS-enabled nodes.
  • The Installer can install Airflow, but cannot set up MySQL as the backend database for Airflow. The default Airflow database is SQLite.​
  • Apache PySpark is removed from the default Airflow dependencies. To use the Spark JDBC operator/hook from Apache, install PySpark as follows:
    1. Run <airflow_home>/build/env/bin/activate.
    2. Run pip install pyspark==<spark_version>.
    3. Run deactivate.
    4. NOTE
      This process does not affect the Ezmeral Spark provider.

Resolved Issues

  • None.