Spark 3.2.0.300 - 2411 (EEP 8.1.3) Release Notes

This section provides reference information, including new features, patches, and known issues for Spark 3.2.0.300.

The notes below relate specifically to the Hewlett Packard Enterprise Distribution for Apache Hadoop. For more information, you may also want to consult the open-source Spark 3.2.0 Release Notes.

These release notes contain only Hewlett Packard Enterprise specific information and are not necessarily cumulative in nature. For information about how to use the release notes, see Ecosystem Component Release Notes.

Spark Version 3.2.0.300
Release Date November 2024
HPE Version Interoperability See Component Versions for Released EEPs and EEP Components and OS Support.
Source on GitHub https://github.com/mapr/spark
GitHub Release Tag 3.2.0.300-eep-813
Maven Artifacts https://repository.mapr.com/maven/
Package Names Navigate to https://package.ezmeral.hpe.com/releases/MEP/ and select your EEP and OS to view the list of package names.
IMPORTANT
  • Beginning with EEP 6.0.0, the KeyStore and TrustStore password can be removed from spark-defaults.conf and set in /opt/mapr/conf/ssl-client.xml.
  • Beginning with Core 6.2 and EEP 7.0, Spark supports SSL for WebUI.

Hive Support

  • Starting from Spark 3.1.2, Spark supports Hive 2.3.

New in This Release

For a complete list of new features, see the open-source Spark 3.2.0 Release Notes.
  • Bug fixes.

Fixes

This HPE release includes the following new fixes since the latest Spark release. For details, refer to the commit log for this project in GitHub.

GitHub Commit Date (YYYY-MM-DD) Comment
eb80ac4 25/06/2024 MapR [SPARK-1299] Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient

Known Issues and Limitations

  • When Hive/Metastore is not installed for Spark on derby db, you can use the workaround described in the documentation, and not support log4j1.2 logging.
  • FIPS in mixed mode is not supported with enabled SSL for WebUI.

Resolved Issues

  • None.