Spark 3.5.2.0 (EEP 9.3.1) Release Notes

This section provides reference information, including new features, patches, and known issues for Spark 3.5.2.0.

The notes below relate specifically to the Hewlett Packard Enterprise Distribution for Apache Hadoop. For more information, you may also want to consult the open-source Spark 3.5.2 Release Notes.

These release notes contain only Hewlett Packard Enterprise specific information and are not necessarily cumulative in nature. For information about how to use the release notes, see Ecosystem Component Release Notes.

Spark Version 3.5.2.0
Release Date October 2024
HPE Version Interoperability See Component Versions for Released EEPs and EEP Components and OS Support.
Source on GitHub https://github.com/mapr/spark
GitHub Release Tag 3.5.2.0-eep-931
Maven Artifacts https://repository.mapr.com/maven/
Package Names Navigate to https://package.ezmeral.hpe.com/releases/MEP/ and select your EEP and OS to view the list of package names.

Hive Support

  • Starting from Spark 3.1.2, Spark supports Hive 2.3.

New in This Release

Spark 3.5.2.0 introduces the following enhancements or HPE platform-specific behavior changes:

  • Bug fixes
  • Spark Connect Server package.
  • Session timeout for Spark UIs.

Fixes

This HPE release includes the following new fixes on the base Apache release. For details, refer to the commit log for this project in GitHub.

GitHub Commit Date (YYYY-MM-DD) Comment
3fd8dfb 08/10/2024 MapR [SPARK-1333] Fix CVE-2024-47561 for Avro
bde5b8c 03/10/2024 MapR [SPARK-1331] STS doesn't work because jetty-rewrite jar is missing.
d8ed332 25/09/2024 MapR [SPARK-1321] spark-thriftserver failed to start if HMS configured to use SSL
85a95e2 24/09/2024 MapR [SPARK-1328] Remove dependency on mapr-core package
d84d523 20/09/2024 MapR [SPARK-1324] Spark connect fail to start
4f5fa11 11/09/2024 MapR [SPARK-1322] Add spark-connect jar to the Spark package
1e6df25 11/09/2024 MapR [SPARK-1312] Make separate EEP Spark service for spark-connect
78881ee 20/08/2024 EZAF-6347: Avoid using custom spark-env.sh and sprk-defaults.conf in PKD
32a718e 14/08/2024 MapR [SPARK-1315] Port Spark 3.5.2 to EEP
791fc87 08/08/2024 MapR [SPARK-1309] Move SPARK-1308/SPARK-1307 fix to all released EEP versions

Known Issues and Limitations

  • FIPS in mixed mode not supported with enabled SSL for WebUI.
  • SPARK-1099: Non-mapr user is unable to insert values into Hive table by using Spark Thrift Server

Resolved Issues

  • None.