Spark 3.5.2.0 (EEP 9.3.1) Release Notes
This section provides reference information, including new features, patches, and known issues for Spark 3.5.2.0.
The notes below relate specifically to the Hewlett Packard Enterprise Distribution for Apache Hadoop. For more information, you may also want to consult the open-source Spark 3.5.2 Release Notes.
These release notes contain only Hewlett Packard Enterprise specific information and are not necessarily cumulative in nature. For information about how to use the release notes, see Ecosystem Component Release Notes.
Spark Version | 3.5.2.0 |
Release Date | October 2024 |
HPE Version Interoperability | See Component Versions for Released EEPs and EEP Components and OS Support. |
Source on GitHub | https://github.com/mapr/spark |
GitHub Release Tag | 3.5.2.0-eep-931 |
Maven Artifacts | https://repository.mapr.com/maven/ |
Package Names | Navigate to https://package.ezmeral.hpe.com/releases/MEP/ and select your EEP and OS to view the list of package names. |
Hive Support
- Starting from Spark 3.1.2, Spark supports Hive 2.3.
New in This Release
Spark 3.5.2.0 introduces the following enhancements or HPE platform-specific behavior changes:
- Bug fixes
- Spark Connect Server package.
- Session timeout for Spark UIs.
Fixes
This HPE release includes the following new fixes on the base Apache release. For details, refer to the commit log for this project in GitHub.
GitHub Commit | Date (YYYY-MM-DD) | Comment |
---|---|---|
3fd8dfb | 08/10/2024 | MapR [SPARK-1333] Fix CVE-2024-47561 for Avro |
bde5b8c | 03/10/2024 | MapR [SPARK-1331] STS doesn't work because jetty-rewrite jar is missing. |
d8ed332 | 25/09/2024 | MapR [SPARK-1321] spark-thriftserver failed to start if HMS configured to use SSL |
85a95e2 | 24/09/2024 | MapR [SPARK-1328] Remove dependency on mapr-core package |
d84d523 | 20/09/2024 | MapR [SPARK-1324] Spark connect fail to start |
4f5fa11 | 11/09/2024 | MapR [SPARK-1322] Add spark-connect jar to the Spark package |
1e6df25 | 11/09/2024 | MapR [SPARK-1312] Make separate EEP Spark service for spark-connect |
78881ee | 20/08/2024 | EZAF-6347: Avoid using custom spark-env.sh and sprk-defaults.conf in PKD |
32a718e | 14/08/2024 | MapR [SPARK-1315] Port Spark 3.5.2 to EEP |
791fc87 | 08/08/2024 | MapR [SPARK-1309] Move SPARK-1308/SPARK-1307 fix to all released EEP versions |
Known Issues and Limitations
- FIPS in mixed mode not supported with enabled SSL for WebUI.
- SPARK-1099: Non-mapr user is unable to insert values into Hive table by using Spark Thrift Server
Resolved Issues
- None.