Spark 3.5.5.0 (EEP 9.4.0) Release Notes
This section provides reference information, including new features, patches, and known issues for Spark 3.5.5.0.
The notes below relate specifically to the Hewlett Packard Enterprise Distribution for Apache Hadoop. For more information, you may also want to consult the open-source Spark 3.5.2 Release Notes.
These release notes contain only Hewlett Packard Enterprise specific information and are not necessarily cumulative in nature. For information about how to use the release notes, see Ecosystem Component Release Notes.
| Spark Version | 3.5.5.0 |
| Release Date | April 2025 |
| HPE Version Interoperability | See Component Versions for Released EEPs and EEP Components and OS Support. |
| Source on GitHub | https://github.com/mapr/spark |
| GitHub Release Tag | 3.5.5.0-eep-940 |
| Maven Artifacts | https://repository.mapr.com/maven/ |
| Package Names | Navigate to https://package.ezmeral.hpe.com/releases/MEP/ and select your EEP and OS to view the list of package names. |
Hive Support
- Starting from Spark 3.1.2, Spark supports Hive 2.3.
New in This Release
Spark 3.5.5.0 introduces the following enhancements or HPE platform-specific behavior changes:
- Bug fixes
- JWT support
- Login/logout UI
Fixes
This HPE release includes the following new fixes on the base Apache release. For details, refer to the commit log for this project in GitHub.
| GitHub Commit | Date (YYYY-MM-DD) | Comment |
|---|---|---|
| 18c2259 | 11/03/2025 | MapR [SPARK-1340] JWT support at Spark |
| 01da27d | 11/03/2025 | EZAF-7633: Provide an ability to use local files for token verification in Spark JWTAuthHandler |
| c9c2a18 | 11/03/2025 | EZAF-8125: Create log directory if missing |
| 0a67322 | 11/03/2025 | MapR [SPARK-1346] Add login/logout functionality for Spark History Server UI |
| cfa1e29 | 11/03/2025 | MapR [SPARK-1354] Add login page for Spark WEB UI with basic/sso auth support |
| 161e397 | 11/03/2025 | MapR [SPARK-1353] Add login page for Spark Master UI with basic/sso auth support |
| 690a645 | 11/03/2025 | EZAF-7644: EzSparkAWSCredentialProvider does not refresh the token automatically |
| 1f95dd5 | 13/03/2025 | MapR [SPARK-1357] Avoid using signedIn cookie for authentication |
| b498b54 | 18/03/2025 | MapR [SPARK-1361] It's impossible to be authenticated in more then one Spark UI at the same time |
| 8ebe48d | 20/03/2025 | MapR [SPARK-1352] The Spark shell fails to start with the error: 'SSO configuration not yet available on cluster.' |
| 6a71ab5 | 20/03/2025 | MapR [SPARK-1364] Check if SSO is enabled on cluster for login page |
| 9bc1469 | 26/03/2025 | EZAF-8952: spark.mapr.user.secret cannot be empty |
| 1a05799 | 09/04/2025 | EZAF-9269: Extend EzSparkAWSCredentialProvider |
| 32760ec | 09/04/2025 | MapR [SPARK-1355] spark.ui.filters option is duplicated in spark-defaults.conf |
Known Issues and Limitations
- FIPS in mixed mode not supported with enabled SSL for WebUI.
- SPARK-1099: Non-mapr user is unable to insert values into Hive table by using Spark Thrift Server
Resolved Issues
- None.