Hadoop 3.4.1.0 (EEP 9.4.0) Release Notes

The notes below relate specifically to the HPE Ezmeral Data Fabric distribution of Apache Hadoop. You may also be interested in the Apache Hadoop changelog and the Apache Hadoop home page.

These release notes contain only HPE-specific information and are not necessarily cumulative in nature. For information about how to use the release notes, see Ecosystem Component Release Notes.

Version 3.4.1.0
Release Date April 2025
Version Interoperability See EEP Components and OS Support.
GitHub Source https://github.com/mapr/hadoop-common/
GitHub Release Tag 3.4.1.0-eep-940
Maven Artifacts https://repository.mapr.com/maven/
Package Names Navigate to https://package.ezmeral.hpe.com/releases/MEP/ and select your EEP and OS to view the list of package names.
Documentation

New in this Release

Hadoop 3.4.1.0 introduces the following enhancements or HPE platform-specific behavior changes:
  • SSO support for YANR UIs
  • Bearer token support for REST API
  • CVE updates Bug fixes
  • Bug fixes

Fixes

This HPE release includes the following fixes on the base Apache release:
GitHub Commit Number Date (YYYY-MM-DD) HPE Fix Number and Description
a9ccd721d75 2025-04-02 Backported HADOOP-19272. S3A: AWS SDK 2.25.53 warnings logged by transfer manager (#7048)
da32eff31a5 2025-04-02 Backported HADOOP-19195. S3A: Upgrade aws sdk v2 to 2.25.53 (#6900)
4456293c117 2025-04-02 MFS-21024: Fixed duplication for ssoConf file
d9b44ffdd5f 2025-03-27 MAPRHADOOP-547: Find hadoop.home for services without this system variable
c629fff28dc 2025-03-26 MAPRHADOOP-547: Added configuration for SSO to Hadoop conf file to avoid executing maprcli for class initialization for non-SSO cluster
3724417a640 2025-03-13 MAPRHADOOP-543: Added unistd.h to Windows build - skipped dynamic hdfs binary for Widnwos due Protobuf
6eef7d7eeec 2025-03-12 MAPRHADOOP-501: Fixed TestRMWebServicesCapacitySchedulerMixedMode unit tests
574cf1a1af0 2025-03-11 MAPRHADOOP-501: Fixed CS and RMFailover unit tests
57cbae26b7d 2025-03-10 Backported HADOOP-19086. Update commons-logging to 1.3.0 (#7472)
85af3cbb196 2025-03-07 MAPRHADOOP-501: Fixed NPE for TestFederationInterceptorSecure
54f9dba39b3 2025-03-07 MAPRHADOOP-501: Fixed asserts and disable RM service for new YARN tests
128dcdaa933 2025-03-07 MAPRHADOOP-540: Add java-jwt and jwks-rsa jars to get_hadoop_jars function output for support Bearer at ECO
efed0bc59fe 2025-03-06 MAPRHADOOP-501: Fixed yarn tests - fixed yarn configuration comparation - fixed asserts for CS - disable YARN_API_SERVICES for CS tests
65950b610a4 2025-03-05 MAPRHADOOP-501: Skip testJceSm4CtrCryptoCodec that relates to KMS
1782f30efb0 2025-03-05 MAPRHADOOP-538: Added httpclient and httpcore to get_hadoop_jars at mapr-eco-config.sh
63491aaaabb 2025-03-05 MAPRHADOOP-501: Fixed FileStatus for common shell unit tests and skipped some KMS tests
2069bc7705f 2025-03-04 MAPRHADOOP-501: Disable REST API for RM TestMiniMRBringup UTs
55f83ff337d 2025-03-04 MAPRHADOOP-501: Fixed distcp tools tests asserts based on EEP specific
2a1903e7597 2025-03-04 MAPRHADOOP-501: Fixed MR tests Only one cluster can be existing at any point of time (See MiniDFSCluster#build())
3a75eda4756 2025-03-03 MAPRYARN-466: Fixed issue with cleaning only 1 app output
89c674d61fc 2025-02-27 MAPRHADOOP-537: Added isSsoEnabled method to SsoConfigurationUtil for checking whether SSO is enabled on cluster or not
a7c1e296863 2025-02-26 MAPRYARN-466: Implemented NodeLocalVolume monitor for cleanup old data
2b99dc0c853 2025-02-21 Backported HADOOP-19305: Fix ProcessEnvironment ClassCastException in Shell.java (#7106) Contributed by Butao Zhang.
af363051a7c 2025-02-21 Backported YARN-11767. [UI2] upgrade moment.js to v2.30.1 (#7366)
50ad5fb1368 2025-02-21 Backported HADOOP-19465. Upgrade to netty 4.1.118 due to CVE-2025-24970 (#7413) Contributed by PJ Fanning.
b0a2063999f 2025-02-21 Backported HADOOP-19225. Upgrade Jetty to 9.4.57.v20241219 due to CVE-2024-8184 (#7116). Contributed by PJ Fanning.
0cdad359b2e 2025-02-21 Backported HADOOP-19143. Upgrade commons-cli to 1.9.0. (#7126) (#7146) Contributed by Min Yan.
de3bd47305b 2025-02-20 MAPRHADOOP-535 Make JWS algorithm configurable: default to RS256
a61214a8a2e 2025-02-20 MAPRHADOOP-535: Added jws.sso.algorithm property for configuration JWS algorithm
a78fc37f7bb 2025-02-19 MAPRHADOOP-534: Disabled SSO button for the case when SSO configuration is not available on the cluster
429ce8570c4 2025-02-18 MAPRHADOOP-532: Changed metrics log level to WARN by default for AWS tool
cfb372658a6 2025-02-17 MAPRHADOOP-533: SSO audience verification always returns validation failed
dc0f33fad5d 2025-02-11 MAPRHADOOP-530: Added information about UI service to Login page
89810a065e1 2025-02-10 MAPRYARN-465: Fixed ATSv1 cookies name for RM post event operations
f998d9973be 2025-02-07 MAPRYARN-464: Added separate name - "hadoop.tl.auth" for Timeline Server v1 cookie
d7c1aa39c2e 2025-02-04 MAPRHADOOP-531: Fixed NPE for SsoConfigurationUtil.getAudiences method
85a750dd8d2 2025-02-03 MAPRHADOOP-527: Remove NM state directory if files are corrupted
a2761c98449 2025-01-28 MAPRYARN-463: Added login page for ATSv1 UI
ae16d42875b 2025-01-23 MAPRHADOOP-526: Fixed SsoConfiguration for non-admin user execution
b5bb225071b 2025-01-22 MAPRHADOOP-525: Changed aws v1 to aws v2 sdk default symlink
53253276d3e 2025-01-21 MAPRHADOOP-514: Added label information to queue info message for FS
e892c3e993d 2025-01-21 MAPRHADOOP-515: Added root.default queue by default to configuration
eb6d6ebf0c4 2025-01-10 MAPRYARN-462: Implemented logout button for YARN UIs
4419ec692e6 2025-01-03 MAPRYARN-460: Fixed services startup for cluster without SSO configuration
6ee41f55f51 2025-01-03 MAPRYARN-459: Added login page source code to Hadoop packages
04e42bb69c9 2025-01-02 MAPRYARN-458: Implemented login page for YARN services
afe5646588f 2025-01-02 Backported HADOOP-19380. Update the year to 2025 (#7262). Contributed by Ayush Saxena.
98f4690c02f 2024-12-13 MAPRHADOOP-518: Hadoop auth cookie should expire in time as JWT if SSO is enabled
68e1a6d51fb 2024-12-11 HTTPFS-121: Added JWTAuthHandler for Bearer token authentication
ccf62812d28 2024-12-09 MAPRHADOOP-517: Added HADOOP_JWT_ENABLED property constant and remove dot from default JWT domain
0f818bbaa62 2024-12-06 MAPRHADOOP-513: JWTRedirectAuthenticationHandler support implementation for Hadoop UIs

Known Issues and Limitations

Hadoop 3.4.1.0 has the following known issue and limitation:

  • Multiple labels are not supported within the same node or queue.
  • YANR UIv2 can't be loaded without login to UIv1. For using UIv2 - https://<hostname>:8090/ui2, user must first authenticate into standard RM UI - https://<hostname>:8090. After that UIv2 will be loaded.

Resolved Issues

None.