What's New in EEP 9.0.0

Summarizes the new features and product updates in Ecosystem Pack (EEP) 9.0.0.

EEP 9.0.0 can be used with core 7.1.0. For more information about EEP and core version support, see EEP Support and Lifecycle Status.

EEP 9.0.0 Versions and Features

EEP 9.0.0 introduced three new components:
  • NiFi
  • Ranger
  • Zeppelin
EEP 9.0.0 also provided significant updates to many components. Other components received minor updates. The following table summarizes the significant version updates in EEP 9.0.0:
Component EEP 8.1.0 Version EEP 9.0.0 Version
Data Access Gateway 4.0.0.0 5.0.0.0
Drill 1.16.1 1.20.2
Hadoop 2.7.6.200 3.3.4.0
Hive 2.3 3.1.3.0
NiFi Not present 1.16.3.0
Ranger Not present 2.3.0.0
Spark 3.2.0.0 3.3.0.0
Zeppelin Not present 0.10.1.0

To compare the versions of various components in different EEPs, see Component Versions for Released EEPs.

Drill 1.20.2 Support

In EEP 9.0.0, Drill is upgraded from version 1.16.1 to 1.20.2. Drill 1.20.2 provides some fixes and new features, including a TLS update to version 1.3, persistent HBase storage for query profiles, and query-profile data masking based on user filters. For additional information, see Drill 1.20.2.0-2210 (EEP 9.0.0) Release Notes.

Hadoop 3.3.4 Support

EEP 9.0.0 includes Hadoop 3.3.4.0. This Hadoop version adds ATS v2 support and enables GPU support for Spark. In addition, HTTPFS is a part of Hadoop 3. See Hadoop 3.3.4.0 - 2210 (EEP 9.0.0) Release Notes.

Hive 3.1.3 Support

EEP 9.0.0 includes Hive 3.1.3. Hive 3.1.3 includes support for Ranger and new Hive Metastore configuration properties, and also API changes.

For more information, see Hive 3.1.3 API Changes and the Hive 3.1.3.0 - 2210 (EEP 9.0.0) Release Notes.

NiFi 1.16.3.0 Support

EEP 9.0.0 includes NiFi 1.16.3.0. For more information, see NiFi 1.16.3.0 - 2210 (EEP 9.0.0) Release Notes.

Ranger 2.3 Support

EEP 9.0.0 includes Ranger 2.3.0.0. Apache Ranger provides centralized security administration and fine-grain access control for user access within Apache Hadoop, Apache Hive, Apache HBase and other Apache components. For more information, see Ranger.

Spark 3.3 Support

EEP 9.0.0 includes Spark 3.3, which supports GPU-aware scheduling. Spark 3.3 enables use of the RAPIDS Accelerator by Nvidia to accelerate Spark processing. For more information, see Apache Spark Feature Support, the RAPIDS Accelerator Overview, and the Spark Release Notes.

Zeppelin 0.10.1 Support

EEP 9.0.0 includes Zeppelin 0.10.1.0, which is now offered as an RPM or DEB package in the ecosystem pack. Previous releases of Zeppelin consisted of a Docker container, which was offered as part of the Data Science Refinery (DSR) product in releases 6.0.0 and later. As indicated in Discontinued Ecosystem Components, support for DSR is discontinued. Note that upgrades from the Docker-image based Zeppelin product to the package-based Zeppelin product are not supported.

For more information about Zeppelin 0.10.1.0, see Zeppelin and the Zeppelin 0.10.1.0 - 2210 Release Notes.

Discontinued Components

The following components are present in earlier ecosystem packs but are not included in EEP 9.0.0:
  • Flume
  • Oozie
  • Pig
  • S3 Gateway
  • Sqoop

For more information, see Discontinued Ecosystem Components.

Installer Support for EEP 9.0.0

Installer 1.18.0.0 supports EEP 9.0.0 and previously released EEPs. For a list of the EEPs that are supported by different versions of the Installer, see Installer EEP Support.

Installer 1.18.0.x cannot be used with older versions of Ubuntu. For more information, see Selecting an Installer Version to Use.

EEP Upgrades

IMPORTANT
Installer 1.18.0.2 supports core upgrades only from release 7.2.0 to 7.3.0. All EEP upgrades are supported. To upgrade core or EEP manually, see these topics:
If your cluster is currently running EEP 5.x or 6.x, you can upgrade to Ecosystem Pack 6.4.0. If your cluster is running EEP 8.0.0 or 8.1.0, you can upgrade to Ecosystem Pack 9.x.x.
For information about upgrading EEPs, see:
For information about upgrading to core 7.1.0 and EEP 8.1.0, see:

EEP 9.0.0 Ecosystem Components and Release Notes

For a list of the EEP 9.0.0 components and their release notes, see Ecosystem Pack 9.0.0 Release Notes.