What's New in DEP 10.2.0

Summarizes the new features and product updates in Data Fabric Ecosystem Pack( DEP) 10.2.0

DEP 10.2.0 can be used with releases:
  • 8.0.0
  • 8.1.0
  • 8.2.0

For more information about DEP or EEP, and core version support, see Ecosystem Pack Support and Lifecycle Status.

DEP 10.2.0 Version Updates

DEP 10.2.0 provided minor/major updates various components. The following table summarizes the version updates for DEP 10.2.0:
Component DEP 10.0.1 Version DEP 10.1.0 Version DEP 10.1.1 Version DEP 10.2.0 Version Major/Minor Update Links
Airflow 3.0.6.100 3.1.7.0 3.1.7.100 3.2.2.0 Major See Airflow 3.2.2.0 (DEP 10.2.0) Release Notes.
Drill 1.21.2.300 1.21.2.350 1.21.2.360 1.22.0.0 Major See Drill 1.22.0.0 (DEP 10.2.0) Release Notes.
Data Access Gateway 7.0.0 7.1.0 7.1.0.1 7.1.0.1 7.2.0.0 See Data Access Gateway 7.2.0.0 Release Notes.
Flink 2.0.0 2.0.100 2.0.100 2.0.100 NA See Flink 2.0.0.100 - 2604 (DEP 10.1.0) Release Notes.
HBase 1.4.14.900 1.4.14.900 1.4.14.900 1.4.14.920 Minor See HBase 1.4.14.920 - 2610 (DEP 10.2.0) Release Notes.
Hadoop 3.4.1.300 3.4.1.400 3.4.1.450 3.4.1.500 Minor See Hadoop 3.4.1.500 (DEP 10.2.0) Release Notes.
Hive 3.1.3.900 3.1.3.950 3.1.3.975 3.1.3.1000 Minor See Hive 3.1.3.1000 (DEP 10.2.0) Release Notes.
Hue 4.11.0.400 4.11.0.450 4.11.0.450 4.11.0.450 NA See Hue 4.11.0.450 (DEP 10.1.0) Release Notes.
Iceberg Catalog migrator 0.0.1.0 0.0.1.0 0.0.1.0 0.0.1.0 N/A Iceberg Catalog Migrator 0.0.1.0 (DEP 10.0.1) Release Notes
Livy 0.8.0.200 0.8.0.300 0.8.0.300 0.9.0.0 Major See Livy 0.9.0.0 - 2610 (DEP 10.2.0) Release Notes.
Tez 0.10.2.650 0.10.2.650 0.10.2.650 0.10.2.650 NA See Tez 0.10.2.650 (DEP 10.0.1) Release Notes.
KSQL 7.6.0.300 7.6.0.350 7.6.0.350 7.6.0.400 Minor See KSQL 7.6.0.400 (DEP 10.2.0) Release Notes.
Kafka Connect HDFS 10.2.6.200 10.2.6.200 10.2.6.210 10.2.6.300 Minor See Kafka Connect HDFS 10.2.6.300 (DEP 10.2.0) Release Notes.
Kafka Connect JDBC 10.7.4.200 10.7.4.200 10.7.4.200 10.7.4.300 Minor See Kafka Connect JDBC 10.7.4.300 (DEP 10.2.0) Release Notes.
Kafka Schema Registry 7.6.0.400 7.6.0.400 7.6.0.400 7.6.0.500 Minor See Kafka Schema Registry 7.6.0.500 (DEP 10.2.0) Release Notes.
Kafka REST Proxy 7.6.0.300 7.6.0.300 7.6.0.300 7.6.0.400 Minor See Kafka REST Proxy 7.6.0.400 (DEP 10.2.0) Release Notes.
Kafka Streams 3.6.1.300 3.6.1.300 3.6.1.300 3.6.1.400 Minor See Kafka Streams 3.6.1.400 (DEP 10.2.0) Release Notes.
Polaris 1.0.1.100 1.3.0.0 1.3.0.0 1.7.0.0 Major See Polaris 1.7.0.0 (DEP 10.2.0) Release Notes.
Ranger 2.4.0.200 2.4.0.200 2.4.0.200 2.4.0.300 Major See Ranger 2.4.0.300 - 2610 (DEP 10.2.0) Release Notes.
Spark 3.5.5.400 3.5.5.500 3.5.5.600 4.1.3.0 Major See .Spark 4.1.3.0 (DEP 10.2.0) Release Notes.
NiFi 1.28.0.250 1.28.0.300 1.28.0.310 1.28.0.310 NA See NiFi 1.28.0.310 - 2607 (DEP 10.1.1) Release Notes.
Zeppelin 0.10.1.300 0.10.1.400 0.10.1.400 0.10.1.500 Minor See Zeppelin 0.10.1.500 - 2610 Release Notes.

To compare the versions of various components in different EEPs, see Component Versions for Released Ecosystem Packs.

The following components are unchanged for DEP 10.2.0:
  • AsyncHBase 1.8.2
  • Ezotelcol 0.80.0.39
  • Flink 2.0.100
  • Hue 4.11.0.450
  • Nifi 1.28.0.310
  • Tez 0.10.2.650
  • Streams clients:
    • HPE Ezmeral Data Fabric Streams C Client 0.11.3
    • HPE Ezmeral Data Fabric Streams Python Client 0.11.3
    • HPE Ezmeral Data Fabric Streams C#/.NET 0.11.3

Monitoring Components are not Present in EEP 9.3.2 or Higher Releases

Beginning with release 7.8.0 and EEP 9.3.0, the monitoring components are provided in the Data Fabric (core) repository and are not present in the EEP repository. Monitoring packages include the following:
  • mapr-collectd
  • mapr-elasticsearch
  • mapr-fluentd
  • mapr-grafana
  • mapr-kibana
  • mapr-opentsdb
For example, the RHEL monitoring packages for release 7.8.0 can be found at:
https://package.ezmeral.hpe.com/releases/v7.8.0/redhat/
The RHEL monitoring packages are not present in the repository for EEP 9.3.0 at:
https://package.ezmeral.hpe.com/releases/MEP/MEP-9.3.0/redhat/
The same is true for the monitoring packages for Rocky Linux, Ubuntu, SLES, and Oracle Enterprise Linux.

Support for JDK 17 and JDK 21

Starting from DEP 10.1.0, the DEP can be used with JDK 17 or JDK 21.

Using the monitoring components with JRE or JDK 17 is supported in EEP 9.2.0 or later.

Installer Support for DEP 10.2.0

Installer 1.18.0.12 supports DEP 10.2.0 and previously released DEPs. For a list of the DEPs that are supported by different versions of the Installer, see Installer DEP and EEP Support.

Installer 1.18.0.12 is not supported for use with JDK 17. In addition, Installer 1.18.0.x cannot be used with older versions of Ubuntu. For more information, see Selecting an Installer Version to Use.

EEP Upgrades

If your cluster is running EEP 8.0.0 or 8.1.0, you can upgrade to Ecosystem Pack 9.x.x.

For information about upgrading to core 7.8.0 and EEP 9.3.0, see:

DEP 10.2.0 Ecosystem Components and Release Notes

For a list of the DEP 10.2.0 components and their release notes, see Ecosystem Component Release Notes.