What's New in DEP 10.0.0

Summarizes the new features and product updates in Data Fabric Ecosystem Pack( DEP) 10.0.0.

DEP 10.0.0 can be used with releases:
  • 8.0.0

For more information about DEP or EEP, and core version support, see Ecosystem Pack Support and Lifecycle Status.

DEP 10.0.0 Version Updates

DEP 10.0.0 provided minor/major updates various components. The following table summarizes the version updates for DEP 10.0.0:
Component EEP 9.4.1 Version DEP 10.0.0 Version Major/Minor Update Links
Drill 1.21.2.200 1.21.2.300 Minor See Drill 1.21.2.300 (DEP 10.0.0) Release Notes.
Data Access Gateway 6.3.0.2 7.0.0 Major
Flink NA 2.0.0 Major See Flink 2.0.0.0 - 2510 (DEP 10.0.0) Release Notes.
HBase 1.4.14.800 1.4.14.850 Minor See HBase 1.4.14.850 - 2510 (DEP 10.0.0) Release Notes.
Hadoop 3.4.1.100 3.4.1.200 Minor See Hadoop 3.4.1.100 (DEP 10.0.0) Release Notes.
Hive 3.1.3.800 3.1.3.850 Minor See Hive 3.1.3.850 (DEP 10.0.0) Release Notes.
Hue 4.11.0.300 4.11.0.400 Minor See Hue 4.11.0.400 (DEP 10.0.0) Release Notes.
Livy 0.8.0.100 0.8.0.200 Minor See Livy 0.8.0.200 - 2510 (DEP 10.0.0) Release Notes.
Tez 0.10.2.550 0.10.2.600 Minor See Tez 0.10.2.600 (DEP 10.0.0) Release Notes.
KSQL 7.6.0.200 7.6.0.300 Minor See KSQL 7.6.0.300 (DEP 10.0.0) Release Notes.
Kafka Connect HDFS 10.2.6.100 10.2.6.200 Minor See Kafka Connect HDFS 10.2.6.200 (DEP 10.0.0) Release Notes.
Kafka Connect JDBC 10.7.4.100 10.7.4.200 Minor See Kafka Connect JDBC 10.7.4.200 (DEP 10.0.0) Release Notes.
Kafka Schema Registry 7.6.0.300 7.6.0.400 Minor See Kafka Schema Registry 7.6.0.400 (DEP 10.0.0) Release Notes.
Kafka Rest Proxy 7.6.0.200 7.6.0.300 Minor See Kafka REST Proxy 7.6.0.300 (DEP 10.0.0) Release Notes.
Kafka Streams 3.6.1.200 3.6.1.300 Minor See Kafka Streams 3.6.1.300 (DEP 10.0.0) Release Notes.
Polaris NA 1.0.1.0 Major See Polaris 1.0.1.0 - 2510 (DEP 10.0.0) Release Notes.
Ranger 2.4.0.100 2.4.0.200 Major See Ranger 2.4.0.200 - 2510 (DEP 10.0.0) Release Notes.
Airflow 2.10.5.100 3.0.6.0 Major See Airflow 3.0.6.0 (DEP 10.0.0) Release Notes.
NiFi 1.28.0.100 1.28.0.200 Minor See NiFi 1.28.0.200 - 2510 (DEP 10.0.0) Release Notes.
Zeppelin 0.10.1.200 0.10.1.300 Minor See Zeppelin 0.10.1.300 - 2510 Release Notes.

To compare the versions of various components in different EEPs, see Component Versions for Released Ecosystem Packs.

The following components are unchanged for EEP 9.4.0:
  • AsyncHBase 1.8.2
  • Collectd 5.12.0.750
  • DAG 6.3.0.2
  • Elasticsearch 6.8.8.760
  • Ezotelcol 0.80.0.39
  • Fluentd 1.10,3.660
  • Grafana 7.5.10.650
  • Hue 4.11.0.200
  • Kibana 6.8.8.700
  • OpenTSDB 2.4.1.700
  • Streams clients:
    • HPE Ezmeral Data Fabric Streams C Client 0.11.3
    • HPE Ezmeral Data Fabric Streams Python Client 0.11.3
    • HPE Ezmeral Data Fabric Streams C#/.NET 0.11.3

Monitoring Components are not Present in EEP 9.3.2 or Higher Releases

Beginning with release 7.8.0 and EEP 9.3.0, the monitoring components are provided in the Data Fabric (core) repository and are not present in the EEP repository. Monitoring packages include the following:
  • mapr-collectd
  • mapr-elasticsearch
  • mapr-fluentd
  • mapr-grafana
  • mapr-kibana
  • mapr-opentsdb
For example, the RHEL monitoring packages for release 7.8.0 can be found at:
https://package.ezmeral.hpe.com/releases/v7.8.0/redhat/
The RHEL monitoring packages are not present in the repository for EEP 9.3.0 at:
https://package.ezmeral.hpe.com/releases/MEP/MEP-9.3.0/redhat/
The same is true for the monitoring packages for Rocky Linux, Ubuntu, SLES, and Oracle Enterprise Linux.

Support for JDK 11 and JDK 17

EEP 9.4.1 and core 7.10.0 can be used with JDK 11 or JDK 17. However, Installer 1.18.0.10 is not supported on JDK 17. Therefore, installations of or upgrades to EEP 9.4.0 and core 7.10.0 must be performed manually. See Java Support Matrix and Installer Updates.

Using the monitoring components with JRE or JDK 17 is supported in EEP 9.2.0 or later.

Installer Support for DEP 10.0.0

Installer 1.18.0.12 supports DEP 10.0.0 and previously released EEPs. For a list of the EEPs that are supported by different versions of the Installer, see Installer DEP and EEP Support.

Installer 1.18.0.12 is not supported for use with JDK 17. In addition, Installer 1.18.0.x cannot be used with older versions of Ubuntu. For more information, see Selecting an Installer Version to Use.

EEP Upgrades

If your cluster is running EEP 8.0.0 or 8.1.0, you can upgrade to Ecosystem Pack 9.x.x.

For information about upgrading to core 7.8.0 and EEP 9.3.0, see:

DEP 10.0.0 Ecosystem Components and Release Notes

For a list of the DEP 10.0.0 components and their release notes, see Ecosystem Component Release Notes.