Support Matrixes

This section provides information about support and interoperability for HPE Ezmeral Runtime Enterprise and its components.

This information supplements information about system requirements. See System Requirements

OS Versions

See OS Support.

GPU Support

For hardware support, see the following table. For software, driver, and MIG support, see GPU and MIG Support.

HPE Ezmeral Runtime Enterprise Components

HPE Ezmeral Data Fabric

HPE Ezmeral Runtime Enterprise supports the use of different implementations of HPE Ezmeral Data Fabric. Depending on the release version, a given implementation of HPE Ezmeral Data Fabric can be connected as external storage, registered as Tenant/Persistent storage, or both.

In summary, the implementations of HPE Ezmeral Data Fabric are the following:

HPE Ezmeral Data Fabric on Bare Metal

HPE Ezmeral Data Fabric on Bare Metal is an implementation of HPE Ezmeral Data Fabric that is on physical or virtual machines that are not part of the HPE Ezmeral Runtime Enterprise deployment.

HPE Ezmeral Data Fabric on Bare Metal is the only supported implementation of HPE Ezmeral Data Fabric for production deployments of HPE Ezmeral Runtime Enterprise. HPE Ezmeral Data Fabric on Bare Metal is also supported for non-production deployments.

HPE Ezmeral Data Fabric on Kubernetes

HPE Ezmeral Data Fabric on Kubernetes is an implementation of HPE Ezmeral Data Fabric in a Kubernetes cluster.

HPE Ezmeral Data Fabric on Kubernetes is available for use in non-production deployments of HPE Ezmeral Runtime Enterprise, but it is not supported for production environments.

Embedded Data Fabric

Embedded Data Fabric is a legacy implementation of HPE Ezmeral Data Fabric that is locally Embedded and runs on HPE Ezmeral Runtime Enterprise hosts.

Embedded Data Fabric is not supported on 5.5.0 and later releases of HPE Ezmeral Runtime Enterprise. Hewlett Packard Enterprise recommends using HPE Ezmeral Data Fabric on Bare Metal for production deployments. For non-production deployments, you can use either HPE Ezmeral Data Fabric on Bare Metal or HPE Ezmeral Data Fabric on Kubernetes.

In an HPE Ezmeral Runtime Enterprise deployment, only one HPE Ezmeral Data Fabric instance can be registered as Tenant/Persistent storage.

¹ Beginning with HPE Ezmeral Runtime Enterprise 5.5.0, HPE Ezmeral Data Fabric on Kubernetes is supported in non-production environments only.

² Embedded Data Fabric aligns with HPE Ezmeral Data Fabric on bare metal Core 6.1.

³ "Discouraged" means that Hewlett Packard Enterprise strongly recommends that you upgrade to the latest release of HPE Ezmeral Runtime Enterprise (5.4.x, 5.5.0 or later) and migrate existing Embedded Data Fabric deployments toHPE Ezmeral Data Fabric on Bare Metal, or (for non-production deployments only) HPE Ezmeral Data Fabric on Kubernetes. For more information, contactHewlett Packard Enterprise Technical Support.

See also:

• Configuring Cross-Cluster Trust
• Requirements for HPE Ezmeral Data Fabric on Kubernetes (for non-production environments only)
• Using the CSI
• NFS Support

Kubernetes Versions

The supported versions of Kubernetes vary by host OS and whether the Kubernetes cluster is imported into HPE Ezmeral Runtime Enterprise. See HPE Ezmeral Runtime Enterprise Components and Version Requirements for Imported Kubernetes Clusters.

In some cases, you can update Kubernetes to later versions than listed for yourHPE Ezmeral Runtime Enterprise release version without upgrading HPE Ezmeral Runtime Enterprise. See Kubernetes Bundles.

For additional Kubernetes requirements, see also:

• Requirements for HPE Ezmeral Data Fabric on Kubernetes (for non-production environments only)
• The Kubernetes System Requirements
• Kubernetes Cluster Types and Compatibility

¹ Supported during migration of existing Kubernetes clusters to 1.23.9-hpe1 (preferred) or to 1.22.12-hpe1. Not supported for new Kubernetes clusters or for ongoing operations in a production deployment.

² Supported for existing Kubernetes clusters until those legacy clusters are migrated to a Hewlett Packard Enterprise distribution of Kubernetes. You cannot upgrade a legacy Kubernetes cluster without also migrating the cluster to a Hewlett Packard Enterprise distribution of Kubernetes. Not supported for new Kubernetes clusters or for ongoing operations in a production deployment.

³ Supported during migration of existing Kubernetes clusters to 1.23.13-hpe1 (preferred) or to 1.22.15-hpe1. Not supported for new Kubernetes clusters or for ongoing operations in a production deployment.

Imported Kubernetes Clusters

HPE Ezmeral Runtime Enterprise 5.6.x or higher does not support Imported Kubernetes clusters.

Version Requirements for Imported Kubernetes Clusters

Imported Kubernetes clusters are not supported on HPE Ezmeral Runtime Enterprise 5.4.x, 5.5.x or later releases.

HPE Ezmeral Runtime Enterprise 5.2.x and 5.3.x releases support the following Kubernetes versions for clusters that are imported into the platform.

Add-On Versions

The following table lists the versions of system and application add-ons by HPE Ezmeral Runtime Enterprise release. KubeDirector is a prerequisite for the analytics and HPE Ezmeral ML Ops add-ons.

In some cases, you can update add-ons to later versions without upgrading HPE Ezmeral Runtime Enterprise to a later version. See Kubernetes Bundles.

For version information about the container runtimes, HPECP agent, and kubectl, see HPE Ezmeral Runtime Enterprise Components.

^* Istio is a prerequisite for Kubeflow 1.3 and later. However, Istio 1.9.8, which is the version of Istio that is shipped with HPE Ezmeral Runtime Enterprise 5.4.0 or 5.4.1, is not supported on Kubernetes 1.21 and later. HPE Ezmeral Runtime Enterprise prevents existing clusters that have Istio 1.9.8 from being upgraded to Kubernetes 1.21.x.

^* Istio is a prerequisite for Kubeflow 1.3 and later. However, Istio 1.9.8, which is the version of Istio that is shipped with HPE Ezmeral Runtime Enterprise 5.4.0 or 5.4.1, is not supported on Kubernetes 1.21 and later. HPE Ezmeral Runtime Enterprise prevents existing clusters that have Istio 1.9.8 from being upgraded to Kubernetes 1.21.x.

Kubernetes Bundles

The following table lists the versions and content of Kubernetes bundles and their compatible versions of HPE Ezmeral Runtime Enterprise. For more information about Kubernetes bundles, see Kubernetes Bundles.

Airflow (2.3-04f50a2)
ArgoCD (2.5.2-04f50a2)
ERE Service Accounts (0.2-04f50a2)
Falco (0.33.0-04f50a2)
HPECP Agent (1.3.1-7e1d6f6-04f50a2)
Istio (1.14.5-04f50a2)
KubeDirector (0.11.0-04f50a2)
Kubeflow (1.6-5.6.1-67dcdba)
Kubernetes Dashboard (v2.7.0-04f50a2)
Metrics Server (v0.6.2-04f50a2)
Monitoring (6.6.7-04f50a2)
NVIDIA GPU Metrics (6.6.3-04f50a2)
NVIDIA plugin (0.12.3-04f50a2)
Open Policy Agent Gatekeeper (3.10.0-04f50a2)
Spark Operator (1.3.8.1-82f8759-04f50a2)
Tenant Operator (picasso-1.5.2-GA-ERE56-drop1-75-0)
hpecp-bootstrap-prometheus (41.7.4-04f50a2)

Airflow (2.3-04f50a2)
ArgoCD (2.5.2-04f50a2)
ERE Service Accounts (0.2-04f50a2)
Falco (0.33.0-04f50a2)
HPECP Agent (1.3.1-7e1d6f6-04f50a2)
Istio (1.14.5-04f50a2)
KubeDirector (0.11.0-04f50a2)
Kubeflow (1.6-5.6.1-67dcdba)
Kubernetes Dashboard (v2.7.0-04f50a2)
Metrics Server (v0.6.2-04f50a2)
Monitoring (6.6.7-04f50a2)
NVIDIA GPU Metrics (6.6.3-04f50a2)
NVIDIA plugin (0.12.3-04f50a2)
Open Policy Agent Gatekeeper (3.10.0-04f50a2)
Spark Operator (1.3.8.1-82f8759-04f50a2)
Tenant Operator (picasso-1.5.2-GA-ERE56-drop1-75-0)
hpecp-bootstrap-prometheus (41.7.4-04f50a2)

Airflow (2.3-04f50a2)
ArgoCD (2.5.2-04f50a2)
ERE Service Accounts (0.2-04f50a2)
Falco (0.33.0-04f50a2)
HPECP Agent (1.3.1-7e1d6f6-04f50a2)
Istio (1.14.5-04f50a2)
KubeDirector (0.11.0-04f50a2)
Kubeflow (1.6-5.6.1-67dcdba)
Kubernetes Dashboard (v2.7.0-04f50a2)
Metrics Server (v0.6.2-04f50a2)
Monitoring (6.6.7-04f50a2)
NVIDIA GPU Metrics (6.6.3-04f50a2)
NVIDIA plugin (0.12.3-04f50a2)
Open Policy Agent Gatekeeper (3.10.0-04f50a2)
Spark Operator (1.3.8.1-82f8759-04f50a2)
Tenant Operator (picasso-1.5.2-GA-ERE56-drop1-75-0)
hpecp-bootstrap-prometheus (41.7.4-04f50a2)

1.22.15-hpe3
1.23.14-hpe2 
1.24.8-hpe2

Airflow (2.3-67a049e)
ArgoCD (2.5.2-ba31668)
ERE Service Accounts (0.2-da188d2)
Falco (0.33.0-b9eff56)
HPECP Agent (1.3.0-8bf3031-2e67bb4)
Istio (1.14.5-d006b58)
KubeDirector (0.11.0-7c59acf)
Kubeflow (1.6-5.6.0-0c86715)
Kubernetes Dashboard (v2.7.0-0349604)
Metrics Server (v0.6.2-15bd0b2)
Monitoring (6.6.7-b9eff56)
NVIDIA GPU Metrics (6.6.3-a4fbfa3)
NVIDIA plugin (0.12.3-d006b58)
Open Policy Agent Gatekeeper (3.10.0-d006b58)
Spark Operator (1.3.8.0-e69e44a-d88da3c)
Tenant Operator (picasso-1.5.2-GA-ERE56-drop1-75-0)
hpecp-bootstrap-prometheus (41.7.4-d49d66c)

1.22.15-hpe3
1.23.14-hpe2 
1.24.8-hpe2

Airflow (2.3-67a049e)
ArgoCD (2.5.2-ba31668)
ERE Service Accounts (0.2-da188d2)
Falco (0.33.0-b9eff56)
HPECP Agent (1.3.0-8bf3031-2e67bb4)
Istio (1.14.5-d006b58)
KubeDirector (0.11.0-7c59acf)
Kubeflow (1.6-5.6.0-0c86715)
Kubernetes Dashboard (v2.7.0-0349604)
Metrics Server (v0.6.2-15bd0b2)
Monitoring (6.6.7-b9eff56)
NVIDIA GPU Metrics (6.6.3-a4fbfa3)
NVIDIA plugin (0.12.3-d006b58)
Open Policy Agent Gatekeeper (3.10.0-d006b58)
Spark Operator (1.3.8.0-e69e44a-d88da3c)
Tenant Operator (picasso-1.5.2-GA-ERE56-drop1-75-0)
hpecp-bootstrap-prometheus (41.7.4-d49d66c)

1.21.14-hpe2 
1.22.15-hpe1
1.23.13-hpe1

Airflow (2.3-2b38953)
ArgoCD (2.4.17-3c54efb)
ERE Service Accounts (0.2-6155d23)
Falco (0.32.2-a3473ed)
HPECP Agent (1.2.7-234eba4-6155d23)
Istio (1.13.5-e3f62ee)
Kube State Metrics (2.3.0-db64c34)
KubeDirector (0.11.0-9726ef0)
Kubeflow (1.6-d475bce)
Kubernetes Dashboard (v2.7.0-a650c50)
Metrics Server (v0.6.1-6155d23)
Monitoring (6.6.7-6155d23)
NVIDIA GPU Metrics (6.5.5-6155d23)
NVIDIA plugin (0.12.3-4ae1978)
Open Policy Agent Gatekeeper (3.10.0-58c0a78)
Spark Operator (1.3.8.0-14ea66c-5455643)
Tenant Operator (picasso-1.5.2-drop1-74-0)

1.21.14-hpe1 
1.22.12-hpe1
1.23.9-hpe1

airflow 2.2-ce70c0b
argocd 2.2.5-ad3d17b
falco 0.32.2-a3473ed
hpecp-agent 1.2.5-5df266a-6155d23
hpecp-monitoring 6.6.7-6155d23
hpecp-nvidiagpubeat 6.5.5-6155d23
hpecp-serviceaccounts 0.2-6155d23
istio 1.13.5-547eb22
kube-state-metrics 2.3.0-db64c34
kubedirector 0.11.0-9726ef0
kubeflow 1.6-fd89c89
kubernetes-dashboard v2.7.0-a650c50
metrics-server v0.6.1-6155d23
nvidia-plugin 0.12.3-4ae1978
opa-gatekeeper 3.9.0-ad3d17b
picasso picasso-1.5.2-drop1-74-0
spark-operator 1.3.7.1-1a83a98-5455643

Kubernetes Applications

See the following:

• Spark Support and Interoperability Matrix for Spark
• Livy Overview
• Kubeflow
• Airflow

Kubeflow Components (5.6.x and higher)

Kubeflow Operator version is 1.6.

Beginning with HPE Ezmeral Runtime Enterprise 5.5.1, Kubeflow notebooks are available. However, Hewlett Packard Enterprise recommends that you use full-featured KubeDirector notebooks instead.

The following table lists the components that Kubeflow deploys.

Kubeflow Components (5.5.x)

Kubeflow Operator version is 1.6.

Beginning with HPE Ezmeral Runtime Enterprise 5.5.1, Kubeflow notebooks are available. However, Hewlett Packard Enterprise recommends that you use full-featured KubeDirector notebooks instead.

The following table lists the components that Kubeflow deploys.

Kubeflow Components (5.4.0-5.4.1)

The Kubeflow Operator version is: 1.3

The following table lists the components that Kubeflow deploys.