Interoperability Matrix for Spark
This section provides information about support and interoperability for Spark and its components with HPE Ezmeral Runtime Enterprise.
The following table lists the versions of Spark and its components by HPE Ezmeral Runtime Enterprise release.
| HPE Ezmeral Runtime EnterpriseVersions | Spark Operator Versions | Spark Applications Versions* | Livy Versions | Spark History Server Versions | Spark Thrift Server Versions | Hive Metastore Versions |
|---|---|---|---|---|---|---|
| 5.6.x and higher | 1.3.8.0-hpe | 3.3.1 | 0.7.0 | 3.3.1 | 3.3.1 | 3.1.3 |
| 2.4.7 | 0.7.0-2.4.7 | |||||
| 5.5.1 | 1.3.8.0-hpe | 3.2.0 | 0.7.0 | 3.2.0 | 3.2.0 | 2.3.9 |
| 2.4.7 | 0.7.0-2.4.7 | |||||
| 5.5.0 | 1.3.7.1-hpe | 3.2.0 | 0.7.0 | 3.2.0 | 3.2.0 | 2.3.9 |
| 2.4.7 | 0.7.0-2.4.7 | |||||
| 5.4.1 | 1.2.2.0-hpe | 3.1.2 | 0.7.0 | 3.1.2 | 3.1.2 | 2.3.8 |
| 2.4.7 | 0.5.0 | |||||
| 5.4.0 | 1.2.2.0-hpe | 3.1.2 | 0.7.0 | 3.1.2 | 3.1.2 | 2.3.8 |
| 2.4.7 | 0.5.0 |
*Starting from HPE Ezmeral Runtime Enterprise 5.5.0, you can choose to use Spark images provided by HPE Ezmeral Runtime Enterprise or your own open-source Spark images. Livy does not support open-source Spark images on HPE Ezmeral Runtime Enterprise. See Spark Operator for details.