Spark Images

This topic lists the images that must be available to install and run Spark Operator, Apache Livy, Spark History Server, Spark Thrift Server, and Hive Metastore. These images enables you to run the Spark applications in an air-gapped environment.

Images for HPE Ezmeral Runtime Enterprise 5.6.1

Images for Spark 3.3.1

The following images are required in order to install and run Spark and Spark based services:
Spark Operator Images
gcr.io/mapr-252711/spark-operator-1.3.8:1.3.8.2-1.3.8.2-hpe
Spark Applications and Livy Session Images
gcr.io/mapr-252711/spark-3.3.1:202301161621R
gcr.io/mapr-252711/spark-py-3.3.1:202301161621R
gcr.io/mapr-252711/spark-r-3.3.1:202301161621R
gcr.io/mapr-252711/spark-gpu-3.3.1:202301161621R
Spark Based Services Images
gcr.io/mapr-252711/spark-hs-3.3.1:202301161621R
gcr.io/mapr-252711/spark-ts-3.3.1:202301161621R
gcr.io/mapr-252711/livy-0.7.0:202301161621R
gcr.io/mapr-252711/hivemeta-3.1.3:202301161621R

Images for Spark 2.4.7

The following images are required in order to install and run Spark and Spark based services:
Spark Operator Images
gcr.io/mapr-252711/spark-operator-1.3.8:1.3.8.2-1.3.8.2-hpe
Spark Applications and Livy Session Images
gcr.io/mapr-252711/spark-2.4.7:202210110658R
gcr.io/mapr-252711/spark-py-2.4.7:202210110658R
gcr.io/mapr-252711/spark-r-2.4.7:202210110658R
Spark Based Services Images
gcr.io/mapr-252711/spark-hs-2.4.7:202210110658R
gcr.io/mapr-252711/spark-ts-2.4.7:202210110658R
gcr.io/mapr-252711/livy-0.7.0-2.4.7:202301161621R
gcr.io/mapr-252711/hivemeta-3.1.3:202301161621R

Images for HPE Ezmeral Runtime Enterprise 5.6.0

Images for Spark 3.3.1

The following images are required in order to install and run Spark and Spark based services:
Spark Operator Images
gcr.io/mapr-252711/spark-operator-1.3.8:1.3.8.0-202211111429
Spark Applications and Livy Session Images
gcr.io/mapr-252711/spark-3.3.1:202212201209R
gcr.io/mapr-252711/spark-py-3.3.1:202212201209R
gcr.io/mapr-252711/spark-r-3.3.1:202212201209R
gcr.io/mapr-252711/spark-gpu-3.3.1:202212201209R
Spark Based Services Images
gcr.io/mapr-252711/spark-hs-3.3.1:202212201209R
gcr.io/mapr-252711/spark-ts-3.3.1:202212201209R
gcr.io/mapr-252711/livy-0.7.0:202212201209R
gcr.io/mapr-252711/hivemeta-3.1.3:202212160615R

Images for Spark 2.4.7

The following images are required in order to install and run Spark and Spark based services:
Spark Operator Images
gcr.io/mapr-252711/spark-operator-1.3.8:1.3.8.0-202211111429
Spark Applications and Livy Session Images
gcr.io/mapr-252711/spark-2.4.7:202210110658R
gcr.io/mapr-252711/spark-py-2.4.7:202210110658R
gcr.io/mapr-252711/spark-r-2.4.7:202210110658R
Spark Based Services Images
gcr.io/mapr-252711/spark-hs-2.4.7:202212201209R
gcr.io/mapr-252711/spark-ts-2.4.7:202212201209R
gcr.io/mapr-252711/livy-0.7.0-2.4.7:202212201209R
gcr.io/mapr-252711/hivemeta-3.1.3:202212160615R