Installing and Configuring Hive Metastore

This section describes how to install and configure Hive Metastore on HPE Ezmeral Runtime Enterprise.

Prerequisites

  1. Log in as a Kubernetes Tenant Administrator or a Kubernetes Tenant Member in HPE Ezmeral Runtime Enterprise.

About this task

In HPE Ezmeral Runtime Enterprise, you can install Hive Metastore using GUI or manually using the Helm chart for Apache Spark.

Learn more about supported Spark versions at Interoperability Matrix for Spark.

Installing Hive Metastore Using the GUI

About this task

Install the Hive Metastore by using the HPE Ezmeral Runtime Enterprise GUI.

Procedure

  1. Log in as a Kubernetes Tenant Administrator or a Kubernetes Tenant Member on the HPE Ezmeral Runtime Enterprise GUI.
  2. Click Applications in the main menu. You will see Kubernetes Applications tiles under KubeDirector tab.
  3. Navigate to Hive Metastore tile and click Launch.
  4. Configure Cluster Detail and Settings on Create Application screen.
    Cluster Detail:
    Enter the Name and Description of the application.
    Settings:
    Set the CPU and Memory (GB) resources.
    To set MySQL Database Settings, check MySQL Database and set MySQL URL, MySQL Username, and MySQL Password.
    For example: Enter the clear text password in the Create Application screen.

    When you enter the clear text MySQL password in Create Application screen, the MySQL password will be Base64-encoded in YAML. To edit MySQL Password using YAML, provide the Base64-encoded value for mysql_password option.

    For example:



    In HPE Ezmeral Runtime Enterprise 5.4.0, to set Air Gap Settings, check Air Gap and set Base Repository, Image, Image Tag, Image Pull Secret. See Spark Images.
  5. To view yaml, click Edit/Launch yaml.
  6. Click Submit.

Results

The GUI installs the Hive Metastore in a tenant namespace.

Installing Hive Metastore Using the Helm

Prerequisites

  1. Install and configure Helm 3.
  2. Install and configure kubectl..

About this task

Install the Hive Metastore on Data Fabric tenants which are HPE Ezmeral Data Fabric on Kubernetes tenants or HPE Ezmeral Data Fabric on Bare Metal tenants or non Data Fabric tenants using the Helm chart.

To configure Hive Metastore to work with the MySQL Database, you must have a secret with MySQL server credentials in a tenant namespace. See Creating a Hive Metastore Secret.

Procedure

Helm install the Hive Metastore on HPE Ezmeral Runtime Enterprise:
  • Installing Hive Metastore on Data Fabric tenants:
    To helm install the Hive Metastore on data-fabric (internal or external) tenants, run the following command:
    helm install <hive-metastore-name> ./<path-to-hive-metastore-chart> -n <tenant-namespace>
  • Installing Hive Metastore on non Data Fabric tenants:
    To helm install the Hive Metastore on non data-fabric (none) tenants, run the following command:
    helm install <hive-metastore-name> ./<path-to-hive-metastore-chart> -n <tenant-namespace> --set tenantIsUnsecure=true
To configure Hive Metastore to work with the MySQL Database, set the following flags during helm install: 
--set mysqlDB=true --set hiveSecret=<hive-metastore-secret-name>
NOTE

Installing the Helm chart in a non-tenant namespace can cause error due to missing configmaps and secrets.

Running the helm install installs the Hive Metastore in a tenant namespace.

Example

  • To helm install the Hive Metastore on Data Fabric (internal or external) tenants, run the following command:
    helm install hivemeta ./hivemeta-chart -n sampletenant
  • To helm install the Hive Metastore on non Data Fabric (none) tenants, run the following command:
    helm install hivemeta ./hivemeta-chart -n sampletenant --set tenantIsUnsecure=true
To configure Hive Metastore to work with the MySQL Database, set the following flags during helm install: 
--set mysqlDB=true --set hiveSecret=hivemeta-secret