About Release 7.9.0
This site contains documentation for HPE Ezmeral Data Fabric release 7.9.0, including installation, configuration, administration, and reference content, as well as content for the associated ecosystem components and drivers.
7.9.0 Installation
This section contains information about installing and upgrading HPE Ezmeral Data Fabric software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a HPE Ezmeral Data Fabric cluster.
- Planning the Cluster
  Describes information and factors used in planning your cluster.
- Installing Core and Ecosystem Components
  Describes how to install HPE Ezmeral Data Fabric software and ecosystem components with or without the Installer.
  - Data Fabric Repositories and Packages
    Describes the repositories for Data Fabric software and the ecosystem components.
  - Package Dependencies
    Lists the interdependencies between packages across all the supported Operating Systems
  - Preparing Each Node
    Defines minimum requirements for each node in your cluster.
  - Installing with the Installer
    The Installer automates the process of installing Data Fabric software and offers you a variety of options to complete the installation.
  - Installing without the Installer
    Describes how to install HPE Ezmeral Data Fabric software and ecosystem components manually.
    - Step 1: (Optional) Enable FIPS Mode
      If your cluster must be FIPS-compliant, you must enable FIPS mode at the operating system level before installing data-fabric software. If FIPS compliance is not needed, you can skip this step.
    - Step 2: Import the Package Key
      Before you install Data Fabric packages, you must import the package key.
    - Step 3: Prepare Packages and Repositories
      To install services correctly, each node must have access to the package files.
    - Step 4: Install Cluster Service Packages
      The installation process varies based on the location of your packages and the configuration of your cluster.
    - Step 5: Verify Installation Success
      To confirm success, check each node.
    - Step 6: Set Environment Variables
      Before starting ZooKeeper or Warden, you must complete this step.
    - Step 7: Configure Nodes
      Connect nodes to the cluster, configure security, and arrange node storage.
    - Step 8: Bring up the Cluster
      Before you can install monitoring or ecosystem components, you must enable the cluster by starting ZooKeeper and Warden and verifying the cluster installation status.
    - Step 9: Install Metrics Monitoring
      Metrics monitoring is part of monitoring, which also includes log monitoring. Monitoring components are available as part of the Ecosystem Pack (EEP) that you selected for the cluster.
    - Step 10: Install Log Monitoring
      Installing the monitoring logging components is optional. The logging components enable the collection, storage, and visualization of core logs, system logs, and ecosystem component logs. Monitoring components are available as part of the Ecosystem Pack (EEP) that you selected for the cluster.
    - Step 11: Install Ecosystem Components Manually
      You can install one or more ecosystem components from any Ecosystem Pack (EEP) that is supported by the data-fabric cluster version. An EEP consists of a group of ecosystem components that work together.
      - Installing Airflow
        This topic includes instructions for using package managers to download and install Apache Airflow from the EEP repository.
      - Installing AsyncHBase Libraries
        This topic includes instructions for using package managers to download and install AsyncHBase from the EEP repository.
      - Installing Drill
        This topic provides instructions for using package managers to download and install Drill.
      - Installing Hadoop and YARN
        This topic describes how to use package managers to download and install Hadoop and YARN services from the EEP repository.
      - Installing HBase
        This topic includes instructions for using package managers to download and install HBase from the EEP repository.
      - Installing HBase Client and Tools
        MapR 6.0.x does not support HBase as an ecosystem component. Beginning with EEP 6.3.0, MapR 6.1 reintroduced HBase as an ecosystem component. With EEP 6.3.0 and later you can install the HBase Client and tools even if you decide not to install HBase as an ecosystem component. This topic describes the HBase Client and other tools that are available for use with the HPE Ezmeral Data Fabric Database.
      - Installing Hive
        This topic includes instructions for using package managers to download and install Hive from the EEP repository.
      - Installing Hue
        This topic includes instructions for using package managers to download and install Hue from the EEP repository.
      - Installing Kafka Schema Registry
        This topic includes instructions for using package managers to download and install the Kafka Schema Registry from a HPE repository.
      - Installing KSQL
        This topic describes how to use package managers to download and install KSQL from the EEP repository.
      - Installing Kafka Streams
        Kafka Streams is a Java library and is part of the mapr-kafka package. Kafka Streams does not require special installation steps; however, you must install the mapr-core and mapr-kafka packages to use Kafka Streams.
      - Installing HPE Ezmeral Data Fabric Streams Clients
        This topic includes instructions for using package managers to download and install HPE Ezmeral Data Fabric Streams Clients from the EEP repository.
        Installing HPE Ezmeral Data Fabric Streams C Client
        The HPE Ezmeral Data Fabric Streams C Client is a distribution of librdkafka that works with HPE Ezmeral Data Fabric Streams.
        Installing HPE Ezmeral Data Fabric Streams Python Client
        The HPE Ezmeral Data Fabric Streams Python Client is a binding for librdkafka that is dependent on the HPE Ezmeral Data Fabric Streams C client (HPE Ezmeral Data Fabric Streams C Client is a distribution of librdkafka that works with HPE Ezmeral Data Fabric Streams).
        Installing HPE Ezmeral Data Fabric Streams C#/.NET Client
        The HPE Ezmeral Data Fabric Streams C#/.NET client is a binding for librdkafka that is dependent on the HPE Ezmeral Data Fabric Streams C client (HPE Ezmeral Data Fabric Streams C Client is a distribution of librdkafka that works with HPE Ezmeral Data Fabric Streams).
      - Installing HPE Ezmeral Data Fabric Streams Tools
        This topic includes instructions for using package managers to download and install HPE Ezmeral Data Fabric Streams Tools from the EEP repository.
      - Installing Data Access Gateway
        This topic includes instructions for using package managers to download and install the Data Access Gateway from the EEP repository.
      - Installing Livy
        This topic includes instructions for using package managers to download and install Livy from the EEP repository.
      - Installing NiFi
        This topic includes instructions for using package managers to download and install Apache NiFi from the EEP repository.
      - Installing OTel
        This topic includes instructions for using package managers to download and install OTel from the EEP repository.
      - Installing Ranger
        This topic includes instructions for using package managers to download and install Ranger from the EEP repository.
      - Installing Spark Standalone
        This topic describes how to use package managers to download and install Spark Standalone from the EEP repository.
      - Installing Spark on YARN
        Describes how to use package managers to download and install Spark on YARN from the EEP repository.
      - Installing Spark on Mesos
        This section includes instructions to download and install Apache Spark on Apache Mesos.
      - Installing Zeppelin
        This topic includes instructions for using package managers to download and install Zeppelin 0.9 and later from the EEP repository.
    - Step 12: Run configure.sh
      Run configure.sh with the -R option to complete the configuration of ecosystem components that were added manually.
  - Configuring the Cluster
    Describes post-installation configuration tasks for HPE Ezmeral Data Fabric clusters.
- Installing the HPE Ezmeral Data Fabric File Store
  Describes how to install File Store software with or without the Installer.
- Installing HPE Ezmeral Data Fabric Object Store
  Describes installation of the HPE Ezmeral Data Fabric Object Store software with or without the Installer.
- Installing Kubernetes Interfaces for Data Fabric
  This section describes how to plan for and install the Container Storage Interface (CSI) Storage Plugin and the Kubernetes Interfaces for Data Fabric FlexVolume Driver.
- Upgrading Core or EEP Components
  Depending on your current configuration, you may choose to upgrade the release version (core), ecosystem components, clients, or monitoring components.
- Setting Up Clients and Services
  Describes how to set up and use interfaces to an HPE Ezmeral Data Fabric cluster from a client computer.
- Setting Up the Control System
  Describes how to configure and access the Control System.
- Migrating to the HPE Ezmeral Data Fabric
  Provides instructions for migrating business-critical data and applications from an Apache Hadoop cluster to an HPE Ezmeral Data Fabric cluster.
- Applying a Patch
  You can apply a patch by using the Installer, by using the command line (a manual process), or by using an Installer Stanza.
7.9.0 Data Fabric
HPE Ezmeral Data Fabric is the industry-leading data platform for AI and analytics that solves enterprise business needs.
7.9.0 Administration
This section describes how to manage the nodes and services that make up a cluster.
7.9.0 Development
This section contains information related to application development for Ezmeral ecosystem components and HPE Ezmeral Data Fabric products, including the file system, Database (Key-Value and JSON), and Event Streams.
Other Docs
This section contains release-independent information, including: Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other data-fabric version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Installing HPE Ezmeral Data Fabric Streams C Client

The HPE Ezmeral Data Fabric Streams C Client is a distribution of librdkafka that works with HPE Ezmeral Data Fabric Streams.

For instructions on installing the Data Fabric Client, see Installing the Data Fabric Client (Non-FIPS)
For instructions on setting up the EEP repository, see Step 11: Install Ecosystem Components Manually.

Installation

As of MapR 6.0.1, the MapR C client is installed as part of the MapR Core installation and the mapr-client package installation. The MapR C client is available on Linux, Mac, and Windows operating systems.

NOTE

Specific installation is not required as of MapR 6.0.1!

For MapR 5.2.1 through MapR 6.0.0, the MapR C client must be installed. The MapR C client is available on Linux and Mac operating systems. As root or using sudo, install the mapr-librdkafka package on nodes where you want to run or build applications.

On Ubuntu:
```
apt-get install mapr-librdkafka
```
On RedHat/CentOS:
```
yum install mapr-librdkafka
```
On SLES:
```
zypper install mapr-librdkafka
```
On Mac OS:
1. Download the following TAR file: https://package.ezmeral.hpe.com/releases/MEP/<MEP version>/<operating system>/<package>.tar.gz
2. Extract the TAR file under /opt/mapr:
```
tar -C /opt/mapr/ -zxf <librdkafka_tarFile_location>
```

NOTE

The mapr-librdkafka package pulls in the mapr-client as a dependency if the node does not have the mapr-client or mapr-core package installed.

Configuration

For MapR 6.0.1 and higher, use the following configuration instructions.

Linux

For Linux installations, add /opt/mapr/lib to the end of LD_LIBRARY_PATH.

export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/opt/mapr/lib

Mac

For Mac installations, add /opt/mapr/lib to the end of DYLD_LIBRARY_PATH.

export DYLD_LIBRARY_PATH=$DYLD_LIBRARY_PATH:/opt/mapr/lib

Windows

For Windows installations, no additional configuration is required. Link your application and run your programs against the HPE Ezmeral Data Fabric Client dynampic link libraries (dll) located at: C:\opt\mapr\lib. The corresponding librdkafka header is C:\opt\mapr\include\librdkafka.

ATTENTION

For MapR 6.0.0 and earlier, see Configuring the HPE Ezmeral Data Fabric Streams C Client for instructions on configuring the client.

Partners Support Dev-Hub Community Training ALA Privacy Policy Glossary

HPE Ezmeral Data Fabric – Customer-Managed 7.9.0 Documentation
Abstract	This site contains documentation for the customer-managed platform of the HPE Ezmeral Data Fabric version 7.9.0 including installation, configuration, administration, and reference content, as well as content for the associated bundled ecosystem components and drivers.
Published	November 2024
Edition	7.9.0