About Release 7.9.0
This site contains documentation for HPE Ezmeral Data Fabric release 7.9.0, including installation, configuration, administration, and reference content, as well as content for the associated ecosystem components and drivers.
7.9.0 Installation
This section contains information about installing and upgrading HPE Ezmeral Data Fabric software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a HPE Ezmeral Data Fabric cluster.
7.9.0 Data Fabric
HPE Ezmeral Data Fabric is the industry-leading data platform for AI and analytics that solves enterprise business needs.
7.9.0 Administration
This section describes how to manage the nodes and services that make up a cluster.
- Administering Users and Clusters
  Lists topics that help manage a data-fabric cluster.
- Administering Nodes
  Provides a synopsis of managing nodes in a cluster.
- Administering Volumes
  This section provide information about how to organize and manage data using volumes, a unique feature of HPE Ezmeral Data Fabric clusters.
- Administering Files and Directories
- Administering Tables
  Administration of the HPE Ezmeral Data Fabric Database is done primarily via the command line (maprcli) or with the Managed Control System (MCS). Regardless of whether the HPE Ezmeral Data Fabric Database table is used for binary files or JSON documents, the same types of commands are used with slightly different parameter options. HPE Ezmeral Data Fabric Database administration is associated with tables, columns and column families, and table regions.
- Administering Streams
- Administering Data Fabric Gateways
  A HPE Ezmeral Data Fabric gateway mediates one-way communication between a source HPE Ezmeral Data Fabric cluster and a destination cluster. You can replicate HPE Ezmeral Data Fabric Database tables (binary and JSON) and HPE Ezmeral Data Fabric Streams streams. HPE Ezmeral Data Fabric gateways also apply updates from JSON tables to their secondary indexes and propagate Change Data Capture (CDC) logs.
- Administering Services
- Monitoring the Cluster
  This section describes how to monitor the health and performance of a MapR cluster.
- Configuring Security
  Describes how to configure security and manage secure clusters.
- Managing Secure Clusters
  Provides procedures that will enable you to use Data Fabric clusters securely.
- Administering the Data Access Gateway
  The HPE Ezmeral Data Fabric Data Access Gateway is a service that acts as a proxy and gateway for translating requests between lightweight client applications and the HPE Ezmeral Data Fabric cluster. This section describes considerations when upgrading the service, how to modify configuration settings, and how to administer and manage the service.
- Planning for High Availability
- Administrator's Reference
  This section contains in-depth reference information for the administrator.
  - maprcli and REST API Syntax
    This section provides information about the HPE Ezmeral Data Fabric command API. Most commands can be run on the command-line interface (CLI), or by making REST requests programmatically or in a browser.
  - MinIO Client (mc) Commands
    Lists mc commands that you can use to perform operations, such as creating and editing buckets and accounts in HPE Ezmeral Data Fabric Object Store.
  - Utilities
    Contains information about various scripts and utilities, that help setup, maintain, and monitor clusters.
    - configure.sh
      Describes the syntax and parameters of the configure.sh script that you run for a number of tasks including setting up HPE Ezmeral Data Fabric client nodes, and configuring services for a node.
    - configure-crosscluster.sh
      Use the configure-crosscluster.sh utility to set up cross-cluster security between two clusters.
    - cldbguts
      Monitors the activity of the Container Location Database (CLDB). This utility prints information about the CLDB service that is running on the node from which you run the utility.
      - cldbguts acr
        The acr option displays active container requests (ACR).
      - cldbguts containers
        The containers option displays information on the containers.
      - cldbguts heartbeat
        The heartbeat option displays information on the heartbeat sent by the file system and NFS.
      - cldbguts rpc
        The rpc option returns a count of the RPCs that CLDB is processing from clients.
    - disksetup
      Describes the disksetup command that formats disks for use by HPE Ezmeral Data Fabric storage.
    - ectool
      Dumps or checks the validity of the stripelets in the backend volume that is associated with the volume configured for warm tiering.
    - expandaudit
      Describes how to use the expandaudit utility to expand IDs captured in the audit logs to their corresponding names.
    - fcdebug
      Dynamically sets the log level to debug a library.
    - fsck
      Detects and fixes inconsistencies in the file system.
    - gfsck
      Describes how you can use the gfsck command, under the supervision of HPE Ezmeral Data Fabric Support or Engineering, to perform consistency checks and appropriate repairs on a volume, or a volume snapshot.
    - guts
      guts is a tool to measure/analyse performance. In the default mode, it prints one line every second, and counts the number of operations or bytes-processed in one second intervals. guts is an internal utility, and is subject to change without notice.
    - manageSSLKeys.sh
      Use the manageSSLKeys.sh utility to create and manage SSL certificates.
    - mapr-support-collect.sh
      Collects information about a cluster's recent activity, to help Data Fabric Support diagnose problems.
    - mapr-support-dump.sh
      Collects node and cluster-level information for the node on which you invoke the script.
    - maprlogin
      Authenticates logins to secure HPE Ezmeral Data Fabric clusters.
    - mrconfig
      The mrconfig commands let you create, remove, and manage storage pools, disk groups, and disks; and provide information about containers.
    - mrdirectorystats
      Prints the space usage for each directory, for a container.
    - mrdiagnostics
      Gathers node metrics.
    - mrfscmd
      Returns the path to the file specified by ID (fid).
    - stubfuse
      Simulates a FUSE mount point to determine its read and write performance.
  - Configuration Files
    This section contains reference information about various configuration files.
  - Alarms Reference
    The pages in this section provide details about all of the types of alarms.
  - HPE Ezmeral Data Fabric Environment
    This section provides information associated with the Data Fabric environment.
- Troubleshooting Cluster Administration
  Lists the common errors and their solutions.
- Best Practices for Backing Up HPE Ezmeral Data Fabric Information
  Lists the best practices and performance considerations to follow when backing up HPE Ezmeral Data Fabric information.
- IPv6 Support in Data Fabric
  Describes the IPv6 support feature for Data Fabric.
7.9.0 Development
This section contains information related to application development for Ezmeral ecosystem components and HPE Ezmeral Data Fabric products, including the file system, Database (Key-Value and JSON), and Event Streams.
Other Docs
This section contains release-independent information, including: Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other data-fabric version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

cldbguts

Monitors the activity of the Container Location Database (CLDB). This utility prints information about the CLDB service that is running on the node from which you run the utility.

Monitoring the progress of the container location database (CLDB) may be useful when troubleshooting cluster issues.

The cldbguts utility prints information about active container reports, full container reports, registration requests, HPE Ezmeral Data Fabric file system heartbeats, NFS server heartbeats, and containers. You can run cldbguts from any container location database (CLDB) node; however, running this command from the container location database (CLDB) master node provides the most relevant information.

NOTE

After you run cldbguts, it continues to print the output until you kill the process. To prevent cldbguts from printing indefinitely, specify the -n parameter that denotes the number of times cldbguts should print the output.

Syntax:

/opt/mapr/bin/cldbguts [[acr | rpc | heartbeat | containers | alarms | table | all] [-n iterations-count]

Output Fields:

NOTE

When you run cldbguts without any parameters, only the fcr, clrpc, regn, mfs hb, nfs hb, assigns, roles, progress, and the con-chain fields are displayed.

acr

Represents active container requests (ACR).

This column includes the following information:

nr: Number of ACRs completed in the previous second. The first entry displays the total number of ACRs completed since the start of the CLDB service on the node.
pt: Processing time (in milliseconds) for the ACRs completed in the previous second. The first entry displays the total time (in milliseconds) spent processing the ACRs since the start of the CLDB service on the node.
to: Number of ACRs that took longer than expected in the previous second. The first entry displays the total number of ACRs that took longer than expected since the start of the CLDB service on the node.
d: Number of duplicate ACRs received in the previous second. The first entry displays the total number of duplicate ACRs since the start of the CLDB service on the node.
dp: Number of duplicate ACRs that required additional work in the previous second. The first entry displays the total number of duplicate ACRs that required additional work since the start of the CLDB service on the node.

fcr

Represents full container report (FCR).

This column includes the following information:

nr: Number of FCRs completed in the previous second. The first entry displays the total number of FCRs completed since the start of the CLDB service on the node.
pt: Processing time (in milliseconds) for the FCRs completed in the previous second. The first entry displays the total time (in milliseconds) spent processing the FCRs since the start of the CLDB service on the node.
to: Number of FCRs that took longer than expected in the previous second. The first entry displays the total number of FCRs that took longer than expected since the start of the CLDB service on the node.

regn

Represents registration requests.

This column includes the following information:

nr: Number of registration requests completed in the previous second. The first entry displays the total number of registration requests completed since the start of the CLDB service on the node.
pt: Processing time (in milliseconds) for the registration requests completed in the previous second. The first entry displays the total time (in milliseconds) spent processing the registration requests since the start of the CLDB service on the node.
to: Number of registration requests that took longer than expected in the previous second. The first entry displays the total number of registration requests that took longer than expected since the start of the CLDB service on the node.
d: Number of duplicate registration requests received in the previous second. The first entry displays the total number of duplicate registration requests since the start of the CLDB service on the node.
dp: Number of duplicate registration requests that required additional work in the previous second. The first entry displays the total number of duplicate registration requests that required additional work since the start of the CLDB service on the node.

mfs hb

Information about HPE Ezmeral Data Fabric file system heartbeats.

This column includes the following information:

nr: Number of HPE Ezmeral Data Fabric file system heartbeats completed in the previous second. The first entry displays total number of HPE Ezmeral Data Fabric file system heartbeats completed since the start of the CLDB service on the node.
pt: Processing time (in microseconds) for the HPE Ezmeral Data Fabric file system heartbeats completed in the previous second. The first entry displays total time (in microseconds) spent processing HPE Ezmeral Data Fabric file system heartbeats since the start of the CLDB service on the node.
to: Number of HPE Ezmeral Data Fabric file system heartbeats that took longer than expected in the previous second. The first entry displays total number of HPE Ezmeral Data Fabric file system heartbeats that took longer than expected since the start of the CLDB service on the node.
bmc: Number of times the Become Master Command (bmc) has been sent to this MFS.
otc: Number of times the other commands (apart from bmc) has been sent to this MFS.

nfs hb

Information about NFS server heartbeats.

This column includes the following information:

nr: Number of NFS server heartbeats completed in the previous second. The first entry displays total number of NFS server heartbeats completed since the start of the CLDB service on the node.
pt: Processing time (in microseconds) for the NFS server heartbeats completed in the previous second. The first entry displays the total time (in microseconds) spent processing HPE Ezmeral Data Fabric file system heartbeats since the start of the CLDB service on the node.

assigns

This column includes the following information:

nr: Number of container assign requests in the previous second. The first entry displays the total number of container assign requests since the start of the CLDB service on the node.
nc: Number of containers created as part of the above container assign requests in the previous second. The first entry displays the total number of containers created since the start of the CLDB service on the node.
nrt: Number of container assign requests for tablets in the previous second. The first entry displays the total number of container assign requests for tablets since the start of the CLDB service on the node.
nct: Number of containers created as part of the above container assign requests for tablets in the previous second. The first entry displays the total number of container created in tablets since the start of the CLDB service on the node.
pt: Time taken by container assignment RPC in milliseconds
tpt: Time taken by container assignment tablet RPC in milliseconds
cas: Number of storage pools scanned for container assignment requests

roles

Represents the roles of the various replica containers.

This column includes the following information:

bm: Number of replica containers that are in the process of becoming master
ms: Number of replica containers that the CLDB thinks have valid masters
wr: Number of replica containers that are waiting for CLDB to assign a role to them
rs: Number of replica containers that are re-syncing
vr: Number of non-master replica containers that have finished resynchronization
uu: Number of replica containers that are unused. For example, the number of replica containers that are on nodes or storage pools which have been offline or unavailable for more than an hour.

ATTENTION

It may take some time for the CLDB to be aware of role changes.

progress

This column includes the following information:

m%: Percentage of containers that have valid masters
uc: Number of unique containers
v%: Percentage of replica containers that are valid (that is, have completed resynchronization)
tr: Total number of replica containers

con-chain

This column includes the following information:

ms: Number of unique containers that have a master
1r: Number of unique containers that have 2 valid copies of the data
2r: Number of unique containers that have 3 valid copies of the data

location

This column includes the following information:

lu: Number of container location lookups
up: Number of container location updates
dl: Number of container location deletes
sc: Number of container location scans

size

This column includes the following information:

lu: Number of container size lookups
up: Number of container size updates
dl: Number of container size deletes
sc: Number of container size scans

sptable

This column includes the following information:

lu: Number of lookups on the SP-Container-Vol table
up: Number of updates on the SP-Container-Vol table
dl: Number of deletes on the SP-Container-Vol table
sc: Number of scans on the SP-Container-Vol table

nodes

This column includes the following information:

nn: Number of nodes in the cluster
of: Number of offline nodes
nsp: Number of storage pools
of: Number of offline storage pools

Example Output:

/opt/mapr/bin/cldbguts all  -n 3 
            2019-09-15 22:08:39,981
            mfs hb                nfs hb                 assigns                         roles                    progress            con-chain       location            size             sptable            fcr              clrpc           regn            nodes      
            nr        pt     to  bmc  otc    nr  pt     nr  nc  nrt  nct   pt  tpt  cas    bm  ms  wr  rs  vr  uu      m%    uc     v%    tr    ms  1r  2r    lu   up  dl  sc   lu   up  dl  sc   lu  up  dl  sc     nr   pt   to     nr    pt   to    nr   pt  to   nn  of  sp  of  
            428807  112504140   0   57   0      0   0    120   5   0    0   294   0    2      0  61   0   0   0   0    98.39%  62  100.00%  61    61   0   0     0  113   0  32    0  416   0  16    0   1   0   0    476  5073   0    5650  3971   0     3  178   0    1   0   1   0  
            1       245      0   57   0      0   0     0    0   0    0    0    0    0      0  61   0   0   0   0    98.39%  62  100.00%  61    61   0   0     0   0    0   0    0   0    0   0    0   0   0   0     0     0    0      0     0    0     0   0    0    1   0   1   0  
            1       288      0   57   0      0   0     0    0   0    0    0    0    0      0  61   0   0   0   0    98.39%  62  100.00%  61    61   0   0     0   0    0   0    0   0    0   0    0   0   0   0     0     0    0      0     0    0     0   0    0    1   0   1   0

Partners Support Dev-Hub Community Training ALA Privacy Policy Glossary

HPE Ezmeral Data Fabric – Customer-Managed 7.9.0 Documentation
Abstract	This site contains documentation for the customer-managed platform of the HPE Ezmeral Data Fabric version 7.9.0 including installation, configuration, administration, and reference content, as well as content for the associated bundled ecosystem components and drivers.
Published	November 2024
Edition	7.9.0