About Release 7.9.0
This site contains documentation for HPE Ezmeral Data Fabric release 7.9.0, including installation, configuration, administration, and reference content, as well as content for the associated ecosystem components and drivers.
7.9.0 Installation
This section contains information about installing and upgrading HPE Ezmeral Data Fabric software. It also contains information about how to migrate data and applications from an Apache Hadoop cluster to a HPE Ezmeral Data Fabric cluster.
7.9.0 Data Fabric
HPE Ezmeral Data Fabric is the industry-leading data platform for AI and analytics that solves enterprise business needs.
7.9.0 Administration
This section describes how to manage the nodes and services that make up a cluster.
7.9.0 Development
This section contains information related to application development for Ezmeral ecosystem components and HPE Ezmeral Data Fabric products, including the file system, Database (Key-Value and JSON), and Event Streams.
- Application Development Process
  Before you start developing applications on the HPE Ezmeral Data Fabric platform, consider how you will get the data into the platform, the storage format of the data, the type of processing or modeling that is required, and how the data will be accessed.
- File Store and Apps
  The following sections provide information about accessing the File Store with C and Java applications.
- HPE Ezmeral Data Fabric Database and Apps
  This section contains information about developing client applications for JSON and key-value tables.
  - Installing the mapr-client Package
    The mapr-client package must be installed on each node where you will be building and running your applications. This package installs all of the MapR Libraries needed for application development regardless of programming language or type of HPE Ezmeral Data Fabric Database table (binary or JSON).
  - Passing the HPE Ezmeral Data Fabric Database Table Path
    This topic describes the methods for passing a HPE Ezmeral Data Fabric Database table name. Binary table names can be passed by either specifying the table path in the API or by setting the table path in the core-site.xml file. JSON table names are passed by specifying the table path in the API.
  - Tuning Parameters for Client Apps
    Though tuning client applications is generally not necessary, Data Fabric does offer tuning parameters to change the behavior of client-side caching.
  - Developing Applications for Binary Tables
    HPE Ezmeral Data Fabric Database provides a C API, libMapRClient and partially supports the Apache HBase 1.1 Java APIs for performing operation on HPE Ezmeral Data Fabric Database binary tables.
  - Setting for OJAI Applications to Use Data Fabric Client Features
    Describes how to set the classpath for OJAI applications to use data-fabric client features.
  - Developing Applications for JSON Tables
    As part of its support for JSON tables, HPE Ezmeral Data Fabric Database implements the OJAI API. The OJAI API provides methods for creating, reading, updating, and deleting JSON documents in HPE Ezmeral Data Fabric Database JSON tables. It is available in Java, and starting in EEP 6.0, also available in Node.js, Python, C#, and Go. HPE Ezmeral Data Fabric Database also provides a HPE Ezmeral Data Fabric Database JSON Client API for managing JSON tables and a HPE Ezmeral Data Fabric Database JSON REST API for performing basic operations using HTTP calls.
    - Managing JSON Tables
      This section describes how to create, list, and delete JSON tables, alter JSON table attributes, set permissions, and manage column families. You can perform these operations using either the HPE Ezmeral Data Fabric Database JSON Client API library or HPE Ezmeral Data Fabric Database Shell commands.
    - Managing JSON Documents
      To perform CRUD operations (create, read, update, and delete) on JSON documents in HPE Ezmeral Data Fabric Database JSON tables using the OJAI API, you use Document, DocumentStore, and DocumentMutation objects.
    - Querying JSON Documents
      This section describes how to query JSON documents in HPE Ezmeral Data Fabric Database JSON tables using the OJAI API library and HPE Ezmeral Data Fabric Database Shell. It includes sample programs using the OJAI API library and shows how to run the same queries in HPE Ezmeral Data Fabric Database Shell.
    - Querying with HPE Ezmeral Data Fabric Database Shell
      This section describes how to query JSON documents using either the find or findbyid command in HPE Ezmeral Data Fabric Database Shell (dbshell). It introduces the functionality the find command supports and describes the two ways to specify your queries. It also provides links to reference pages and examples.
    - Examples: Querying JSON Documents
      This section provides query examples using the OJAI API. The examples include querying by document ID, retrieving all documents in a store, selecting individual fields, specifying query conditions, and ordering your query result. For reference, the examples also include the equivalent HPE Ezmeral Data Fabric Database Shell (dbshell) commands.
    - Using the Java OJAI Client
      This topic describes HPE Ezmeral Data Fabric Database functionality that is applicable to only the Java OJAI client. This includes instructions on how to compile your Java OJAI application, enable buffered writes, use the read your own writes feature, and enable available query options.
    - Using the Java OJAI Thin Client
      Starting with EEP 6.3.0, you can use the Java OJAI Thin Client to write HPE Ezmeral Data Fabric Database JSON applications. The Java OJAI Thin Client provides a lightweight library that supports the OJAI API. You can connect to HPE Ezmeral Data Fabric Database JSON, and add, update, and query documents in a HPE Ezmeral Data Fabric Database JSON table.
    - Using the Node.js OJAI Client
      Starting with EEP 6.0, you can use the Node.js OJAI client to write HPE Ezmeral Data Fabric Database JSON applications. The client provides you with a lightweight library that supports the OJAI API. You can connect to HPE Ezmeral Data Fabric Database JSON from middleware components, and add, update, and query documents in a HPE Ezmeral Data Fabric Database JSON table.
    - Using the Python OJAI Client
      Starting with EEP 6.0, you can use the Python OJAI client to write HPE Ezmeral Data Fabric Database JSON applications. The client provides you with a lightweight library that supports the OJAI API. You can connect to HPE Ezmeral Data Fabric Database JSON, and add, update, and query documents in a HPE Ezmeral Data Fabric Database JSON table.
      - Getting Started with the Python OJAI Client
        This section describes the software required to run the Python OJAI client, client/server security, and how to specify your connection string. It also provides links to documentation that shows you how to write Python OJAI applications.
      - Python OJAI Client Classes and Methods
        This topic lists and describes the classes supported by the Python OJAI client and provides a link to document pages that describe the methods in each class.
      - Multiprocessing and Multithreading in Python OJAI Applications
        Python supports multiprocessing and multithreading modules that enable you to spawn either multiple processes or multiple threads in a Python program. This section contains examples that show you how to use these modules in your Python OJAI application.
      - Setting Query Options in Python OJAI
        There are two categories of options you can set in your Python OJAI application. This topic describes both and shows you how to set each.
    - Using the C# OJAI Client
      Starting with EEP 6.1.0, you can use the C# OJAI client to write HPE Ezmeral Data Fabric Database JSON applications. The client provides you with a lightweight library that supports the OJAI API. You can connect to HPE Ezmeral Data Fabric Database JSON, and add, update, and query documents in a HPE Ezmeral Data Fabric Database JSON table.
    - Using the Go OJAI Client
      Starting with EEP 6.0.0, you can use the Go OJAI client to write HPE Ezmeral Data Fabric Database JSON applications. The client provides you with a lightweight library that supports the OJAI API. You can connect to HPE Ezmeral Data Fabric Database JSON, and add, update, and query documents in a HPE Ezmeral Data Fabric Database JSON table.
    - Configuring SSL for OJAI Clients
      Describes certificates and how to configure SSL for OJAI clients, including which PEM file to point to and how to determine which DAG host name to use.
    - Using the HPE Ezmeral Data Fabric Database JSON REST API
      Starting in the EEP 5.0 release, you can use a REST API to access HPE Ezmeral Data Fabric Database JSON tables. The REST API allows you to use HTTP calls to perform basic operations on HPE Ezmeral Data Fabric Database JSON tables.
    - HPE Ezmeral Data Fabric Database JSON MapReduce API
      This API library extends the Apache Hadoop MapReduce framework, so that you can write your own MapReduce applications to write data from one JSON table to another.
- Apache Kafka Wire Protocol Service
  HPE Ezmeral Data Fabric Streams supports Apache Kafka Wire Protocol Service. Apache Kafka Wire Protocol Service is a TCP/IP service that emulates a Kafka cluster backed by HPE Ezmeral Data Fabric Streams. The service makes it possible for Apache Kafka clients written in any programming language to access topics in HPE Ezmeral Data Fabric Streams.
- HPE Ezmeral Data Fabric Streams and Apps
  HPE Ezmeral Data Fabric Streams brings integrated publish and subscribe messaging to HPE Ezmeral Data Fabric.
- MapReduce and Apps
  This section contains information associated with developing YARN applications.
- Kubernetes Interfaces for Data Fabric
  This section describes how to leverage the capabilities of the Kubernetes Interfaces for Data Fabric.
- Ecosystem Components
  The following sections provide information about each open-source project that is supported by the HPE Ezmeral Data Fabric.
- Maven and the HPE Ezmeral Data Fabric
  This section discusses topics associated with Maven and the HPE Ezmeral Data Fabric.
- Developer's Reference
  This section contains in-depth information for the developer.
- API Documentation
  HPE Ezmeral Data Fabric supports public APIs for file system, HPE Ezmeral Data Fabric Database, and HPE Ezmeral Data Fabric Streams. These APIs are available for application-development purposes.
Other Docs
This section contains release-independent information, including: Installer documentation, Ecosystem release notes, interoperability matrices, security vulnerabilities, and links to other data-fabric version documentation.
Glossary
Definitions for commonly used terms in MapR Converged Data Platform environments.

Using the Python OJAI Client

Starting with EEP 6.0, you can use the Python OJAI client to write HPE Ezmeral Data Fabric Database JSON applications. The client provides you with a lightweight library that supports the OJAI API. You can connect to HPE Ezmeral Data Fabric Database JSON, and add, update, and query documents in a HPE Ezmeral Data Fabric Database JSON table.

The client provides you with the following benefits:

Easy installation and use
Access to HPE Ezmeral Data Fabric Database JSON through the OJAI interface in Python
An OJAI interface that is tailored to Python developers
Use of Python types to manipulate HPE Ezmeral Data Fabric Database JSON documents
Support for Python multiprocessing and multithreading modules
Support for L3/L4 (transport level) and L7 (application level) proxy load balancing

To use the Python OJAI client, you must install the Data FabricData Access Gateway on your HPE Ezmeral Data Fabric cluster. The gateway serves as a proxy for translating requests between the Python client and the HPE Ezmeral Data Fabric cluster. The gateway also performs data processing to keep the client lightweight. See Administering the Data Access Gateway for information about how to administer the gateway and configure load balancing.

Additional Resources

Examples: https://github.com/mapr-demos/ojai-examples/tree/master/python

Source Code: https://github.com/mapr/maprdb-python-client

Partners Support Dev-Hub Community Training ALA Privacy Policy Glossary

HPE Ezmeral Data Fabric – Customer-Managed 7.9.0 Documentation
Abstract	This site contains documentation for the customer-managed platform of the HPE Ezmeral Data Fabric version 7.9.0 including installation, configuration, administration, and reference content, as well as content for the associated bundled ecosystem components and drivers.
Published	November 2024
Edition	7.9.0