Getting Started with Apache Kafka Wire Protocol Service
Describes the steps required to install, configure, and use Apache Kafka Wire Protocol Service.
The following sections describe the prerequisites and steps required to use Apache Kafka Wire Protocol Service.
Prerequisites
- HPE Ezmeral Data Fabric 7.3.0
- DAG 6.0 (available in EEP 9.1.1)
- Apache Kafka clients 2.6.x
1 - Install Data Access Gateway
Apache Kafka Wire Protocol Service is
included with the Data Access Gateway (DAG) package
(mapr-data-access-gateway) and is installed when you install DAG.
You can install DAG on multiple Data Fabric client nodes alongside the mfs
(file server) service through the Data Fabric Installer or manually using package managers.
For more information about installing DAG, see Installing Data Access Gateway.
- High Availability
- Apache Kafka Wire Protocol Service runs on all Data Fabric nodes that run DAG. By default, one instance of Apache Kafka Wire Protocol Service is active and all other instances remain in standby mode unless the active instance becomes inactive for any reason. If that happens, one of the standby instances becomes active. Only the active instance hosts and serves the Admin and Producer RPCs. The other instances can serve metadata and fetch RPCs, redirecting the clients to the active instance.
- Port
- The default DAG port for Apache Kafka Wire Protocol Service is 9092; however, you can change the port as described in Configuring Apache Kafka Wire Protocol Service.
2 - Configure Apache Kafka Wire Protocol Service
Set cluster and node-specific settings, as described in Configuring Apache Kafka Wire Protocol Service.
3 - Secure Streams
Set ACEs on streams, as described in Securing Apache Kafka Wire Protocol Service.
4 - Use Apache Kafka Client Libraries to Connect to HPE Ezmeral Data Fabric Streams
For a list of available clients, see https://cwiki.apache.org/confluence/display/KAFKA/Clients.