HPE Ezmeral Data Fabric Streams C Applications

You can develop C applications for HPE Ezmeral Data Fabric Streams. The HPE Ezmeral Data Fabric Streams C Client is a distribution of librdkafka that works with HPE Ezmeral Data Fabric Streams. The HPE Ezmeral Data Fabric Streams C Client is available in Ecosystem Pack (EEP) 3.0 and later.

The following Apache Kafka librdkafka versions are supported:
Table 1. Supported Apache Kafka librdkafka versions
Core release EEP Release Kafka librdkafka version
As of 7.9.0 As of 9.3.1 2.0.2*
As of 6.0.1 As of 5.0 0.11.3
As of 5.2.1 through 6.0.0 As of 3.0 0.9.0

*Librdkafka 2.0.2 in core 7.9 is not compatible with HPE Ezmeral Data Fabric Stream clients for Python1 or C#2 applications. Nodes running Python or C# applications should not be upgraded to HPE Ezmeral Data Fabric 7.9.

1HPE Ezmeral Data Fabric Streams Python Applications

2HPE Ezmeral Data Fabric Streams C#/.NET Applications

The HPE Ezmeral Data Fabric Streams C Client supports a majority of the librdkafka C APIs plus additional configuration properties that are available only with HPE Ezmeral Data Fabric Streams. When developing applications for HPE Ezmeral Data Fabric Streams or migrating Kafka applications to HPE Ezmeral Data Fabric Streams, see the list of librdkafka APIs Supported by HPE Ezmeral Data Fabric Streams C Client which also describes API behavior. Reference rdkafka.h for API signatures.

When developing and running HPE Ezmeral Data Fabric Streams C applications, note the following:
  • You can create producers and high-level consumers. Low-level consumers are not supported.
  • Consuming or producing topics in a Kafka cluster is not supported.
  • As of HPE Ezmeral Data Fabric 6.0, the HPE Ezmeral Data Fabric Streams offset values start at 0.
  • HPE Ezmeral Data Fabric Security is supported. Kafka application-level security is not supported. See Security.
  • User impersonation is not supported.
CAUTION
As of HPE Ezmeral Data Fabric 6.1, the mapr-core package has a dependency on mapr-librdkafka. If the mapr-librdkafka package is installed, do not remove it manually. Doing so could result in the removal of HPE Ezmeral Data Fabric core packages, rendering the node unusable.