Kafka Streams 3.6.1.0 (EEP 9.3.0) Release Notes

The notes below relate specifically to the HPE Ezmeral Data Fabric Distribution for Apache Kafka. See Apache Kafka 2.6.1 release notes and Apache Kafka Streams homepage for more information.
Version 3.6.1.0
Release Date July 2024
HPE Version Interoperability See EEP Components and OS Support.
Source on GitHub https://github.com/mapr/kafka
GitHub Release Tag 3.6.1.0-eep-930
Maven Artifacts https://repository.mapr.com/maven/
Package Names See Package Names for Ecosystem Packs (EEPs).

New in This Release

Kafka Streams 3.6.1.0 introduces the following enhancements or HPE platform-specific behavior changes:
  • New Apache Kafka release ported – 3.6.1
  • Bug fixes
  • CVE fixes

Fixes

This HPE release includes the following fixes on the base release:
GitHub Commit Number Date (YYYY-MM-DD) Fix Number and Description
cf8a60b18e 2024-06-27 KAFKA-1063 Active query is not canceled after rebalancing or task restarting
9df3fd3eff 2024-06-26 KAFKA-1051 Update jetty* to 9.4.54.v20240208
2439cd9c28 2024-06-17 KAFKA-1064 Not all messages were produced in topic when we quickly stopped console producer
047d511ac0 2024-06-17 KAFKA-1005 Support MM2 in Kafka 3.6.1 (Fix ConcurrentModificationException)
d89e90b00b 2024-06-17 KAFKA-995 Could not delete stream topic via bin/kafka-topics.sh --delete
f82947d05c 2024-06-12 KAFKA-1042 Specify new package dependencies in kafka components in EEP-9.3.0
7da9f78c90 2024-06-12 MS-1428 In consumer creation context warning is seen: "Multiple partition assignors are not supported in MapR Consumer. Only the first assignor in the list will be used"
8ba0056893 2024-06-11 KAFKA-1052 Unable to read SSL configuration from XML files when all needed keystore/truststore properties are present in connector-standalone.properties (2)
e11a55d168 2024-06-10 KAFKA-1052 Unable to read SSL configuration from XML files when all needed keystore/truststore properties are present in connector-standalone.properties
a4ce39220f 2024-05-21 KAFKA-1049 Kafka console produce and consumer failed to start on cluster with java17
abd8a8e766 2024-05-02 KAFKA-1046 No current assignment for partition
81c609fc79 2024-04-26 KAFKA-1005 Support MM2 in Kafka 3.6.1
2287208658 2024-04-24 KAFKA-996 Port EEP specific changes to Kafka CONNECT 3.6.1
b9d37c35ba 2024-04-17 KAFKA-1012 HdfsSinkConnector creates files/directories with incorrect ownership when run by non-mapr user
5fb1ba76eb 2024-04-15 KAFKA-1038 StreamsException: Failed to retrieve committed offsets for [/sample-stream:pageviews_regions-0]
eaea53c890 2024-04-15 KAFKA-1037 Topic name is invalid: the length of topic is longer than the max allowed length 249
8c066c5cc3 2024-04-01 ECO-341 Security: Vulnerable versions of “guava” OSS versions reported as part of the mapr-kafka-*.rpm
d3f77c39d3 2024-03-22 KAFKA-1013 Kafka connect failed to start in standalone mode with "org.apache.hadoop.security.KerberosAuthException: failure to login"
7c9c8b323c 2024-03-01 KAFKA-1023 No current assignment for partition
2b5f1d8248 2024-02-16 KAFKA-1006 Throw exception in usupported 3.6.1 API
b93c1992a9 2024-02-16 Use our hadoopCommon version
239e7031e5 2024-02-16 KAFKA-989 Port EEP specific changes to Kafka 3.6.1, Part 3: connect-runtime, connect-mirror, connect-mirror-client
85ab202d9b 2024-02-09 KAFKA-989 Port EEP specific changes to Kafka 3.6.1, Part 2: kafka-streams, mapr-eco-tools, kafka-tools
e3d3186986 2024-02-09 MS-1386 WORKAROUND 2: treat ConsumerPollThread as current thread in StateDirectory
c5e2f8afbc 2024-02-09 MS-1386 WORKAROUND 1: skip acquire()/release() in KafkaConsumer
3e33f12ac8 2024-02-09 KAFKA-989 Port EEP specific changes to Kafka 3.6.1, Part 1: kafka-clients & kafka-eventstreams (2)
66a33dbf6f 2024-02-09 KAFKA-986 Split producer/consumer intialization logics (apache vs mapr) completely by introducing new dedicated config variable (2)
227fe6922f 2024-01-19 KAFKA-989 Port EEP specific changes to Kafka 3.6.1, Part 1: kafka-clients & kafka-eventstreams
2f000d3482 2024-01-19 KAFKA-985 Move packaging routines from private-pkg to private-kafka
For complete details, refer to the commit log for this project in GitHub.

Known Issues and Limitations

  • Transactions are not supported.
  • Pattern subscription is not supported.
  • The application reset tool hangs if it runs when the Kafka Streams application is running.
  • The application reset tool may throw a Null Pointer Exception when the date or duration parameter is used.
  • The application reset tool does not reset to intermediate offset if the topic has multiple partitions.
  • MAPR-KAFKA-581: Stream hangs in rebalancing state. The workaround is to set a larger timeout. This issue is caused by MS-915: “MapR Stream application hangs inside cycle”

Resolved Issues

  • [MS-1386, KAFKA-983]: Consumer client events related to consumer rebalance (assignment change, ConsumerRebalanceListener callbacks, invocation, etc.) now happen only inside the consumer.poll() method in the user thread, according to the Apache defined behavior.

  • [KAFKA-1031]: In Kafka REST, this means that subscribing a consumer by sending a POST request to a /subscription endpoint will not cause partitions to be assigned to it. Partitions will be assigned only on the next poll call (GET /records).