Spark and Spark on YARN 1.4.1-1508 Release Notes

The notes below relate specifically to the MapR Distribution for Apache Hadoop. You may also be interested in the open source Spark 1.4.1 Release Notes.

Spark Version 1.4.1
Release Date Sept 9, 2015
Source on GitHub
GitHub Release Tag 1.4.1-mapr-1508
MapR Version Interoperability See Spark Support Matrix.

New in This Release

This is the initial MapR release of Spark 1.4.1.

Hive Support

  • This version of Spark supports Spark-SQL with Hive 0.13. However, Hive on Spark is not supported.
  • Spark-SQL is not fully compatible with Hive; see the Apache Spark documentation for details.

Known Issues

On secure clusters, the MapR Control System (MCS) does not display links for Spark-Master and Spark-HistoryServer.
On a secure cluster, MapR does not support the Spark SQL Thrift JDBC server. When the cluster is secure, the Spark Thrift server will not start.