Enabling Centralized Logging for MapReduce Version 2

Describes how to enable central logging for MapReduce version 2 applications.

About this task

As of MapR version 4.0.2, you can use centralized logging for MapReduce version 2 applications. However, this feature is disabled by default. In MapR version 4.0.1, centralized logging is not supported for MapReduce version 2 applications.

Procedure

Configure the yarn.use-central-logging-for-mapreduce-only property in the yarn-site.xml file to enable or disable centralized logging.
The yarn-site.xml file is located in the following directory: /opt/mapr/hadoop/hadoop-2.x.x/etc/hadoop/.
  • To disable centralized logging, remove the property yarn.use-central-logging-for-mapreduce-only from the yarn-site.xml file, or set the value of yarn.use-central-logging-for-mapreduce-only to false in the yarn-site.xml file.
  • To enable centralized logging, set the value of yarn.use-central-logging-for-mapreduce-only to true in the yarn-site.xml file. If you enable centralized logging while applications are running, restart all ResourceManagers. In a production cluster, restart ResoureManagers one at a time to prevent interruption to the running applications. The applications running during this process may not have centralized logging enabled.