yarn-site.xml
Describes the YARN configuration options.
YARN configuration options are stored in the
/opt/mapr/hadoop/hadoop-2.x.x/etc/hadoop/yarn-site.xml
file and are
editable by the root
user. This file contains configuration information
that overrides the default values for YARN parameters. Overrides of the default values for
core configuration properties are stored in the Default YARN parameters file.
To override a default value for a property, specify the new value within the
<configuration>
tags, using the following format:
<property>
<name> </name>
<value> </value>
<description> </description>
</property>
The following configuration lists describe the possible entries that you can place between
the <name>
tags and between the <value>
tags. The
<description>
tag is optional but recommended for maintainability.
Configuration for ResourceManager
- yarn.resourcemanager.hostname
- The hostname of the ResourceManager.
The configure.sh command automatically sets this value to the IP address that you provide with the
-RM
option.Default value:
{IP Address}
- yarn.resourcemanager.scheduler.address
- The hostname and port of the Scheduler Interface.
Example value:
${yarn.resourcemanager.hostname}:8030
- yarn.resourcemanager.resource-tracker.address
- The hostname and port of the Resource Manager.
Example value:
${yarn.resourcemanager.hostname}:8025
- yarn.resourcemanager.address
- The address of the Applications Manager interface that is contained in the Resource
Manager.
Example value:
${yarn.resourcemanager.address}:8041
Configuration for NodeManager
- yarn.nodemanager.container-localizer.log.level
- Default Value:INFO
- yarn.nodemanager.max-retry-file-delete
- Default Value: 2
- yarn.nodemanager.kill-container-child-process
- Default Value:
false
- yarn.nodemanager.container-executor.class
- Default Value:
org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor
- yarn.nodemanager.aux-services
- Default Value:
mapreduce_shuffle, mapr_direct_shuffle
- yarn.nodemanager.aux-services.mapreduce_shuffle.class
- Default Value:
org.apache.hadoop.mapred.ShuffleHandler
- yarn.nodemanager.aux-services.mapr_direct_shuffle.class
- Default Value:
com.mapr.hadoop.mapred.LocalVolumeAuxService
Configuration for Timeline Server Security with MapR-SASL
- yarn.timeline-service.http-authentication.type
- Default Value:
com.mapr.security.maprauth.MaprDelegationTokenAuthenticationHand ler
Configuration for Timeline Server Security with Kerberos
- yarn.timeline-service.http-authentication.type
- Default Value:
com.mapr.security.maprauth.MaprDelegationTokenAuthenticationHand ler
- yarn.timeline-service.http-authentication.kerberos.principal
- Default Value:
principal(HTTP/nodex@NODEx)
- yarn.timeline-service.http-authentication.kerberos.keytab
- Default Value:
path to keytab(/opt/mapr/conf/mapr.keytab)
- yarn.timeline-service.principal
- Default Value:
mapr/nodex@NODEX
- yarn.timeline-service.keytab
- Default Value:
path to keytab(/opt/mapr/conf/mapr.keytab)
Configuration for MapReduce
- mapreduce.job.shuffle.provider.services
- Default Value:
mapr_direct_shuffle
Configuration for Container Logs
- yarn.nodemanager.log-dirs
- Default Value: /opt/mapr/hadoop/hadoop-<version>/logs/userlogs/<applicationID>/<containerID>/<filename>.log
- yarn.log-aggregation-enable
- Default Value: false
- yarn.nodemanager.log.retain-seconds
- Default Value: 10800 (3 hours)
- yarn.log-aggregation.retain-seconds
- Default Value: -1
- yarn.log-aggregation.retain-check-interval-seconds
- Default Value: -1
- yarn.nodemanager.remote-app-log-dir
- Default Value: /tmp/logs
- yarn.nodemanager.remote-app-log-dir-suffix
- Default Value: logs
Configuration for Apache Shuffle
- yarn.nodemanager.aux-services
- Value: mapreduce_shuffle