Additional Drill-on-YARN Configuration Options
You can include additional configuration options in the
$DRILL_SITE/drill-on-yarn.conf file for specialized cases. For example,
you can customize the Application Master web UI port or Application Master settings.
Refer to the drill-on-yarn-example.conf file in $DRILL_HOME/conf to see
examples of the additional options. Do not use the example file.
The following list describes the changes that you can make for several of the Drill-on-YARN components:
- Application Name
- You can customize the application name that appears when starting or stopping the
Drill cluster and in the Drill-on-YARN web UI. Change the value of the following
option to a name you prefer:
app-name: "My Drill Cluster" - Application Master Web UI Port
- If you run multiple Drill clusters in a YARN cluster, YARN may assign two Drill
Application Master processes on the same node. To avoid port conflicts, change the
HTTP port for one or both of the Drill clusters. Change the value of the following
option to a different port
number:
drill.yarn: http: { port: 12345 } } - Application Master Settings
- You can customize certain Application Master properties. All of the Application
Master properties are prefixed with
drill.yarn.am, for exampledrill.yarn.am.heap.The following table lists the Application Master properties with their default settings:Name Description Default memory-mb Memory, in MB, to allocate to the Application Master. 14336 vcores Number of CPUS to allocate to the Application Master. 1 heap Java heap for the Application Master. 450M - Drillbit
- You can customize certain properties that control the Drillbit processes. All of the
Drillbit properties are prefixed with
drill.yarn.drillbit, for exampledrill.yarn.drillbit.disks.NOTEYou can specify Drill disk usage to YARN, however Drill uses all disks regardless of the setting.The following table lists the Drillbit properties with their default settings:Name Description Default code-cache Code cache that holds classes generated at runtime. 1G memory-mb Memory, in MB, to allocate to the Drillbit. 13000 vcores Number of CPUS to allocate to the AM. 4 disks Number of disk equivalents consumed by Drill (on versions of YARN that support disk resources.) 1 heap Java heap memory. 4G max-direct-memory Direct (off-heap) memory for the Drillbit. 4G log-gc Enables Java garbage collector logging. false class-path Additional class-path entries. blank