Hive JMX Metrics
Every 10 seconds, the collectd
service uses the Hive plug-in to gather
the following Hive JMX metrics on each node in the cluster. Descriptions for the Hive metrics
are not currently available.
Metric Collection
Metrics collected in Hive relate specifically to the HiveServer2 and Hive metastore processes. Each process runs in a separate JVM, and the JVMs provide values for the metrics.
Starting in EEP 6.3.2 and EEP 7.0.1, the
hive.exec.submit.local.task.via.child
option (in hive-site.xml) is set to
true
, by default, and enables HiveServer2 to spawn local tasks (typically
mapjoin hashtable generation phase) in child JVMs. The system does not collect metrics for
the child JVMs. The system only collects metrics for the HiveServer2 and Hive metastore
processes.
Hive Metastore Metrics
The following are the JMX metrics provided for the Hive metastore:
- mapr.hivemetastore.hivemetastore_buffers_direct_capacity
- mapr.hivemetastore.hivemetastore_buffers_direct_count
- mapr.hivemetastore.hivemetastore_buffers_direct_used
- mapr.hivemetastore.hivemetastore_buffers_mapped_capacity
- mapr.hivemetastore.hivemetastore_buffers_mapped_count
- mapr.hivemetastore.hivemetastore_buffers_mapped_used
- mapr.hivemetastore.hivemetastore_class_loading_loaded
- mapr.hivemetastore.hivemetastore_class_loading_unloaded
- mapr.hivemetastore.hivemetastore_gc_ps_mark_sweep_count
- mapr.hivemetastore.hivemetastore_gc_ps_mark_sweep_time
- mapr.hivemetastore.hivemetastore_gc_ps_scavenge_count
- mapr.hivemetastore.hivemetastore_gc_ps_scavenge_time
- mapr.hivemetastore.hivemetastore_init_total_count_dbs
- mapr.hivemetastore.hivemetastore_init_total_count_partitions
- mapr.hivemetastore.hivemetastore_init_total_count_tables
- mapr.hivemetastore.hivemetastore_memory_heap_committed
- mapr.hivemetastore.hivemetastore_memory_heap_init
- mapr.hivemetastore.hivemetastore_memory_heap_max
- mapr.hivemetastore.hivemetastore_memory_heap_usage
- mapr.hivemetastore.hivemetastore_memory_heap_used
- mapr.hivemetastore.hivemetastore_memory_non_heap_committed
- mapr.hivemetastore.hivemetastore_memory_non_heap_init
- mapr.hivemetastore.hivemetastore_memory_non_heap_max
- mapr.hivemetastore.hivemetastore_memory_non_heap_usage
- mapr.hivemetastore.hivemetastore_memory_non_heap_used
- mapr.hivemetastore.hivemetastore_memory_pools_code_cache_usage
- mapr.hivemetastore.hivemetastore_memory_pools_compressed_class_space_usage
- mapr.hivemetastore.hivemetastore_memory_pools_metaspace_usage
- mapr.hivemetastore.hivemetastore_memory_pools_ps_eden_space_usage
- mapr.hivemetastore.hivemetastore_memory_pools_ps_old_gen_usage
- mapr.hivemetastore.hivemetastore_memory_pools_ps_survivor_space_usage
- mapr.hivemetastore.hivemetastore_memory_total_committed
- mapr.hivemetastore.hivemetastore_memory_total_init
- mapr.hivemetastore.hivemetastore_memory_total_max
- mapr.hivemetastore.hivemetastore_memory_total_used
- mapr.hivemetastore.hivemetastore_threads_blocked_count
- mapr.hivemetastore.hivemetastore_threads_count
- mapr.hivemetastore.hivemetastore_threads_daemon_count
- mapr.hivemetastore.hivemetastore_threads_deadlock_count
- mapr.hivemetastore.hivemetastore_threads_deadlocks
- mapr.hivemetastore.hivemetastore_threads_new_count
- mapr.hivemetastore.hivemetastore_threads_runnable_count
- mapr.hivemetastore.hivemetastore_threads_terminated_count
- mapr.hivemetastore.hivemetastore_threads_timed_waiting_count
- mapr.hivemetastore.hivemetastore_threads_waiting_count
- mapr.hivemetastore.hivemetastore_active_calls_api_get_all_databases
- mapr.hivemetastore.hivemetastore_active_calls_api_get_all_functions
- mapr.hivemetastore.hivemetastore_active_calls_api_get_all_tables
- mapr.hivemetastore.hivemetastore_active_calls_api_get_database
- mapr.hivemetastore.hivemetastore_active_calls_api_get_multi_table
- mapr.hivemetastore.hivemetastore_active_calls_api_get_table_objects_by_name_req
- mapr.hivemetastore.hivemetastore_active_calls_api_init
- mapr.hivemetastore.hivemetastore_jvm_pause_extra_sleep_time
- mapr.hivemetastore.hivemetastore_open_connections
- mapr.hivemetastore.hivemetastore_api_get_all_databases_count
- mapr.hivemetastore.hivemetastore_api_get_all_databases_max
- mapr.hivemetastore.hivemetastore_api_get_all_databases_mean
- mapr.hivemetastore.hivemetastore_api_get_all_databases_min
- mapr.hivemetastore.hivemetastore_api_get_all_databases_p50
- mapr.hivemetastore.hivemetastore_api_get_all_databases_p75
- mapr.hivemetastore.hivemetastore_api_get_all_databases_p95
- mapr.hivemetastore.hivemetastore_api_get_all_databases_p98
- mapr.hivemetastore.hivemetastore_api_get_all_databases_p99
- mapr.hivemetastore.hivemetastore_api_get_all_databases_p999
- mapr.hivemetastore.hivemetastore_api_get_all_databases_stddev
- mapr.hivemetastore.hivemetastore_api_get_all_databases_m15_rate
- mapr.hivemetastore.hivemetastore_api_get_all_databases_m1_rate
- mapr.hivemetastore.hivemetastore_api_get_all_databases_m5_rate
- mapr.hivemetastore.hivemetastore_api_get_all_databases_mean_rate
- mapr.hivemetastore.hivemetastore_api_get_all_functions_count
- mapr.hivemetastore.hivemetastore_api_get_all_functions_max
- mapr.hivemetastore.hivemetastore_api_get_all_functions_mean
- mapr.hivemetastore.hivemetastore_api_get_all_functions_min
- mapr.hivemetastore.hivemetastore_api_get_all_functions_p50
- mapr.hivemetastore.hivemetastore_api_get_all_functions_p75
- mapr.hivemetastore.hivemetastore_api_get_all_functions_p95
- mapr.hivemetastore.hivemetastore_api_get_all_functions_p98
- mapr.hivemetastore.hivemetastore_api_get_all_functions_p99
- mapr.hivemetastore.hivemetastore_api_get_all_functions_p999
- mapr.hivemetastore.hivemetastore_api_get_all_functions_stddev
- mapr.hivemetastore.hivemetastore_api_get_all_functions_m15_rate
- mapr.hivemetastore.hivemetastore_api_get_all_functions_m1_rate
- mapr.hivemetastore.hivemetastore_api_get_all_functions_m5_rate
- mapr.hivemetastore.hivemetastore_api_get_all_functions_mean_rate
- mapr.hivemetastore.hivemetastore_api_get_all_tables_count
- mapr.hivemetastore.hivemetastore_api_get_all_tables_max
- mapr.hivemetastore.hivemetastore_api_get_all_tables_mean
- mapr.hivemetastore.hivemetastore_api_get_all_tables_min
- mapr.hivemetastore.hivemetastore_api_get_all_tables_p50
- mapr.hivemetastore.hivemetastore_api_get_all_tables_p75
- mapr.hivemetastore.hivemetastore_api_get_all_tables_p95
- mapr.hivemetastore.hivemetastore_api_get_all_tables_p98
- mapr.hivemetastore.hivemetastore_api_get_all_tables_p99
- mapr.hivemetastore.hivemetastore_api_get_all_tables_p999
- mapr.hivemetastore.hivemetastore_api_get_all_tables_stddev
- mapr.hivemetastore.hivemetastore_api_get_all_tables_m15_rate
- mapr.hivemetastore.hivemetastore_api_get_all_tables_m1_rate
- mapr.hivemetastore.hivemetastore_api_get_all_tables_m5_rate
- mapr.hivemetastore.hivemetastore_api_get_all_tables_mean_rate
- mapr.hivemetastore.hivemetastore_api_get_multi_table_count
- mapr.hivemetastore.hivemetastore_api_get_multi_table_max
- mapr.hivemetastore.hivemetastore_api_get_multi_table_mean
- mapr.hivemetastore.hivemetastore_api_get_multi_table_min
- mapr.hivemetastore.hivemetastore_api_get_multi_table_p50
- mapr.hivemetastore.hivemetastore_api_get_multi_table_p75
- mapr.hivemetastore.hivemetastore_api_get_multi_table_p95
- mapr.hivemetastore.hivemetastore_api_get_multi_table_p98
- mapr.hivemetastore.hivemetastore_api_get_multi_table_p99
- mapr.hivemetastore.hivemetastore_api_get_multi_table_p999
- mapr.hivemetastore.hivemetastore_api_get_multi_table_stddev
- mapr.hivemetastore.hivemetastore_api_get_multi_table_m15_rate
- mapr.hivemetastore.hivemetastore_api_get_multi_table_m1_rate
- mapr.hivemetastore.hivemetastore_api_get_multi_table_m5_rate
- mapr.hivemetastore.hivemetastore_api_get_multi_table_mean_rate
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_count
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_max
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_mean
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_min
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p50
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p75
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p95
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p98
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p99
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_p999
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_stddev
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_m15_rate
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_m1_rate
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_m5_rate
- mapr.hivemetastore.hivemetastore_api_get_table_objects_by_name_req_mean_rate
- mapr.hivemetastore.hivemetastore_api_init_count
- mapr.hivemetastore.hivemetastore_api_init_max
- mapr.hivemetastore.hivemetastore_api_init_mean
- mapr.hivemetastore.hivemetastore_api_init_min
- mapr.hivemetastore.hivemetastore_api_init_p50
- mapr.hivemetastore.hivemetastore_api_init_p75
- mapr.hivemetastore.hivemetastore_api_init_p95
- mapr.hivemetastore.hivemetastore_api_init_p98
- mapr.hivemetastore.hivemetastore_api_init_p99
- mapr.hivemetastore.hivemetastore_api_init_p999
- mapr.hivemetastore.hivemetastore_api_init_stddev
- mapr.hivemetastore.hivemetastore_api_init_m15_rate
- mapr.hivemetastore.hivemetastore_api_init_m1_rate
- mapr.hivemetastore.hivemetastore_api_init_m5_rate
- mapr.hivemetastore.hivemetastore_api_init_mean_rate
HiveServer2 Metrics
The following are the JMX metrics provided for HiveServer2 (hs2):
- mapr.hiveserver2.hiveserver2_buffers_direct_capacity
- mapr.hiveserver2.hiveserver2_buffers_direct_count
- mapr.hiveserver2.hiveserver2_buffers_direct_used
- mapr.hiveserver2.hiveserver2_buffers_mapped_capacity
- mapr.hiveserver2.hiveserver2_buffers_mapped_count
- mapr.hiveserver2.hiveserver2_buffers_mapped_used
- mapr.hiveserver2.hiveserver2_class_loading_loaded
- mapr.hiveserver2.hiveserver2_class_loading_unloaded
- mapr.hiveserver2.hiveserver2_exec_async_pool_size
- mapr.hiveserver2.hiveserver2_exec_async_queue_size
- mapr.hiveserver2.hiveserver2_gc_ps_mark_sweep_count
- mapr.hiveserver2.hiveserver2_gc_ps_mark_sweep_time
- mapr.hiveserver2.hiveserver2_gc_ps_scavenge_count
- mapr.hiveserver2.hiveserver2_gc_ps_scavenge_time
- mapr.hiveserver2.hiveserver2_active_sessions
- mapr.hiveserver2.hiveserver2_open_sessions
- mapr.hiveserver2.hiveserver2_init_total_count_dbs
- mapr.hiveserver2.hiveserver2_init_total_count_partitions
- mapr.hiveserver2.hiveserver2_init_total_count_tables
- mapr.hiveserver2.hiveserver2_memory_heap_committed
- mapr.hiveserver2.hiveserver2_memory_heap_init
- mapr.hiveserver2.hiveserver2_memory_heap_max
- mapr.hiveserver2.hiveserver2_memory_heap_usage
- mapr.hiveserver2.hiveserver2_memory_heap_used
- mapr.hiveserver2.hiveserver2_memory_non_heap_committed
- mapr.hiveserver2.hiveserver2_memory_non_heap_init
- mapr.hiveserver2.hiveserver2_memory_non_heap_max
- mapr.hiveserver2.hiveserver2_memory_non_heap_usage
- mapr.hiveserver2.hiveserver2_memory_non_heap_used
- mapr.hiveserver2.hiveserver2_memory_pools_code_cache_usage
- mapr.hiveserver2.hiveserver2_memory_pools_compressed_class_space_usage
- mapr.hiveserver2.hiveserver2_memory_pools_metaspace_usage
- mapr.hiveserver2.hiveserver2_memory_pools_ps_eden_space_usage
- mapr.hiveserver2.hiveserver2_memory_pools_ps_old_gen_usage
- mapr.hiveserver2.hiveserver2_memory_pools_ps_survivor_space_usage
- mapr.hiveserver2.hiveserver2_memory_total_committed
- mapr.hiveserver2.hiveserver2_memory_total_init
- mapr.hiveserver2.hiveserver2_memory_total_max
- mapr.hiveserver2.hiveserver2_memory_total_used
- mapr.hiveserver2.hiveserver2_threads_blocked_count
- mapr.hiveserver2.hiveserver2_threads_count
- mapr.hiveserver2.hiveserver2_threads_daemon_count
- mapr.hiveserver2.hiveserver2_threads_deadlock_count
- mapr.hiveserver2.hiveserver2_threads_deadlocks
- mapr.hiveserver2.hiveserver2_threads_new_count
- mapr.hiveserver2.hiveserver2_threads_runnable_count
- mapr.hiveserver2.hiveserver2_threads_terminated_count
- mapr.hiveserver2.hiveserver2_threads_timed_waiting_count
- mapr.hiveserver2.hiveserver2_threads_waiting_count
- mapr.hiveserver2.hiveserver2_active_calls_api_get_all_databases
- mapr.hiveserver2.hiveserver2_active_calls_api_get_all_functions
- mapr.hiveserver2.hiveserver2_active_calls_api_get_all_tables
- mapr.hiveserver2.hiveserver2_active_calls_api_get_database
- mapr.hiveserver2.hiveserver2_active_calls_api_get_multi_table
- mapr.hiveserver2.hiveserver2_active_calls_api_get_table_objects_by_name_req
- mapr.hiveserver2.hiveserver2_active_calls_api_init
- mapr.hiveserver2.hiveserver2_jvm_pause_extra_sleep_time
- mapr.hiveserver2.hiveserver2_open_connections
- mapr.hiveserver2.hiveserver2_api_get_all_databases_count
- mapr.hiveserver2.hiveserver2_api_get_all_databases_max
- mapr.hiveserver2.hiveserver2_api_get_all_databases_mean
- mapr.hiveserver2.hiveserver2_api_get_all_databases_min
- mapr.hiveserver2.hiveserver2_api_get_all_databases_p50
- mapr.hiveserver2.hiveserver2_api_get_all_databases_p75
- mapr.hiveserver2.hiveserver2_api_get_all_databases_p95
- mapr.hiveserver2.hiveserver2_api_get_all_databases_p98
- mapr.hiveserver2.hiveserver2_api_get_all_databases_p99
- mapr.hiveserver2.hiveserver2_api_get_all_databases_p999
- mapr.hiveserver2.hiveserver2_api_get_all_databases_stddev
- mapr.hiveserver2.hiveserver2_api_get_all_databases_m15_rate
- mapr.hiveserver2.hiveserver2_api_get_all_databases_m1_rate
- mapr.hiveserver2.hiveserver2_api_get_all_databases_m5_rate
- mapr.hiveserver2.hiveserver2_api_get_all_databases_mean_rate
- mapr.hiveserver2.hiveserver2_api_get_all_functions_count
- mapr.hiveserver2.hiveserver2_api_get_all_functions_max
- mapr.hiveserver2.hiveserver2_api_get_all_functions_mean
- mapr.hiveserver2.hiveserver2_api_get_all_functions_min
- mapr.hiveserver2.hiveserver2_api_get_all_functions_p50
- mapr.hiveserver2.hiveserver2_api_get_all_functions_p75
- mapr.hiveserver2.hiveserver2_api_get_all_functions_p95
- mapr.hiveserver2.hiveserver2_api_get_all_functions_p98
- mapr.hiveserver2.hiveserver2_api_get_all_functions_p99
- mapr.hiveserver2.hiveserver2_api_get_all_functions_p999
- mapr.hiveserver2.hiveserver2_api_get_all_functions_stddev
- mapr.hiveserver2.hiveserver2_api_get_all_functions_m15_rate
- mapr.hiveserver2.hiveserver2_api_get_all_functions_m1_rate
- mapr.hiveserver2.hiveserver2_api_get_all_functions_m5_rate
- mapr.hiveserver2.hiveserver2_api_get_all_functions_mean_rate
- mapr.hiveserver2.hiveserver2_api_get_all_tables_count
- mapr.hiveserver2.hiveserver2_api_get_all_tables_max
- mapr.hiveserver2.hiveserver2_api_get_all_tables_mean
- mapr.hiveserver2.hiveserver2_api_get_all_tables_min
- mapr.hiveserver2.hiveserver2_api_get_all_tables_p50
- mapr.hiveserver2.hiveserver2_api_get_all_tables_p75
- mapr.hiveserver2.hiveserver2_api_get_all_tables_p95
- mapr.hiveserver2.hiveserver2_api_get_all_tables_p98
- mapr.hiveserver2.hiveserver2_api_get_all_tables_p99
- mapr.hiveserver2.hiveserver2_api_get_all_tables_p999
- mapr.hiveserver2.hiveserver2_api_get_all_tables_stddev
- mapr.hiveserver2.hiveserver2_api_get_all_tables_m15_rate
- mapr.hiveserver2.hiveserver2_api_get_all_tables_m1_rate
- mapr.hiveserver2.hiveserver2_api_get_all_tables_m5_rate
- mapr.hiveserver2.hiveserver2_api_get_all_tables_mean_rate
- mapr.hiveserver2.hiveserver2_api_get_multi_table_count
- mapr.hiveserver2.hiveserver2_api_get_multi_table_max
- mapr.hiveserver2.hiveserver2_api_get_multi_table_mean
- mapr.hiveserver2.hiveserver2_api_get_multi_table_min
- mapr.hiveserver2.hiveserver2_api_get_multi_table_p50
- mapr.hiveserver2.hiveserver2_api_get_multi_table_p75
- mapr.hiveserver2.hiveserver2_api_get_multi_table_p95
- mapr.hiveserver2.hiveserver2_api_get_multi_table_p98
- mapr.hiveserver2.hiveserver2_api_get_multi_table_p99
- mapr.hiveserver2.hiveserver2_api_get_multi_table_p999
- mapr.hiveserver2.hiveserver2_api_get_multi_table_stddev
- mapr.hiveserver2.hiveserver2_api_get_multi_table_m15_rate
- mapr.hiveserver2.hiveserver2_api_get_multi_table_m1_rate
- mapr.hiveserver2.hiveserver2_api_get_multi_table_m5_rate
- mapr.hiveserver2.hiveserver2_api_get_multi_table_mean_rate
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_count
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_max
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_mean
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_min
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p50
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p75
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p95
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p98
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p99
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_p999
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_stddev
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_m15_rate
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_m1_rate
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_m5_rate
- mapr.hiveserver2.hiveserver2_api_get_table_objects_by_name_req_mean_rate
- mapr.hiveserver2.hiveserver2_api_init_count
- mapr.hiveserver2.hiveserver2_api_init_max
- mapr.hiveserver2.hiveserver2_api_init_mean
- mapr.hiveserver2.hiveserver2_api_init_min
- mapr.hiveserver2.hiveserver2_api_init_p50
- mapr.hiveserver2.hiveserver2_api_init_p75
- mapr.hiveserver2.hiveserver2_api_init_p95
- mapr.hiveserver2.hiveserver2_api_init_p98
- mapr.hiveserver2.hiveserver2_api_init_p99
- mapr.hiveserver2.hiveserver2_api_init_p999
- mapr.hiveserver2.hiveserver2_api_init_stddev
- mapr.hiveserver2.hiveserver2_api_init_m15_rate
- mapr.hiveserver2.hiveserver2_api_init_m1_rate
- mapr.hiveserver2.hiveserver2_api_init_m5_rate
- mapr.hiveserver2.hiveserver2_api_init_mean_rate