Spark Monitoring Metrics

Last updated: 2023-12-21 16:50:50

SPARK-HistoryServer

Title
Description
Metric Unit
Description
Garbage Collection Frequency
YGC
Threads
Young Garbage Collection Frequency
FGC
Threads
Full Garbage Collection Frequency
Garbage Collection Duration
FGCT
s
Full Garbage Collection Time Consumption
GCT
s
Garbage Collection Time Expenditure
YGCT
s
Young Garbage Collection Time Consumption
Memory Region Occupancy
S0
%
Survivor 0 Region Memory Usage Proportion
E
%
Eden Region Memory Usage Proportion
CCS
%
Compressed Class Space Region Memory Usage Proportion
S1
%
Survivor 1 Region Memory Usage Proportion
O
%
Old Region Memory Usage Proportion
M
%
Metaspace Region Memory Usage Proportion