弹性 MapReduce(Clickhouse )

最近更新时间:2024-05-11 18:29:11

我的收藏

命名空间

Namespace = QCE/TXMR_CLICKHOUSE

监控指标

指标英文名
指标中文名
指标说明
单位
维度
统计规则 [period, statType]
ClickhouseBackgroundPoolTaskBackgroundpooltask
BackgroundProcessingPool中的活跃任务数
BackgroundProcessingPool中的活跃任务数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseBackgroundPoolTaskBackgroundschedulepooltask
BackgroundSchedulePool中的活跃任务数
BackgroundSchedulePool中的活跃任务数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseBufferFileDescriptorBytesRead
来自文件描述器的读字节数
来自文件描述器的读字节数
MBytes
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseBufferFileDescriptorBytesWrite
写入文件描述器的字节数
写入文件描述器的字节数
MBytes
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseBufferFileDescriptorCountRead
来自文件描述器的读个数
来自文件描述器的读个数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseBufferFileDescriptorCountWrite
来自文件描述器的写个数
来自文件描述器的写个数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseConnectionCountHttp
HTTP服务器的连接数
HTTP服务器的连接数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseConnectionCountTcp
TCP服务器的连接数
TCP服务器的连接数
Count
id4clickhouseserver host4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDatabaseCountDatabasecount
数据库数量
数据库数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDelayedInsertCountDelayedinserts
被抑制的Insert查询数
被抑制的Insert查询数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDictCacheRequestCountDictcacherequests
cache类型字典的数据源中的请求数
cache类型字典的数据源中的请求数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDiskElapsedMicrosecondsRead
等待读系统调用的总时间
等待读系统调用的总时间
us
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDiskElapsedMicrosecondsWrite
等待写系统调用的总时间
等待写系统调用的总时间
us
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseDistributedFilesToinsertCountDistributedsend
pending的异步插入到分布式表的文件数
pending的异步插入到分布式表的文件数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseExcuteQueryCountInsert
可能执行的Insert查询数
可能执行的Insert查询数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseExcuteQueryCountSelect
可能执行的Select查询数
可能执行的Select查询数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseExcuteQueryCountTotal
可能执行的查询总数
可能执行的查询总数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseFileOpenCountFileopen
已打开的文件数
已打开的文件数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseInsertBytesInsertedbytes
被插入到所有表中的字节数
被插入到所有表中的字节数
Count
id4clickhouseserver host4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseInsertRowsInsertedrows
被插入到所有表中的行数
被插入到所有表中的行数
Count
id4clickhouseserver host4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseLeaderElectionCountLeaderelection
参与leader选举的副本数量
参与leader选举的副本数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMarkCacheBytesMarkcachebytes
StorageMergeTree的marks的缓存大小
StorageMergeTree的marks的缓存大小
MBytes
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMarkCacheFilesMarkcachefiles
StorageMergeTree的marks的缓存文件数
StorageMergeTree的marks的缓存文件数
Count
id4clickhouseserver host4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMaxPartPartitionMaxpartcountforpartition
partitions中最大的活跃数据块的数量
partitions中最大的活跃数据块的数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMemoryAllocatedBackgroundprocessingpool
后台处理池中分配的内存总量
后台处理池中分配的内存总量
GBytes
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMemoryAllocatedBackgroundschedulepool
后台调度池中所分配的内存总量
后台调度池中所分配的内存总量
GBytes
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMemoryAllocatedMemorytracking
当前执行的查询中所分配的内存总量
当前执行的查询中所分配的内存总量
GBytes
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMemoryAllocatedMemorytrackingformerges
后台merges所分配的内存总量
后台merges所分配的内存总量
GBytes
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseMergeCountMerge
正在后台执行的merge数量
正在后台执行的merge数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseOpenFileCountRead
打开的可读文件的数量
打开的可读文件的数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseOpenFileCountWrite
打开的可写文件的数量
打开的可写文件的数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhousePartMutationCountPartmutation
表变更的次数
表变更的次数
Count
id4clickhouseserver host4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseProcessThreadTimeRealtime
处理线程花费的总时间
处理线程花费的总时间
us
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseProcessThreadTimeSystem
在操作系统内核空间下处理线程在执行CPU指令花费的总时间
在操作系统内核空间下处理线程在执行CPU指令花费的总时间
us
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseProcessThreadTimeUser
在用户空间下处理线程在执行CPU指令花费的总时间
在用户空间下处理线程在执行CPU指令花费的总时间
us
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseQueryPreemptedCountQuerypreempted
停止或等待的查询数量
停止或等待的查询数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseQueryThreadCountQuerythread
查询处理的线程数量
查询处理的线程数量
Count
id4clickhouseserver host4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRegexpCreatedCountRegexpcreated
编译的正则表达式数
编译的正则表达式数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicaCountLeaderreplica
属于leader的Replicated table的数量
属于leader的Replicated table的数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicaCountReadonlyreplica
处于只读状态的Replicated table的数量
处于只读状态的Replicated table的数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicaDataPartCountCheck
检查一致性的数据块数量
检查一致性的数据块数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicaDataPartCountFetch
从副本收集的数据块数量
从副本收集的数据块数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicaDataPartCountSend
发送到副本的数量块数量
发送到副本的数量块数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicasInQueueInsert
需要完成的数据块insert数
需要完成的数据块insert数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicasInQueueMerge
待完成的merge数
待完成的merge数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicasMaxDelayAbsolute
最大的replica队列时延
最大的replica队列时延
us
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseReplicasMaxDelayRelative
来自其他块的绝对时延的差异的最大值
来自其他块的绝对时延的差异的最大值
us
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRevisionRevision
server的修改
server的修改
Count
id4clickhouseserver host4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRwlockThreadCountActiveread
在一个表的读写锁中持有读锁的线程数
在一个表的读写锁中持有读锁的线程数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRwlockThreadCountActivewrite
在一个表的读写锁中持有写锁的线程数
在一个表的读写锁中持有写锁的线程数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRwlockThreadCountWaitingread
等待读表的读写锁的线程数量
等待读表的读写锁的线程数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseRwlockThreadCountWaitingwrite
等待写表的读写锁的线程数量
等待写表的读写锁的线程数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseStorageBufferBytesStoragebufferbytes
Buffer tables中的字节数
Buffer tables中的字节数
MBytes
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseStorageBufferRowsStoragebufferrows
Buffer tables中的行数
Buffer tables中的行数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseSyscallCountRead
读系统调用的数量
读系统调用的数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseSyscallCountWrite
写系统调用的数量
写系统调用的数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseTableCountTablecount
数据表数量
数据表数量
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseThreadContextLockWaitCountContextlockwait
在Context中等待锁的线程数
在Context中等待锁的线程数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseThreadCountGlobal
全局线程池中的线程数
全局线程池中的线程数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseThreadCountGlobalactive
全局线程池中活跃的线程数
全局线程池中活跃的线程数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseThreadCountLocal
本地线程池中的线程数
本地线程池中的线程数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseThreadCountLocalactive
本地线程池中活跃的线程数
本地线程池中活跃的线程数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseVersionVersion
版本号
版本号
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseZkEphemeralNodeCountEphemeralnode
ZooKeeper中保存的临时节点数
ZooKeeper中保存的临时节点数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]
ClickhouseZkWatchesCountWatches
ZK事件订阅数
ZK事件订阅数
Count
host4clickhouseserver id4clickhouseserver
[ 60s, max ] [ 300s, max ] [ 3600s, max ] [ 86400s, max ]

各维度对应参数总览

参数名称
维度名称
维度解释
格式
Instances.N.Dimensions.0.Name
host4clickhouseserver
EMR 实例中节点 IP 的维度名称
输入 String 类型维度名称:host4clickhouseserver
Instances.N.Dimensions.0.Value
host4clickhouseserver
EMR 实例中具体节点 IP
输入具体节点 IP,可从控制台获取,登录 腾讯云 MapReduce 控制台,单击实例 > 集群资源 > 资源管理 > 节点内网 IP。也可通过 查询节点信息 API 获取。
Instances.N.Dimensions.0.Name
id4clickhouseserver
EMR 实例 ID 的维度名称
输入 String 类型维度名称:id4clickhouseserver
Instances.N.Dimensions.0.Value
id4clickhouseserver
EMR 实例具体 ID
输入 EMR 具体实例 ID,例如:emr-mm8bs222

入参说明

查询弹性 MapReduce(Clickhouse)监控数据,入参取值如下:
Namespace=QCE/TXMR_CLICKHOUSE &Instances.N.Dimensions.0.Name=host4clickhouseserver &Instances.N.Dimensions.0.Value=EMR 实例中具体节点 IP &Instances.N.Dimensions.1.Name=id4clickhouseserver &Instances.N.Dimensions.1.Value=EMR 实例具体 ID