Kafka指标的详细信息

本文为您介绍Kafka指标的详细信息。 Kafka-HOME 参数 指标 描述 ActiveControllerCount Kafka_Broker_kafka_controller_KafkaController_ActiveControllerCount 当某个Broker上该指标为1时，该Broker为Controller节点。 GlobalTopicCount Kafka_Broker_kafka_controller_KafkaController_GlobalTopicCount 集群总Topic个数。 GlobalPartitionCount Kafka_Broker_kafka_controller_KafkaController_GlobalPartitionCount 集群总Partition个数。 UnderMinIsrPartitionCount Kafka_Broker_kafka_server_ReplicaManager_UnderMinIsrPartitionCount 低于Min Isr partition的个数。 OfflineLogDirectoryCount Kafka_Broker_kafka_log_LogManager_OfflineLogDirectoryCount Directory Offline个数。 OfflinePartitionsCount Kafka_Broker_kafka_controller_KafkaController_OfflinePartitionsCount Offline的Partition个数。 UnderReplicatedPartitions Kafka_Broker_kafka_server_ReplicaManager_UnderReplicatedPartitions 处于未同步状态Partition个数。 BytesOutPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate 每秒流量出口字节数。 BytesInPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate 每秒流量入口字节数。 MessagesInPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate 每秒流量入口条数。 Kafka-Broker Status 参数 指标 描述 LeaderCount Kafka_Broker_kafka_server_ReplicaManager_LeaderCount Leader个数。 PartitionCount Kafka_Broker_kafka_server_ReplicaManager_PartitionCount Partition个数。 OfflineLogDirectoryCount Kafka_Broker_kafka_log_LogManager_OfflineLogDirectoryCount Directory Offline个数。 OfflineReplicaCount Kafka_Broker_kafka_server_ReplicaManager_OfflineReplicaCount Offline Replica个数。 UnderReplicatedPartitions Kafka_Broker_kafka_server_ReplicaManager_UnderReplicatedPartitions 处于未同步状态的Partition个数。 UnderMinIsrPartitionCount Kafka_Broker_kafka_server_ReplicaManager_UnderMinIsrPartitionCount 低于Min Isr partition的个数。 Throughput 参数 指标 描述 BytesInPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate Broker每秒流量入口字节数。 BytesOutPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate Broker每秒流量出口字节数。 MessagesInPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate Broker每秒流量入口条数。 Performance 参数 指标 描述 IsrShrinksPerSec Kafka_Broker_kafka_server_ReplicaManager_IsrShrinksPerSec_OneMinuteRate ISR缩减频率。 IsrExpandsPerSec Kafka_Broker_kafka_server_ReplicaManager_IsrExpandsPerSec_OneMinuteRate ISR膨胀频率。 RequestHandlerAvgIdlePercent Kafka_Broker_kafka_server_KafkaRequestHandlerPool_RequestHandlerAvgIdlePercent_OneMinuteRate Request请求处理线程的空闲比。 NetworkProcessorAvgIdlePercent Kafka_Broker_kafka_network_SocketServer_NetworkProcessorAvgIdlePercent 网络处理线程的空闲比。 RequestQueueUsagePercent Kafka_Broker_kafka_network_RequestChannel_RequestQueueUsagePercent RequestQueue队列的使用率。 LogFlushRateAndTimeMs Kafka_Broker_kafka_log_LogFlushStats_LogFlushRateAndTimeMs_OneMinuteRate 磁盘刷盘的速率。 Kafka_Broker_kafka_log_LogFlushStats_LogFlushRateAndTimeMs_99thPercentile 磁盘刷盘消耗的时间，单位：ms。 Storage 参数 指标 描述 Size Kafka_Broker_kafka_log_Log_Size Partition存储的大小。 disk-usages-max-percent Kafka_Broker_kafka_server_ReplicaManager_disk_usages_max_percent 该Broker各个磁盘使用率的最大值。 disk-usages-mean-percent Kafka_Broker_kafka_server_ReplicaManager_disk_usages_mean_percent 该Broker各个磁盘使用率的平均值。 disk-usages-min-percent Kafka_Broker_kafka_server_ReplicaManager_disk_usages_min_percent 该Broker各个磁盘使用率的最小值。 Request Rate 参数 指标 描述 TotalFetchRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate Broker每秒Fetch请求次数。 TotalProduceRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate Broker每秒Produce请求次数。 FailedFetchRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate Broker每秒失败的Fetch请求次数。 FailedProduceRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate Broker每秒失败的Produce请求次数。 RequestsPerSec-Produce Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate Produce每秒请求的字节数。 RequestsPerSec-Fetch Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate Fetch请求数。 RequestsPerSec-FetchFollower Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate Follower Fetch请求数。 RequestsPerSec-FetchConsumer Kafka_Broker_kafka_network_RequestMetrics_RequestsPerSec_OneMinuteRate Consumer Fetch请求数。 Request Time 参数 指标 描述 RequestMetrics-TotalTimeMs-Produce-99th Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile Produce Request处理时长，单位：ms。 RequestMetrics-TotalTimeMs-Fetch-99th Kafka_Broker_kafka_network_RequestMetrics_TotalTimeMs_99thPercentile Fetch Request处理时长，单位：ms。 MessageConversion 参数 指标 描述 FetchMessageConversionsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FetchMessageConversionsPerSec_OneMinuteRate Broker每秒Fetch Request导致的消息版本转换的条数。 ProduceMessageConversionsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate Broker每秒Produce Request导致的消息版本转换的条数。 ZK session 参数 指标 描述 ZooKeeperDisconnectsPerSec Kafka_Broker_kafka_server_SessionExpireListener_ZooKeeperDisconnectsPerSec_OneMinuteRate Zookeeper客户端断开频率。 ZooKeeperExpiresPerSec Kafka_Broker_kafka_server_SessionExpireListener_ZooKeeperExpiresPerSec_OneMinuteRate Zookeeper客户端Session过期频率。 JVM 参数 指标 描述 G1-Old-CollectionTime Kafka_Broker_java_lang_GarbageCollector_G1_Old_Generation_CollectionTime 老年代垃圾回收器收集时长。 G1-Old-CollectionCount Kafka_Broker_java_lang_GarbageCollector_G1_Old_Generation_CollectionCount 老年代垃圾回收器收集次数。 G1-Young-CollectionTime Kafka_Broker_java_lang_GarbageCollector_G1_Young_Generation_CollectionTime 年轻代垃圾回收器收集时长。 G1-Young-CollectionCount Kafka_Broker_java_lang_GarbageCollector_G1_Young_Generation_CollectionCount 年轻代垃圾回收器收集次数。 Kafka-Topic Status 参数 指标 描述 UnderReplicated Kafka_Broker_kafka_cluster_Partition_UnderReplicated 该Topic-Partition是否在非同步状态。 UnderMinIsr Kafka_Broker_kafka_cluster_Partition_UnderMinIsr 该Topic-Partition是否处于小于MinIsr状态。 Throughput 参数 指标 描述 BytesInPerSec kafka_server_BrokerTopicMetrics_BytesInPerSec_OneMinuteRate Topic每秒流量入口字节数。 BytesOutPerSec kafka_server_BrokerTopicMetrics_BytesOutPerSec_OneMinuteRate Topic每秒流量出口字节数。 MessagesInPerSec kafka_server_BrokerTopicMetrics_MessagesInPerSec_OneMinuteRate Topic每秒流量入口条数。 Request Rate 参数 指标 描述 TotalFetchRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalFetchRequestsPerSec_OneMinuteRate Topic每秒Fetch请求次数。 TotalProduceRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_TotalProduceRequestsPerSec_OneMinuteRate Topic每秒Produce请求次数。 FailedFetchRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedFetchRequestsPerSec_OneMinuteRate Topic每秒失败Fetch请求次数。 FailedProduceRequestsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FailedProduceRequestsPerSec_OneMinuteRate Topic每秒失败Produce请求次数。 MessageConversion 参数 指标 描述 FetchMessageConversionsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_FetchMessageConversionsPerSec_OneMinuteRate Topic每秒Fetch Request导致的消息版本转换的条数。 ProduceMessageConversionsPerSec Kafka_Broker_kafka_server_BrokerTopicMetrics_ProduceMessageConversionsPerSec_OneMinuteRate Topic每秒Produce Request导致的消息版本转换的条数。 Storage 参数 指标 描述 Size Kafka_Broker_kafka_log_Log_Size Partition存储的大小。