Amazon Managed Streaming for Apache Kafka
Rapport de recherche Datadog : Bilan sur l'adoption de l'informatique sans serveur Rapport : Bilan sur l'adoption de l'informatique sans serveur

Amazon Managed Streaming for Apache Kafka

Agent Check Check de l'Agent

Présentation

Amazon Managed Streaming for Apache Kafka (MSK) est un service entièrement géré qui vous permet de créer et d’exécuter facilement des applications qui utilisent Apache Kafka pour traiter les données en streaming.

Vous pouvez recueillir des métriques à partir de cette intégration de deux façons : avec l’Agent Datadog ou avec un Crawler qui recueille des métriques à partir de Cloudwatch.

Check de l’Agent

Le check de l’Agent permet de surveiller Amazon Managed Streaming for Apache Kafka (Amazon MSK) avec l’Agent Datadog.

Implémentation

Suivez les instructions ci-dessous pour installer et configurer ce check lorsque l’Agent est exécuté sur un host. Consultez la documentation relative aux modèles d’intégration Autodiscovery pour découvrir comment appliquer ces instructions à un environnement conteneurisé.

Installation

  1. Créez une machine client si ce n’est pas déjà fait.
  2. Assurez-vous que la machine client dispose de la stratégie d’autorisation arn:aws:iam::aws:policy/AmazonMSKReadOnlyAccess ou que des identifiants équivalents sont disponibles.
  3. Installez l’Agent Datadog.

Configuration

  1. Modifiez le fichier amazon_msk.d/conf.yaml dans le dossier conf.d/ à la racine du répertoire de configuration de votre Agent pour commencer à recueillir vos données de performance Amazon MSK. Consultez le fichier d’exemple amazon_msk.d/conf.yaml pour découvrir toutes les options de configuration disponibles.

  2. Redémarrez l’Agent.

Validation

Lancez la sous-commande status de l’Agent et cherchez amazon_msk dans la section Checks.

Données collectées

Métriques

aws.msk.go.gc.duration.seconds.count
(gauge)
GC invocation durations count.
aws.msk.go.gc.duration.seconds.quantile
(gauge)
GC invocation duration quantile.
Shown as second
aws.msk.go.gc.duration.seconds.sum
(gauge)
GC invocation duration total.
Shown as second
aws.msk.go.goroutines
(gauge)
Number of goroutines that currently exist.
Shown as thread
aws.msk.go.info
(gauge)
Information about the Go environment.
aws.msk.go.memstats.alloc.bytes
(gauge)
Number of bytes allocated and still in use.
Shown as byte
aws.msk.go.memstats.alloc.bytes.total
(count)
Total number of bytes allocated, even if freed.
Shown as byte
aws.msk.go.memstats.buck.hash.sys.bytes
(gauge)
Number of bytes used by the profiling bucket hash table.
Shown as byte
aws.msk.go.memstats.frees.total
(count)
Total number of frees.
aws.msk.go.memstats.gc.cpu.fraction
(gauge)
The fraction of this program's available CPU time used by the GC since the program started.
aws.msk.go.memstats.gc.sys.bytes
(gauge)
Number of bytes used for garbage collection system metadata.
Shown as byte
aws.msk.go.memstats.heap.alloc.bytes
(gauge)
Number of heap bytes allocated and still in use.
Shown as byte
aws.msk.go.memstats.heap.idle.bytes
(gauge)
Number of heap bytes waiting to be used.
Shown as byte
aws.msk.go.memstats.heap.inuse.bytes
(gauge)
Number of heap bytes that are in use.
Shown as byte
aws.msk.go.memstats.heap.objects
(gauge)
Number of allocated objects.
aws.msk.go.memstats.heap.released.bytes
(gauge)
Number of heap bytes released to OS.
Shown as byte
aws.msk.go.memstats.heap.sys.bytes
(gauge)
Number of heap bytes obtained from system.
Shown as byte
aws.msk.go.memstats.last.gc.time.seconds
(gauge)
Number of seconds since 1970 of last garbage collection.
Shown as second
aws.msk.go.memstats.lookups.total
(count)
Total number of pointer lookups.
aws.msk.go.memstats.mallocs.total
(count)
Total number of mallocs.
aws.msk.go.memstats.mcache.inuse.bytes
(gauge)
Number of bytes in use by mcache structures.
Shown as byte
aws.msk.go.memstats.mcache.sys.bytes
(gauge)
Number of bytes used for mcache structures obtained from system.
Shown as byte
aws.msk.go.memstats.mspan.inuse.bytes
(gauge)
Number of bytes in use by mspan structures.
Shown as byte
aws.msk.go.memstats.mspan.sys.bytes
(gauge)
Number of bytes used for mspan structures obtained from system.
Shown as byte
aws.msk.go.memstats.next.gc.bytes
(gauge)
Number of heap bytes when next garbage collection will take place.
Shown as byte
aws.msk.go.memstats.other.sys.bytes
(gauge)
Number of bytes used for other system allocations.
Shown as byte
aws.msk.go.memstats.stack.inuse.bytes
(gauge)
Number of bytes in use by the stack allocator.
Shown as byte
aws.msk.go.memstats.stack.sys.bytes
(gauge)
Number of bytes obtained from system for stack allocator.
Shown as byte
aws.msk.go.memstats.sys.bytes
(gauge)
Number of bytes obtained from system.
Shown as byte
aws.msk.go.threads
(gauge)
Number of OS threads created.
Shown as thread
aws.msk.jmx.config.reload.failure.total
(count)
Number of times configuration have failed to be reloaded.
aws.msk.jmx.config.reload.success.total
(count)
Number of times configuration have successfully been reloaded.
aws.msk.jmx.exporter.build.info
(gauge)
A metric with a constant '1' value labeled with the version of the JMX exporter.
aws.msk.jmx.scrape.duration.seconds
(gauge)
Time this JMX scrape took, in seconds.
Shown as second
aws.msk.jmx.scrape.error
(gauge)
Non-zero if this scrape failed.
aws.msk.kafka.cluster.Partition.Value
(gauge)
Attribute exposed for management (kafka.cluster<>Value)
aws.msk.kafka.controller.ControllerChannelManager.50thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>50thPercentile)
aws.msk.kafka.controller.ControllerChannelManager.75thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>75thPercentile)
aws.msk.kafka.controller.ControllerChannelManager.95thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>95thPercentile)
aws.msk.kafka.controller.ControllerChannelManager.98thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>98thPercentile)
aws.msk.kafka.controller.ControllerChannelManager.999thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>999thPercentile)
aws.msk.kafka.controller.ControllerChannelManager.99thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>99thPercentile)
aws.msk.kafka.controller.ControllerChannelManager.Count
(gauge)
Attribute exposed for management (kafka.controller<>Count)
aws.msk.kafka.controller.ControllerChannelManager.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.controller<>FifteenMinuteRate)
aws.msk.kafka.controller.ControllerChannelManager.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.controller<>FiveMinuteRate)
aws.msk.kafka.controller.ControllerChannelManager.Max
(gauge)
Attribute exposed for management (kafka.controller<>Max)
aws.msk.kafka.controller.ControllerChannelManager.Mean
(gauge)
Attribute exposed for management (kafka.controller<>Mean)
aws.msk.kafka.controller.ControllerChannelManager.MeanRate
(gauge)
Attribute exposed for management (kafka.controller<>MeanRate)
aws.msk.kafka.controller.ControllerChannelManager.Min
(gauge)
Attribute exposed for management (kafka.controller<>Min)
aws.msk.kafka.controller.ControllerChannelManager.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.controller<>OneMinuteRate)
aws.msk.kafka.controller.ControllerChannelManager.StdDev
(gauge)
Attribute exposed for management (kafka.controller<>StdDev)
aws.msk.kafka.controller.ControllerChannelManager.Value
(gauge)
Attribute exposed for management (kafka.controller<>Value)
aws.msk.kafka.controller.ControllerEventManager.50thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>50thPercentile)
aws.msk.kafka.controller.ControllerEventManager.75thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>75thPercentile)
aws.msk.kafka.controller.ControllerEventManager.95thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>95thPercentile)
aws.msk.kafka.controller.ControllerEventManager.98thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>98thPercentile)
aws.msk.kafka.controller.ControllerEventManager.999thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>999thPercentile)
aws.msk.kafka.controller.ControllerEventManager.99thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>99thPercentile)
aws.msk.kafka.controller.ControllerEventManager.Count
(gauge)
Attribute exposed for management (kafka.controller<>Count)
aws.msk.kafka.controller.ControllerEventManager.Max
(gauge)
Attribute exposed for management (kafka.controller<>Max)
aws.msk.kafka.controller.ControllerEventManager.Mean
(gauge)
Attribute exposed for management (kafka.controller<>Mean)
aws.msk.kafka.controller.ControllerEventManager.Min
(gauge)
Attribute exposed for management (kafka.controller<>Min)
aws.msk.kafka.controller.ControllerEventManager.StdDev
(gauge)
Attribute exposed for management (kafka.controller<>StdDev)
aws.msk.kafka.controller.ControllerEventManager.Value
(gauge)
Attribute exposed for management (kafka.controller<>Value)
aws.msk.kafka.controller.ControllerStats.50thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>50thPercentile)
aws.msk.kafka.controller.ControllerStats.75thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>75thPercentile)
aws.msk.kafka.controller.ControllerStats.95thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>95thPercentile)
aws.msk.kafka.controller.ControllerStats.98thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>98thPercentile)
aws.msk.kafka.controller.ControllerStats.999thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>999thPercentile)
aws.msk.kafka.controller.ControllerStats.99thPercentile
(gauge)
Attribute exposed for management (kafka.controller<>99thPercentile)
aws.msk.kafka.controller.ControllerStats.Count
(gauge)
Attribute exposed for management (kafka.controller<>Count)
aws.msk.kafka.controller.ControllerStats.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.controller<>FifteenMinuteRate)
aws.msk.kafka.controller.ControllerStats.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.controller<>FiveMinuteRate)
aws.msk.kafka.controller.ControllerStats.Max
(gauge)
Attribute exposed for management (kafka.controller<>Max)
aws.msk.kafka.controller.ControllerStats.Mean
(gauge)
Attribute exposed for management (kafka.controller<>Mean)
aws.msk.kafka.controller.ControllerStats.MeanRate
(gauge)
Attribute exposed for management (kafka.controller<>MeanRate)
aws.msk.kafka.controller.ControllerStats.Min
(gauge)
Attribute exposed for management (kafka.controller<>Min)
aws.msk.kafka.controller.ControllerStats.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.controller<>OneMinuteRate)
aws.msk.kafka.controller.ControllerStats.StdDev
(gauge)
Attribute exposed for management (kafka.controller<>StdDev)
aws.msk.kafka.controller.KafkaController.Value
(gauge)
Attribute exposed for management (kafka.controller<>Value)
aws.msk.kafka.coordinator.group.GroupMetadataManager.Value
(gauge)
Attribute exposed for management (kafka.coordinator.group<>Value)
aws.msk.kafka.coordinator.transaction.TransactionMarkerChannelManager.Value
(gauge)
Attribute exposed for management (kafka.coordinator.transaction<>Value)
aws.msk.kafka.log.Log.Value
(gauge)
Attribute exposed for management (kafka.log<>Value)
aws.msk.kafka.log.LogCleaner.Value
(gauge)
Attribute exposed for management (kafka.log<>Value)
aws.msk.kafka.log.LogCleanerManager.Value
(gauge)
Attribute exposed for management (kafka.log<>Value)
aws.msk.kafka.log.LogManager.Value
(gauge)
Attribute exposed for management (kafka.log<>Value)
aws.msk.kafka.network.Acceptor.Count
(gauge)
Attribute exposed for management (kafka.network<>Count)
aws.msk.kafka.network.Acceptor.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.network<>FifteenMinuteRate)
aws.msk.kafka.network.Acceptor.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.network<>FiveMinuteRate)
aws.msk.kafka.network.Acceptor.MeanRate
(gauge)
Attribute exposed for management (kafka.network<>MeanRate)
aws.msk.kafka.network.Acceptor.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.network<>OneMinuteRate)
aws.msk.kafka.network.Processor.Value
(gauge)
Attribute exposed for management (kafka.network<>Value)
aws.msk.kafka.network.RequestChannel.Value
(gauge)
Attribute exposed for management (kafka.network<>Value)
aws.msk.kafka.network.RequestMetrics.50thPercentile
(gauge)
Attribute exposed for management (kafka.network<>50thPercentile)
aws.msk.kafka.network.RequestMetrics.75thPercentile
(gauge)
Attribute exposed for management (kafka.network<>75thPercentile)
aws.msk.kafka.network.RequestMetrics.95thPercentile
(gauge)
Attribute exposed for management (kafka.network<>95thPercentile)
aws.msk.kafka.network.RequestMetrics.98thPercentile
(gauge)
Attribute exposed for management (kafka.network<>98thPercentile)
aws.msk.kafka.network.RequestMetrics.999thPercentile
(gauge)
Attribute exposed for management (kafka.network<>999thPercentile)
aws.msk.kafka.network.RequestMetrics.99thPercentile
(gauge)
Attribute exposed for management (kafka.network<>99thPercentile)
aws.msk.kafka.network.RequestMetrics.Count
(gauge)
Attribute exposed for management (kafka.network<>Count)
aws.msk.kafka.network.RequestMetrics.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.network<>FifteenMinuteRate)
aws.msk.kafka.network.RequestMetrics.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.network<>FiveMinuteRate)
aws.msk.kafka.network.RequestMetrics.Max
(gauge)
Attribute exposed for management (kafka.network<>Max)
aws.msk.kafka.network.RequestMetrics.Mean
(gauge)
Attribute exposed for management (kafka.network<>Mean)
aws.msk.kafka.network.RequestMetrics.MeanRate
(gauge)
Attribute exposed for management (kafka.network<>MeanRate)
aws.msk.kafka.network.RequestMetrics.Min
(gauge)
Attribute exposed for management (kafka.network<>Min)
aws.msk.kafka.network.RequestMetrics.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.network<>OneMinuteRate)
aws.msk.kafka.network.RequestMetrics.StdDev
(gauge)
Attribute exposed for management (kafka.network<>StdDev)
aws.msk.kafka.network.SocketServer.Value
(gauge)
Attribute exposed for management (kafka.network<>Value)
aws.msk.kafka.security.SimpleAclAuthorizer.Count
(gauge)
Attribute exposed for management (kafka.security<>Count)
aws.msk.kafka.security.SimpleAclAuthorizer.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.security<>FifteenMinuteRate)
aws.msk.kafka.security.SimpleAclAuthorizer.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.security<>FiveMinuteRate)
aws.msk.kafka.security.SimpleAclAuthorizer.MeanRate
(gauge)
Attribute exposed for management (kafka.security<>MeanRate)
aws.msk.kafka.security.SimpleAclAuthorizer.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.security<>OneMinuteRate)
aws.msk.kafka.server.BrokerTopicMetrics.Count
(gauge)
Attribute exposed for management (kafka.server<>Count)
aws.msk.kafka.server.BrokerTopicMetrics.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FifteenMinuteRate)
aws.msk.kafka.server.BrokerTopicMetrics.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FiveMinuteRate)
aws.msk.kafka.server.BrokerTopicMetrics.MeanRate
(gauge)
Attribute exposed for management (kafka.server<>MeanRate)
aws.msk.kafka.server.BrokerTopicMetrics.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>OneMinuteRate)
aws.msk.kafka.server.DelayedFetchMetrics.Count
(gauge)
Attribute exposed for management (kafka.server<>Count)
aws.msk.kafka.server.DelayedFetchMetrics.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FifteenMinuteRate)
aws.msk.kafka.server.DelayedFetchMetrics.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FiveMinuteRate)
aws.msk.kafka.server.DelayedFetchMetrics.MeanRate
(gauge)
Attribute exposed for management (kafka.server<>MeanRate)
aws.msk.kafka.server.DelayedFetchMetrics.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>OneMinuteRate)
aws.msk.kafka.server.DelayedOperationPurgatory.Value
(gauge)
Attribute exposed for management (kafka.server<>Value)
aws.msk.kafka.server.Fetch.queue.size
(gauge)
Tracks the size of the delay queue (kafka.server<>queue-size)
aws.msk.kafka.server.FetchSessionCache.Count
(gauge)
Attribute exposed for management (kafka.server<>Count)
aws.msk.kafka.server.FetchSessionCache.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FifteenMinuteRate)
aws.msk.kafka.server.FetchSessionCache.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FiveMinuteRate)
aws.msk.kafka.server.FetchSessionCache.MeanRate
(gauge)
Attribute exposed for management (kafka.server<>MeanRate)
aws.msk.kafka.server.FetchSessionCache.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>OneMinuteRate)
aws.msk.kafka.server.FetchSessionCache.Value
(gauge)
Attribute exposed for management (kafka.server<>Value)
aws.msk.kafka.server.FetcherLagMetrics.Value
(gauge)
Attribute exposed for management (kafka.server<>Value)
aws.msk.kafka.server.FetcherStats.Count
(gauge)
Attribute exposed for management (kafka.server<>Count)
aws.msk.kafka.server.FetcherStats.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FifteenMinuteRate)
aws.msk.kafka.server.FetcherStats.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FiveMinuteRate)
aws.msk.kafka.server.FetcherStats.MeanRate
(gauge)
Attribute exposed for management (kafka.server<>MeanRate)
aws.msk.kafka.server.FetcherStats.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>OneMinuteRate)
aws.msk.kafka.server.KafkaRequestHandlerPool.Count
(gauge)
Attribute exposed for management (kafka.server<>Count)
aws.msk.kafka.server.KafkaRequestHandlerPool.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FifteenMinuteRate)
aws.msk.kafka.server.KafkaRequestHandlerPool.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FiveMinuteRate)
aws.msk.kafka.server.KafkaRequestHandlerPool.MeanRate
(gauge)
Attribute exposed for management (kafka.server<>MeanRate)
aws.msk.kafka.server.KafkaRequestHandlerPool.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>OneMinuteRate)
aws.msk.kafka.server.KafkaServer.Value
(gauge)
Attribute exposed for management (kafka.server<>Value)
aws.msk.kafka.server.LeaderReplication.byte.rate
(gauge)
Tracking byte-rate for LeaderReplication (kafka.server<>byte-rate)
aws.msk.kafka.server.Produce.queue.size
(gauge)
Tracks the size of the delay queue (kafka.server<>queue-size)
aws.msk.kafka.server.ReplicaAlterLogDirsManager.Value
(gauge)
Attribute exposed for management (kafka.server<>Value)
aws.msk.kafka.server.ReplicaFetcherManager.Value
(gauge)
Attribute exposed for management (kafka.server<>Value)
aws.msk.kafka.server.ReplicaManager.Count
(gauge)
Attribute exposed for management (kafka.server<>Count)
aws.msk.kafka.server.ReplicaManager.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FifteenMinuteRate)
aws.msk.kafka.server.ReplicaManager.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FiveMinuteRate)
aws.msk.kafka.server.ReplicaManager.MeanRate
(gauge)
Attribute exposed for management (kafka.server<>MeanRate)
aws.msk.kafka.server.ReplicaManager.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>OneMinuteRate)
aws.msk.kafka.server.ReplicaManager.Value
(gauge)
Attribute exposed for management (kafka.server<>Value)
aws.msk.kafka.server.Request.queue.size
(gauge)
Tracks the size of the delay queue (kafka.server<>queue-size)
aws.msk.kafka.server.SessionExpireListener.Count
(gauge)
Attribute exposed for management (kafka.server<>Count)
aws.msk.kafka.server.SessionExpireListener.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FifteenMinuteRate)
aws.msk.kafka.server.SessionExpireListener.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>FiveMinuteRate)
aws.msk.kafka.server.SessionExpireListener.MeanRate
(gauge)
Attribute exposed for management (kafka.server<>MeanRate)
aws.msk.kafka.server.SessionExpireListener.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.server<>OneMinuteRate)
aws.msk.kafka.server.ZooKeeperClientMetrics.50thPercentile
(gauge)
Attribute exposed for management (kafka.server<>50thPercentile)
aws.msk.kafka.server.ZooKeeperClientMetrics.75thPercentile
(gauge)
Attribute exposed for management (kafka.server<>75thPercentile)
aws.msk.kafka.server.ZooKeeperClientMetrics.95thPercentile
(gauge)
Attribute exposed for management (kafka.server<>95thPercentile)
aws.msk.kafka.server.ZooKeeperClientMetrics.98thPercentile
(gauge)
Attribute exposed for management (kafka.server<>98thPercentile)
aws.msk.kafka.server.ZooKeeperClientMetrics.999thPercentile
(gauge)
Attribute exposed for management (kafka.server<>999thPercentile)
aws.msk.kafka.server.ZooKeeperClientMetrics.99thPercentile
(gauge)
Attribute exposed for management (kafka.server<>99thPercentile)
aws.msk.kafka.server.ZooKeeperClientMetrics.Count
(gauge)
Attribute exposed for management (kafka.server<>Count)
aws.msk.kafka.server.ZooKeeperClientMetrics.Max
(gauge)
Attribute exposed for management (kafka.server<>Max)
aws.msk.kafka.server.ZooKeeperClientMetrics.Mean
(gauge)
Attribute exposed for management (kafka.server<>Mean)
aws.msk.kafka.server.ZooKeeperClientMetrics.Min
(gauge)
Attribute exposed for management (kafka.server<>Min)
aws.msk.kafka.server.ZooKeeperClientMetrics.StdDev
(gauge)
Attribute exposed for management (kafka.server<>StdDev)
aws.msk.kafka.server.controller.channel.metrics.connection.close.rate
(gauge)
The number of connections closed per second (kafka.server<>connection-close-rate)
Shown as connection
aws.msk.kafka.server.controller.channel.metrics.connection.close.total
(gauge)
The total number of connections closed (kafka.server<>connection-close-total)
Shown as connection
aws.msk.kafka.server.controller.channel.metrics.connection.count
(gauge)
The current number of active connections. (kafka.server<>connection-count)
Shown as connection
aws.msk.kafka.server.controller.channel.metrics.connection.creation.rate
(gauge)
The number of new connections established per second (kafka.server<>connection-creation-rate)
aws.msk.kafka.server.controller.channel.metrics.connection.creation.total
(gauge)
The total number of new connections established (kafka.server<>connection-creation-total)
aws.msk.kafka.server.controller.channel.metrics.failed.authentication.rate
(gauge)
The number of connections with failed authentication per second (kafka.server<>failed-authentication-rate)
aws.msk.kafka.server.controller.channel.metrics.failed.authentication.total
(gauge)
The total number of connections with failed authentication (kafka.server<>failed-authentication-total)
aws.msk.kafka.server.controller.channel.metrics.failed.reauthentication.rate
(gauge)
The number of failed re-authentication of connections per second (kafka.server<>failed-reauthentication-rate)
aws.msk.kafka.server.controller.channel.metrics.failed.reauthentication.total
(gauge)
The total number of failed re-authentication of connections (kafka.server<>failed-reauthentication-total)
aws.msk.kafka.server.controller.channel.metrics.incoming.byte.rate
(gauge)
The number of bytes read off all sockets per second (kafka.server<>incoming-byte-rate)
Shown as byte
aws.msk.kafka.server.controller.channel.metrics.incoming.byte.total
(gauge)
The total number of bytes read off all sockets (kafka.server<>incoming-byte-total)
Shown as byte
aws.msk.kafka.server.controller.channel.metrics.io.ratio
(gauge)
The fraction of time the I/O thread spent doing I/O (kafka.server<>io-ratio)
aws.msk.kafka.server.controller.channel.metrics.io.time.ns.avg
(gauge)
The average length of time for I/O per select call in nanoseconds. (kafka.server<>io-time-ns-avg)
aws.msk.kafka.server.controller.channel.metrics.io.wait.ratio
(gauge)
The fraction of time the I/O thread spent waiting (kafka.server<>io-wait-ratio)
aws.msk.kafka.server.controller.channel.metrics.io.wait.time.ns.avg
(gauge)
The average length of time the I/O thread spent waiting for a socket ready for reads or writes in nanoseconds. (kafka.server<>io-wait-time-ns-avg)
aws.msk.kafka.server.controller.channel.metrics.io.waittime.total
(gauge)
The total time the I/O thread spent waiting (kafka.server<>io-waittime-total)
aws.msk.kafka.server.controller.channel.metrics.iotime.total
(gauge)
The total time the I/O thread spent doing I/O (kafka.server<>iotime-total)
aws.msk.kafka.server.controller.channel.metrics.network.io.rate
(gauge)
The number of network operations (reads or writes) on all connections per second (kafka.server<>network-io-rate)
aws.msk.kafka.server.controller.channel.metrics.network.io.total
(gauge)
The total number of network operations (reads or writes) on all connections (kafka.server<>network-io-total)
aws.msk.kafka.server.controller.channel.metrics.outgoing.byte.rate
(gauge)
The number of outgoing bytes sent to all servers per second (kafka.server<>outgoing-byte-rate)
Shown as byte
aws.msk.kafka.server.controller.channel.metrics.outgoing.byte.total
(gauge)
The total number of outgoing bytes sent to all servers (kafka.server<>outgoing-byte-total)
Shown as byte
aws.msk.kafka.server.controller.channel.metrics.reauthentication.latency.avg
(gauge)
The average latency observed due to re-authentication (kafka.server<>reauthentication-latency-avg)
aws.msk.kafka.server.controller.channel.metrics.reauthentication.latency.max
(gauge)
The max latency observed due to re-authentication (kafka.server<>reauthentication-latency-max)
aws.msk.kafka.server.controller.channel.metrics.request.rate
(gauge)
The number of requests sent per second (kafka.server<>request-rate)
aws.msk.kafka.server.controller.channel.metrics.request.size.avg
(gauge)
The average size of requests sent. (kafka.server<>request-size-avg)
aws.msk.kafka.server.controller.channel.metrics.request.size.max
(gauge)
The maximum size of any request sent. (kafka.server<>request-size-max)
aws.msk.kafka.server.controller.channel.metrics.request.total
(gauge)
The total number of requests sent (kafka.server<>request-total)
aws.msk.kafka.server.controller.channel.metrics.response.rate
(gauge)
The number of responses received per second (kafka.server<>response-rate)
aws.msk.kafka.server.controller.channel.metrics.response.total
(gauge)
The total number of responses received (kafka.server<>response-total)
aws.msk.kafka.server.controller.channel.metrics.select.rate
(gauge)
The number of times the I/O layer checked for new I/O to perform per second (kafka.server<>select-rate)
aws.msk.kafka.server.controller.channel.metrics.select.total
(gauge)
The total number of times the I/O layer checked for new I/O to perform (kafka.server<>select-total)
aws.msk.kafka.server.controller.channel.metrics.successful.authentication.no.reauth.total
(gauge)
The total number of connections with successful authentication where the client does not support re-authentication (kafka.server<>successful-authentication-no-reauth-total)
aws.msk.kafka.server.controller.channel.metrics.successful.authentication.rate
(gauge)
The number of connections with successful authentication per second (kafka.server<>successful-authentication-rate)
aws.msk.kafka.server.controller.channel.metrics.successful.authentication.total
(gauge)
The total number of connections with successful authentication (kafka.server<>successful-authentication-total)
aws.msk.kafka.server.controller.channel.metrics.successful.reauthentication.rate
(gauge)
The number of successful re-authentication of connections per second (kafka.server<>successful-reauthentication-rate)
aws.msk.kafka.server.controller.channel.metrics.successful.reauthentication.total
(gauge)
The total number of successful re-authentication of connections (kafka.server<>successful-reauthentication-total)
aws.msk.kafka.server.kafka.metrics.count.count
(gauge)
total number of registered metrics (kafka.server<>count)
aws.msk.kafka.server.replica.fetcher.metrics.connection.close.rate
(gauge)
The number of connections closed per second (kafka.server<>connection-close-rate)
aws.msk.kafka.server.replica.fetcher.metrics.connection.close.total
(gauge)
The total number of connections closed (kafka.server<>connection-close-total)
aws.msk.kafka.server.replica.fetcher.metrics.connection.count
(gauge)
The current number of active connections. (kafka.server<>connection-count)
aws.msk.kafka.server.replica.fetcher.metrics.connection.creation.rate
(gauge)
The number of new connections established per second (kafka.server<>connection-creation-rate)
aws.msk.kafka.server.replica.fetcher.metrics.connection.creation.total
(gauge)
The total number of new connections established (kafka.server<>connection-creation-total)
aws.msk.kafka.server.replica.fetcher.metrics.failed.authentication.rate
(gauge)
The number of connections with failed authentication per second (kafka.server<>failed-authentication-rate)
aws.msk.kafka.server.replica.fetcher.metrics.failed.authentication.total
(gauge)
The total number of connections with failed authentication (kafka.server<>failed-authentication-total)
aws.msk.kafka.server.replica.fetcher.metrics.incoming.byte.rate
(gauge)
The number of bytes read off all sockets per second (kafka.server<>incoming-byte-rate)
Shown as byte
aws.msk.kafka.server.replica.fetcher.metrics.incoming.byte.total
(gauge)
The total number of bytes read off all sockets (kafka.server<>incoming-byte-total)
Shown as byte
aws.msk.kafka.server.replica.fetcher.metrics.io.ratio
(gauge)
The fraction of time the I/O thread spent doing I/O (kafka.server<>io-ratio)
aws.msk.kafka.server.replica.fetcher.metrics.io.time.ns.avg
(gauge)
The average length of time for I/O per select call in nanoseconds. (kafka.server<>io-time-ns-avg)
aws.msk.kafka.server.replica.fetcher.metrics.io.wait.ratio
(gauge)
The fraction of time the I/O thread spent waiting (kafka.server<>io-wait-ratio)
aws.msk.kafka.server.replica.fetcher.metrics.io.wait.time.ns.avg
(gauge)
The average length of time the I/O thread spent waiting for a socket ready for reads or writes in nanoseconds. (kafka.server<>io-wait-time-ns-avg)
aws.msk.kafka.server.replica.fetcher.metrics.io.waittime.total
(gauge)
The total time the I/O thread spent waiting (kafka.server<>io-waittime-total)
aws.msk.kafka.server.replica.fetcher.metrics.iotime.total
(gauge)
The total time the I/O thread spent doing I/O (kafka.server<>iotime-total)
aws.msk.kafka.server.replica.fetcher.metrics.network.io.rate
(gauge)
The number of network operations (reads or writes) on all connections per second (kafka.server<>network-io-rate)
aws.msk.kafka.server.replica.fetcher.metrics.network.io.total
(gauge)
The total number of network operations (reads or writes) on all connections (kafka.server<>network-io-total)
aws.msk.kafka.server.replica.fetcher.metrics.outgoing.byte.rate
(gauge)
The number of outgoing bytes sent to all servers per second (kafka.server<>outgoing-byte-rate)
Shown as byte
aws.msk.kafka.server.replica.fetcher.metrics.outgoing.byte.total
(gauge)
The total number of outgoing bytes sent to all servers (kafka.server<>outgoing-byte-total)
Shown as byte
aws.msk.kafka.server.replica.fetcher.metrics.request.rate
(gauge)
The number of requests sent per second (kafka.server<>request-rate)
aws.msk.kafka.server.replica.fetcher.metrics.request.size.avg
(gauge)
The average size of requests sent. (kafka.server<>request-size-avg)
aws.msk.kafka.server.replica.fetcher.metrics.request.size.max
(gauge)
The maximum size of any request sent. (kafka.server<>request-size-max)
aws.msk.kafka.server.replica.fetcher.metrics.request.total
(gauge)
The total number of requests sent (kafka.server<>request-total)
aws.msk.kafka.server.replica.fetcher.metrics.response.rate
(gauge)
The number of responses received per second (kafka.server<>response-rate)
aws.msk.kafka.server.replica.fetcher.metrics.response.total
(gauge)
The total number of responses received (kafka.server<>response-total)
aws.msk.kafka.server.replica.fetcher.metrics.select.rate
(gauge)
The number of times the I/O layer checked for new I/O to perform per second (kafka.server<>select-rate)
aws.msk.kafka.server.replica.fetcher.metrics.select.total
(gauge)
The total number of times the I/O layer checked for new I/O to perform (kafka.server<>select-total)
aws.msk.kafka.server.replica.fetcher.metrics.successful.authentication.rate
(gauge)
The number of connections with successful authentication per second (kafka.server<>successful-authentication-rate)
aws.msk.kafka.server.replica.fetcher.metrics.successful.authentication.total
(gauge)
The total number of connections with successful authentication (kafka.server<>successful-authentication-total)
aws.msk.kafka.server.socket.server.metrics.MemoryPoolAvgDepletedPercent
(gauge)
(kafka.server<>MemoryPoolAvgDepletedPercent)
aws.msk.kafka.server.socket.server.metrics.MemoryPoolDepletedTimeTotal
(gauge)
(kafka.server<>MemoryPoolDepletedTimeTotal)
aws.msk.kafka.server.socket.server.metrics.connection.close.rate
(gauge)
The number of connections closed per second (kafka.server<>connection-close-rate)
aws.msk.kafka.server.socket.server.metrics.connection.close.total
(gauge)
The total number of connections closed (kafka.server<>connection-close-total)
aws.msk.kafka.server.socket.server.metrics.connection.count
(gauge)
The current number of active connections. (kafka.server<>connection-count)
aws.msk.kafka.server.socket.server.metrics.connection.creation.rate
(gauge)
The number of new connections established per second (kafka.server<>connection-creation-rate)
aws.msk.kafka.server.socket.server.metrics.connection.creation.total
(gauge)
The total number of new connections established (kafka.server<>connection-creation-total)
aws.msk.kafka.server.socket.server.metrics.expired.connections.killed.count
(gauge)
(kafka.server<>expired-connections-killed-count)
aws.msk.kafka.server.socket.server.metrics.failed.authentication.rate
(gauge)
The number of connections with failed authentication per second (kafka.server<>failed-authentication-rate)
aws.msk.kafka.server.socket.server.metrics.failed.authentication.total
(gauge)
The total number of connections with failed authentication (kafka.server<>failed-authentication-total)
aws.msk.kafka.server.socket.server.metrics.failed.reauthentication.rate
(gauge)
The number of failed re-authentication of connections per second (kafka.server<>failed-reauthentication-rate)
aws.msk.kafka.server.socket.server.metrics.failed.reauthentication.total
(gauge)
The total number of failed re-authentication of connections (kafka.server<>failed-reauthentication-total)
aws.msk.kafka.server.socket.server.metrics.incoming.byte.rate
(gauge)
The number of bytes read off all sockets per second (kafka.server<>incoming-byte-rate)
aws.msk.kafka.server.socket.server.metrics.incoming.byte.total
(gauge)
The total number of bytes read off all sockets (kafka.server<>incoming-byte-total)
aws.msk.kafka.server.socket.server.metrics.io.ratio
(gauge)
The fraction of time the I/O thread spent doing I/O (kafka.server<>io-ratio)
aws.msk.kafka.server.socket.server.metrics.io.time.ns.avg
(gauge)
The average length of time for I/O per select call in nanoseconds. (kafka.server<>io-time-ns-avg)
aws.msk.kafka.server.socket.server.metrics.io.wait.ratio
(gauge)
The fraction of time the I/O thread spent waiting (kafka.server<>io-wait-ratio)
aws.msk.kafka.server.socket.server.metrics.io.wait.time.ns.avg
(gauge)
The average length of time the I/O thread spent waiting for a socket ready for reads or writes in nanoseconds. (kafka.server<>io-wait-time-ns-avg)
aws.msk.kafka.server.socket.server.metrics.io.waittime.total
(gauge)
The total time the I/O thread spent waiting (kafka.server<>io-waittime-total)
aws.msk.kafka.server.socket.server.metrics.iotime.total
(gauge)
The total time the I/O thread spent doing I/O (kafka.server<>iotime-total)
aws.msk.kafka.server.socket.server.metrics.network.io.rate
(gauge)
The number of network operations (reads or writes) on all connections per second (kafka.server<>network-io-rate)
aws.msk.kafka.server.socket.server.metrics.network.io.total
(gauge)
The total number of network operations (reads or writes) on all connections (kafka.server<>network-io-total)
aws.msk.kafka.server.socket.server.metrics.outgoing.byte.rate
(gauge)
The number of outgoing bytes sent to all servers per second (kafka.server<>outgoing-byte-rate)
aws.msk.kafka.server.socket.server.metrics.outgoing.byte.total
(gauge)
The total number of outgoing bytes sent to all servers (kafka.server<>outgoing-byte-total)
aws.msk.kafka.server.socket.server.metrics.reauthentication.latency.avg
(gauge)
The average latency observed due to re-authentication (kafka.server<>reauthentication-latency-avg)
aws.msk.kafka.server.socket.server.metrics.reauthentication.latency.max
(gauge)
The max latency observed due to re-authentication (kafka.server<>reauthentication-latency-max)
aws.msk.kafka.server.socket.server.metrics.request.rate
(gauge)
The number of requests sent per second (kafka.server<>request-rate)
aws.msk.kafka.server.socket.server.metrics.request.size.avg
(gauge)
The average size of requests sent. (kafka.server<>request-size-avg)
aws.msk.kafka.server.socket.server.metrics.request.size.max
(gauge)
The maximum size of any request sent. (kafka.server<>request-size-max)
aws.msk.kafka.server.socket.server.metrics.request.total
(gauge)
The total number of requests sent (kafka.server<>request-total)
aws.msk.kafka.server.socket.server.metrics.response.rate
(gauge)
The number of responses received per second (kafka.server<>response-rate)
aws.msk.kafka.server.socket.server.metrics.response.total
(gauge)
The total number of responses received (kafka.server<>response-total)
aws.msk.kafka.server.socket.server.metrics.select.rate
(gauge)
The number of times the I/O layer checked for new I/O to perform per second (kafka.server<>select-rate)
aws.msk.kafka.server.socket.server.metrics.select.total
(gauge)
The total number of times the I/O layer checked for new I/O to perform (kafka.server<>select-total)
aws.msk.kafka.server.socket.server.metrics.successful.authentication.no.reauth.total
(gauge)
The total number of connections with successful authentication where the client does not support re-authentication (kafka.server<>successful-authentication-no-reauth-total)
aws.msk.kafka.server.socket.server.metrics.successful.authentication.rate
(gauge)
The number of connections with successful authentication per second (kafka.server<>successful-authentication-rate)
aws.msk.kafka.server.socket.server.metrics.successful.authentication.total
(gauge)
The total number of connections with successful authentication (kafka.server<>successful-authentication-total)
aws.msk.kafka.server.socket.server.metrics.successful.reauthentication.rate
(gauge)
The number of successful re-authentication of connections per second (kafka.server<>successful-reauthentication-rate)
aws.msk.kafka.server.socket.server.metrics.successful.reauthentication.total
(gauge)
The total number of successful re-authentication of connections (kafka.server<>successful-reauthentication-total)
aws.msk.kafka.server.txn.marker.channel.metrics.connection.close.rate
(gauge)
The number of connections closed per second (kafka.server<>connection-close-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.connection.close.total
(gauge)
The total number of connections closed (kafka.server<>connection-close-total)
aws.msk.kafka.server.txn.marker.channel.metrics.connection.count
(gauge)
The current number of active connections. (kafka.server<>connection-count)
aws.msk.kafka.server.txn.marker.channel.metrics.connection.creation.rate
(gauge)
The number of new connections established per second (kafka.server<>connection-creation-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.connection.creation.total
(gauge)
The total number of new connections established (kafka.server<>connection-creation-total)
aws.msk.kafka.server.txn.marker.channel.metrics.failed.authentication.rate
(gauge)
The number of connections with failed authentication per second (kafka.server<>failed-authentication-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.failed.authentication.total
(gauge)
The total number of connections with failed authentication (kafka.server<>failed-authentication-total)
aws.msk.kafka.server.txn.marker.channel.metrics.failed.reauthentication.rate
(gauge)
The number of failed re-authentication of connections per second (kafka.server<>failed-reauthentication-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.failed.reauthentication.total
(gauge)
The total number of failed re-authentication of connections (kafka.server<>failed-reauthentication-total)
aws.msk.kafka.server.txn.marker.channel.metrics.incoming.byte.rate
(gauge)
The number of bytes read off all sockets per second (kafka.server<>incoming-byte-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.incoming.byte.total
(gauge)
The total number of bytes read off all sockets (kafka.server<>incoming-byte-total)
aws.msk.kafka.server.txn.marker.channel.metrics.io.ratio
(gauge)
The fraction of time the I/O thread spent doing I/O (kafka.server<>io-ratio)
aws.msk.kafka.server.txn.marker.channel.metrics.io.time.ns.avg
(gauge)
The average length of time for I/O per select call in nanoseconds. (kafka.server<>io-time-ns-avg)
aws.msk.kafka.server.txn.marker.channel.metrics.io.wait.ratio
(gauge)
The fraction of time the I/O thread spent waiting (kafka.server<>io-wait-ratio)
aws.msk.kafka.server.txn.marker.channel.metrics.io.wait.time.ns.avg
(gauge)
The average length of time the I/O thread spent waiting for a socket ready for reads or writes in nanoseconds. (kafka.server<>io-wait-time-ns-avg)
aws.msk.kafka.server.txn.marker.channel.metrics.io.waittime.total
(gauge)
The total time the I/O thread spent waiting (kafka.server<>io-waittime-total)
aws.msk.kafka.server.txn.marker.channel.metrics.iotime.total
(gauge)
The total time the I/O thread spent doing I/O (kafka.server<>iotime-total)
aws.msk.kafka.server.txn.marker.channel.metrics.network.io.rate
(gauge)
The number of network operations (reads or writes) on all connections per second (kafka.server<>network-io-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.network.io.total
(gauge)
The total number of network operations (reads or writes) on all connections (kafka.server<>network-io-total)
aws.msk.kafka.server.txn.marker.channel.metrics.outgoing.byte.rate
(gauge)
The number of outgoing bytes sent to all servers per second (kafka.server<>outgoing-byte-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.outgoing.byte.total
(gauge)
The total number of outgoing bytes sent to all servers (kafka.server<>outgoing-byte-total)
aws.msk.kafka.server.txn.marker.channel.metrics.reauthentication.latency.avg
(gauge)
The average latency observed due to re-authentication (kafka.server<>reauthentication-latency-avg)
aws.msk.kafka.server.txn.marker.channel.metrics.reauthentication.latency.max
(gauge)
The max latency observed due to re-authentication (kafka.server<>reauthentication-latency-max)
aws.msk.kafka.server.txn.marker.channel.metrics.request.rate
(gauge)
The number of requests sent per second (kafka.server<>request-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.request.size.avg
(gauge)
The average size of requests sent. (kafka.server<>request-size-avg)
aws.msk.kafka.server.txn.marker.channel.metrics.request.size.max
(gauge)
The maximum size of any request sent. (kafka.server<>request-size-max)
aws.msk.kafka.server.txn.marker.channel.metrics.request.total
(gauge)
The total number of requests sent (kafka.server<>request-total)
aws.msk.kafka.server.txn.marker.channel.metrics.response.rate
(gauge)
The number of responses received per second (kafka.server<>response-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.response.total
(gauge)
The total number of responses received (kafka.server<>response-total)
aws.msk.kafka.server.txn.marker.channel.metrics.select.rate
(gauge)
The number of times the I/O layer checked for new I/O to perform per second (kafka.server<>select-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.select.total
(gauge)
The total number of times the I/O layer checked for new I/O to perform (kafka.server<>select-total)
aws.msk.kafka.server.txn.marker.channel.metrics.successful.authentication.no.reauth.total
(gauge)
The total number of connections with successful authentication where the client does not support re-authentication (kafka.server<>successful-authentication-no-reauth-total)
aws.msk.kafka.server.txn.marker.channel.metrics.successful.authentication.rate
(gauge)
The number of connections with successful authentication per second (kafka.server<>successful-authentication-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.successful.authentication.total
(gauge)
The total number of connections with successful authentication (kafka.server<>successful-authentication-total)
aws.msk.kafka.server.txn.marker.channel.metrics.successful.reauthentication.rate
(gauge)
The number of successful re-authentication of connections per second (kafka.server<>successful-reauthentication-rate)
aws.msk.kafka.server.txn.marker.channel.metrics.successful.reauthentication.total
(gauge)
The total number of successful re-authentication of connections (kafka.server<>successful-reauthentication-total)
aws.msk.kafka.utils.Throttler.Count
(gauge)
Attribute exposed for management (kafka.utils<>Count)
aws.msk.kafka.utils.Throttler.FifteenMinuteRate
(gauge)
Attribute exposed for management (kafka.utils<>FifteenMinuteRate)
aws.msk.kafka.utils.Throttler.FiveMinuteRate
(gauge)
Attribute exposed for management (kafka.utils<>FiveMinuteRate)
aws.msk.kafka.utils.Throttler.MeanRate
(gauge)
Attribute exposed for management (kafka.utils<>MeanRate)
aws.msk.kafka.utils.Throttler.OneMinuteRate
(gauge)
Attribute exposed for management (kafka.utils<>OneMinuteRate)
aws.msk.node.cpu.seconds.total
(count)
Seconds the cpus spent in each mode.
aws.msk.node.exporter.build.info
(gauge)
A metric with a constant '1' value labeled by version, revision, branch, and goversion from which node_exporter was built.
aws.msk.node.filesystem.avail.bytes
(gauge)
Filesystem space available to non-root users in bytes.
Shown as byte
aws.msk.node.filesystem.device.error
(gauge)
Whether an error occurred while getting statistics for the given device.
aws.msk.node.filesystem.files
(gauge)
Filesystem total file nodes.
aws.msk.node.filesystem.files.free
(gauge)
Filesystem total free file nodes.
aws.msk.node.filesystem.free.bytes
(gauge)
Filesystem free space in bytes.
Shown as byte
aws.msk.node.filesystem.readonly
(gauge)
Filesystem read-only status.
aws.msk.node.filesystem.size.bytes
(gauge)
Filesystem size in bytes.
Shown as byte
aws.msk.node.scrape.collector.duration.seconds
(gauge)
node_exporter: Duration of a collector scrape.
Shown as second
aws.msk.node.scrape.collector.success
(gauge)
node_exporter: Whether a collector succeeded.
aws.msk.process.cpu.seconds.total
(count)
Total user and system CPU time spent in seconds.
aws.msk.process.max.fds
(gauge)
Maximum number of open file descriptors.
aws.msk.process.open.fds
(gauge)
Number of open file descriptors.
aws.msk.process.resident.memory.bytes
(gauge)
Resident memory size in bytes.
Shown as byte
aws.msk.process.start.time.seconds
(gauge)
Start time of the process since unix epoch in seconds.
Shown as second
aws.msk.process.virtual.memory.bytes
(gauge)
Virtual memory size in bytes.
Shown as byte
aws.msk.process.virtual.memory.max.bytes
(gauge)
Maximum amount of virtual memory available in bytes.
Shown as byte
aws.msk.promhttp.metric.handler.requests.in.flight
(gauge)
Current number of scrapes being served.
aws.msk.promhttp.metric.handler.requests.total
(count)
Total number of scrapes by HTTP status code.

Checks de service

aws.msk.can_connect :
Renvoie CRITICAL si l’Agent ne parvient pas à détecter les nœuds du cluster MSK. Si ce n’est pas le cas, renvoie OK.

aws.msk.prometheus.health :
Renvoie CRITICAL si le check ne parvient pas à se connecter à l’endpoint de métriques. Si ce n’est pas le cas, renvoie OK.

Événements

Le check Amazon MSK n’inclut aucun événement.

Crawler

Activez cette intégration pour visualiser dans Datadog vos métriques MSK provenant de Cloudwatch.

Configuration

Installation

Si vous ne l’avez pas déjà fait, configurez d’abord l’intégration Amazon Web Services.

Collecte de métriques

  1. Dans le carré d’intégration AWS, assurez-vous que l’option MSK est cochée dans la section concernant la collecte des métriques.

  2. Installez l’intégration Datadog/Amazon MSK.

Collecte de logs

Activer le logging

Configurez Amazon MSK de façon à ce que ses logs soient envoyés vers un compartiment S3 ou vers Cloudwatch.

Remarque : si vous envoyez vos logs vers un compartiment S3, assurez-vous que amazon_msk est défini en tant que Target prefix.

Envoyer des logs à Datadog

  1. Si vous ne l’avez pas déjà fait, configurez la fonction Lambda de collecte de logs AWS avec Datadog.
  2. Une fois la fonction Lambda installée, ajoutez manuellement un déclencheur sur le compartiment S3 ou sur le groupe de logs Cloudwatch qui contient vos logs Amazon MSK dans la console AWS :

Données collectées

aws.kafka.zookeeper_request_latency_ms_mean
(gauge)
Latence moyenne en millisecondes pour les requêtes ZooKeeper du broker.
aws.kafka.active_controller_count
(gauge)
Un seul contrôleur par cluster doit être actif à un moment donné.
aws.kafka.global_partition_count
(gauge)
Nombre total de partitions au niveau de tous les brokers dans le cluster.
aws.kafka.global_topic_count
(gauge)
Nombre total de rubriques parmi tous les brokers du cluster.
aws.kafka.offline_partitions_count
(gauge)
Nombre total de partitions hors connexion dans le cluster.
aws.kafka.swap_used
(gauge)
Taille en octets de la mémoire swap utilisée pour le broker.
Affichée en octet
aws.kafka.swap_free
(gauge)
Taille en octets de la mémoire swap disponible pour le broker.
Affichée en octet
aws.kafka.memory_used
(gauge)
Taille en octets de la mémoire utilisée pour le broker.
Affichée en octet
aws.kafka.memory_buffered
(gauge)
Taille en octets de la mémoire tampon pour le broker.
Affichée en octet
aws.kafka.memory_free
(gauge)
Taille en octets de la mémoire libre et disponible pour le broker.
Affichée en octet
aws.kafka.memory_cached
(gauge)
Taille en octets de la mémoire cache pour le broker.
Affichée en octet
aws.kafka.cpu_user
(gauge)
Pourcentage de CPU dans l'espace utilisateur.
Affiché en pourcentage
aws.kafka.cpu_system
(gauge)
Pourcentage de CPU dans l'espace du noyau.
Affiché en pourcentage
aws.kafka.cpu_idle
(gauge)
Pourcentage de temps d'inactivité du processeur.
Affiché en pourcentage
aws.kafka.root_disk_used
(gauge)
Pourcentage du disque racine utilisé par le broker.
Affiché en pourcentage
aws.kafka.kafka_app_logs_disk_used
(gauge)
Pourcentage d'espace disque utilisé pour les logs d'application.
Affiché en pourcentage
aws.kafka.kafka_data_logs_disk_used
(gauge)
Pourcentage d'espace disque utilisé pour les logs de données.
Affiché en pourcentage
aws.kafka.network_rx_errors
(count)
Nombre d'erreurs de réception réseau pour le broker.
aws.kafka.network_tx_errors
(count)
Nombre d'erreurs de transmission réseau pour le broker.
aws.kafka.network_rx_dropped
(count)
Nombre de paquets de réception perdus.
aws.kafka.network_tx_dropped
(count)
Nombre de paquets de transmission perdus.
aws.kafka.network_rx_packets
(count)
Nombre de paquets reçus par le broker.
aws.kafka.network_tx_packets
(count)
Nombre de paquets transmis par le broker.
aws.kafka.messages_in_per_sec
(gauge)
Nombre de messages entrants par seconde pour le broker.
aws.kafka.network_processor_avg_idle_percent
(gauge)
Pourcentage moyen de temps pendant lequel les processeurs réseau sont inactifs.
aws.kafka.request_handler_avg_idle_percent
(gauge)
Pourcentage moyen de temps pendant lequel les threads du gestionnaire de requêtes sont inactifs.
aws.kafka.leader_count
(gauge)
Nombre de réplicas leader.
aws.kafka.partition_count
(gauge)
Nombre de partitions pour le broker.
aws.kafka.produce_local_time_ms_mean
(gauge)
Temps moyen, en millisecondes, d'envoi d'une réponse par le suiveur.
Affiché en milliseconde
aws.kafka.produce_message_conversions_time_ms_mean
(gauge)
Temps moyen, en millisecondes, consacré aux conversions de format de message.
Affiché en milliseconde
aws.kafka.produce_request_queue_time_ms_mean
(gauge)
Temps moyen, en millisecondes, que les messages de requête passent dans la file d'attente.
Affiché en milliseconde
aws.kafka.produce_response_queue_time_ms_mean
(gauge)
Temps moyen, en millisecondes, que les messages de réponse passent dans la file d'attente.
Affiché en milliseconde
aws.kafka.produce_response_send_time_ms_mean
(gauge)
Temps moyen, en millisecondes, consacré à l'envoi de messages de réponse.
Affiché en milliseconde
aws.kafka.produce_total_time_ms_mean
(gauge)
Temps moyen de production en millisecondes.
Affiché en milliseconde
aws.kafka.request_bytes_mean
(gauge)
Nombre moyen d'octets de requêtes pour le broker.
aws.kafka.under_minlsr_partition_count
(gauge)
Nombre de partitions sous minlsr pour le broker
aws.kafka.under_replicated_partitions
(gauge)
Nombre de partitions sous-répliquées pour le broker.
aws.kafka.bytes_in_per_sec
(gauge)
Nombre d'octets reçus des clients par seconde.
Affiché en octet
aws.kafka.bytes_out_per_sec
(gauge)
Nombre d'octets envoyés aux clients par seconde.
Affiché en octet
aws.kafka.messages_in_per_sec
(gauge)
Nombre de messages reçus des clients par seconde.
aws.kafka.fetch_message_conversions_per_sec
(gauge)
Nombre de messages récupérés convertis par seconde pour le broker.
aws.kafka.produce_message_conversions_per_sec
(gauge)
Nombre de message de production convertis par seconde pour le broker.
aws.kafka.fetch_consumer_total_time_ms_mean
(gauge)
Temps total moyen, en millisecondes, que les consommateurs consacrent à l'extraction des données du broker.
Affiché en milliseconde
aws.kafka.fetch_follower_total_time_ms_mean
(gauge)
Temps total moyen, en millisecondes, consacré par les suiveurs à la récupération des données du broker.
Affiché en milliseconde
aws.kafka.fetch_consumer_request_queue_time_ms_mean
(gauge)
Temps moyen, en millisecondes, pendant lequel les requêtes des consommateurs attendent dans la file d'attente des requêtes.
Affiché en milliseconde
aws.kafka.fetch_follower_request_queue_time_ms_mean
(gauge)
Temps moyen, en millisecondes, pendant lequel les requêtes des suiveurs attendent dans la file d'attente des requêtes.
Affiché en milliseconde
aws.kafka.fetch_consumer_local_time_ms_mean
(gauge)
Temps moyen, en millisecondes, pendant lequel la requête du consommateur est traitée au niveau du leader.
Affiché en milliseconde
aws.kafka.fetch_follower_local_time_ms_mean
(gauge)
Temps moyen, en millisecondes, pendant lequel la requête du suiveur est traitée au niveau du leader.
Affiché en milliseconde
aws.kafka.fetch_consumer_response_queue_time_ms_mean
(gauge)
Temps moyen, en millisecondes, pendant lequel la requête du consommateur attend dans la file d'attente de réponses.
Affiché en milliseconde
aws.kafka.fetch_follower_response_queue_time_ms_mean
(gauge)
Temps moyen, en millisecondes, pendant lequel la requête du suiveur attend dans la file d'attente de réponses.
Affiché en milliseconde
aws.kafka.consumer_response_send_time_ms_mean
(gauge)
Temps moyen, en millisecondes, d'envoi d'une réponse par le consommateur.
Affiché en milliseconde
aws.kafka.fetch_follower_response_send_time_ms_mean
(gauge)
Temps moyen, en millisecondes, d'envoi d'une réponse par le suiveur.
Affiché en milliseconde
aws.kafka.produce_throttle_time
(gauge)
Temps moyen de limitation de production en millisecondes.
Affiché en milliseconde
aws.kafka.produce_throttle_byte_rate
(gauge)
Nombre d'octets limités par seconde.
aws.kafka.produce_throttle_queue_size
(gauge)
Nombre de messages dans la file d'attente des limites.
aws.kafka.fetch_throttle_time
(gauge)
Temps moyen de limitation de récupération en millisecondes.
Affiché en milliseconde
aws.kafka.fetch_throttle_byte_rate
(gauge)
Nombre d'octets limités par seconde.
aws.kafka.fetch_throttle_queue_size
(gauge)
Nombre de messages dans la file d'attente des limites.
aws.kafka.request_throttle_time
(gauge)
Temps moyen de limitation de requête en millisecondes.
Affiché en milliseconde
aws.kafka.request_time
(gauge)
Temps moyen passé dans le réseau de courtage et les threads d'E/S pour traiter les requêtes.
aws.kafka.request_throttle_queue_size
(gauge)
Nombre de messages dans la file d'attente des limites.
aws.kafka.request_exempt_from_throttle_time
(gauge)
Temps moyen passé dans le réseau de courtage et les threads d'E/S pour traiter les requêtes exemptées de la limitation.

Le crawler Amazon MSK n’inclut aucun événement ni aucun check de service.

Dépannage

Besoin d’aide ? Contactez l’assistance Datadog.