---
title: Alibaba Cloud Kafka
description: >-
  Monitor Alibaba Cloud Message Queue for Apache Kafka throughput, disk usage,
  consumer group lag, and connection metrics.
breadcrumbs: Docs > Integrations > Alibaba Cloud Kafka
---

# Alibaba Cloud Kafka
Integration version1.0.0
{% callout %}
# Important note for users on the following Datadog sites: us2.ddog-gov.com

{% alert level="info" %}
To find out if this integration is available in your organization, see your [Datadog Integrations](https://app.datadoghq.com/integrations) page or ask your organization administrator.

To initiate an exception request to enable this integration for your organization, email [support@ddog-gov.com](mailto:support@ddog-gov.com).
{% /alert %}

{% /callout %}

## Overview{% #overview %}

Alibaba Cloud Message Queue for Apache Kafka is a fully managed, high-throughput distributed messaging service compatible with the Apache Kafka ecosystem. It is used for real-time data pipelines, log collection, and stream processing.

Use this integration to monitor instance throughput, disk usage, consumer group lag, and connection metrics.

## Setup{% #setup %}

### Installation{% #installation %}

After you set up the [Alibaba Cloud](https://docs.datadoghq.com/integrations/alibaba_cloud.md) integration, ensure that the Kafka service is included in your Alibaba Cloud monitoring configuration.

## Data Collected{% #data-collected %}

### Metrics{% #metrics %}

|  |
|  |
| **alibabacloud.kafka.cluster\_message\_input\_v3**(rate)                             | Input byte for V3 clusters.*Shown as byte*                                             |
| **alibabacloud.kafka.disk\_instance\_ratio\_v3**(gauge)                              | Disk Usage by Instance.*Shown as percent*                                              |
| **alibabacloud.kafka.group\_message\_num\_output\_onetopic\_onepartition\_v3**(rate) | Number of messages per topic per partition.*Shown as message*                          |
| **alibabacloud.kafka.group\_message\_num\_output\_onetopic\_v3**(rate)               | Number of messages per topic.*Shown as message*                                        |
| **alibabacloud.kafka.group\_message\_num\_output\_v3**(rate)                         | Number of messages.*Shown as message*                                                  |
| **alibabacloud.kafka.instance\_batch\_size\_tp50v2**(gauge)                          | Instance Batch Size TP50.*Shown as byte*                                               |
| **alibabacloud.kafka.instance\_batch\_size\_tp999v2**(gauge)                         | Instance Batch Size TP999.*Shown as byte*                                              |
| **alibabacloud.kafka.instance\_cpu\_usage\_v2**(gauge)                               | Instance CPU Utilization.*Shown as percent*                                            |
| **alibabacloud.kafka.instance\_disk\_log\_size\_v3**(gauge)                          | Instance Disk log size.*Shown as byte*                                                 |
| **alibabacloud.kafka.instance\_internet\_rx\_rate\_v3**(rate)                        | Instance inbound internet traffic.*Shown as byte*                                      |
| **alibabacloud.kafka.instance\_internet\_tx\_rate\_v3**(rate)                        | Instance outbound internet traffic.*Shown as byte*                                     |
| **alibabacloud.kafka.instance\_max\_connection\_ratio\_v3**(gauge)                   | Usage of Maximum Connections per Node (Internet + Internal Network).*Shown as percent* |
| **alibabacloud.kafka.instance\_max\_connection\_v3**(gauge)                          | Instance max connections.*Shown as instance*                                           |
| **alibabacloud.kafka.instance\_max\_internet\_connection\_ratio\_v3**(gauge)         | Usage of Maximum Connections per Node (Internet).*Shown as percent*                    |
| **alibabacloud.kafka.instance\_max\_internet\_connection\_v3**(gauge)                | Instance max internet connections.*Shown as instance*                                  |
| **alibabacloud.kafka.instance\_max\_node\_input\_ratio\_v3**(gauge)                  | Instance Max Node Input Ratio.*Shown as percent*                                       |
| **alibabacloud.kafka.instance\_max\_node\_output\_ratio\_v3**(gauge)                 | Instance Max Node Output Ratio.*Shown as percent*                                      |
| **alibabacloud.kafka.instance\_message\_input\_ratio\_v3**(gauge)                    | Instance message input ratio.*Shown as percent*                                        |
| **alibabacloud.kafka.instance\_message\_input\_v3**(rate)                            | Instance message input.*Shown as byte*                                                 |
| **alibabacloud.kafka.instance\_message\_num\_input\_v3**(rate)                       | Instance message number input.*Shown as message*                                       |
| **alibabacloud.kafka.instance\_message\_num\_output\_v3**(rate)                      | Instance message number output.*Shown as message*                                      |
| **alibabacloud.kafka.instance\_message\_output\_ratio\_v3**(gauge)                   | Instance message output ratio.*Shown as percent*                                       |
| **alibabacloud.kafka.instance\_message\_output\_v3**(rate)                           | Instance message output.*Shown as byte*                                                |
| **alibabacloud.kafka.instance\_reqs\_input\_v3**(rate)                               | Instance request input rate.*Shown as instance*                                        |
| **alibabacloud.kafka.instance\_reqs\_output\_v3**(rate)                              | Instance request output rate.*Shown as instance*                                       |
| **alibabacloud.kafka.instance\_throttle\_time\_p99\_input\_v3**(gauge)               | Instance throttle p99 input.*Shown as millisecond*                                     |
| **alibabacloud.kafka.instance\_throttle\_time\_p99\_output\_v3**(gauge)              | Instance throttle p99 output.*Shown as millisecond*                                    |
| **alibabacloud.kafka.instance\_total\_connection\_v3**(gauge)                        | Instance total connections.*Shown as connection*                                       |
| **alibabacloud.kafka.instance\_total\_internet\_connection\_V3**(gauge)              | Instance total internet connections.*Shown as connection*                              |
| **alibabacloud.kafka.message\_accumulation\_onetopic\_v3**(gauge)                    | Message accumulation per topic.*Shown as message*                                      |
| **alibabacloud.kafka.message\_accumulation\_v3**(gauge)                              | Message accumulation.*Shown as message*                                                |
| **alibabacloud.kafka.partition\_instance\_ratio\_v3**(gauge)                         | Partition Usage by Instance*Shown as percent*                                          |
| **alibabacloud.kafka.topic\_abnormal\_ha\_partition\_v3**(gauge)                     | Topic abnormal ha partition number.*Shown as instance*                                 |
| **alibabacloud.kafka.topic\_message\_input\_v3**(rate)                               | Topic message input.*Shown as byte*                                                    |
| **alibabacloud.kafka.topic\_message\_num\_input\_v3**(rate)                          | Topic message input number.*Shown as message*                                          |
| **alibabacloud.kafka.topic\_message\_num\_output\_v3**(rate)                         | Topic message output number.*Shown as message*                                         |
| **alibabacloud.kafka.topic\_message\_output\_input\_ratio\_v3**(gauge)               | Topic message input/output ratio.*Shown as percent*                                    |
| **alibabacloud.kafka.topic\_message\_output\_v3**(rate)                              | Topic message output.*Shown as byte*                                                   |
| **alibabacloud.kafka.topic\_normal\_ha\_partition\_num\_v3**(gauge)                  | Topic normal ha partition number.*Shown as instance*                                   |
| **alibabacloud.kafka.topic\_reqs\_input\_v3**(rate)                                  | Topic requests input.*Shown as instance*                                               |
| **alibabacloud.kafka.topic\_reqs\_output\_v3**(rate)                                 | Topic requests output.*Shown as instance*                                              |
| **alibabacloud.kafka.instance\_fetch\_throttle\_queue\_size\_v2**(gauge)             | Throttled Consumption Requests of Instance.*Shown as instance*                         |
| **alibabacloud.kafka.instance\_ha\_event\_v2**(gauge)                                | Instance HA Event.*Shown as instance*                                                  |
| **alibabacloud.kafka.instance\_internet\_rx\_rate\_by\_node**(rate)                  | Instance inbound traffic per node.*Shown as byte*                                      |
| **alibabacloud.kafka.instance\_internet\_rx\_utilization\_by\_node**(gauge)          | Instance inbound traffic utilization per node.*Shown as percent*                       |
| **alibabacloud.kafka.instance\_internet\_tx\_rate\_by\_node**(rate)                  | Instance outbound traffic per node.*Shown as byte*                                     |
| **alibabacloud.kafka.instance\_internet\_tx\_utilization\_by\_node**(gauge)          | Instance outbound traffic utilization per node.*Shown as percent*                      |
| **alibabacloud.kafka.instance\_max\_connection**(gauge)                              | Instance max connections.*Shown as connection*                                         |
| **alibabacloud.kafka.instance\_max\_internet\_connection**(gauge)                    | Instance max internet connections.*Shown as connection*                                |
| **alibabacloud.kafka.instance\_max\_read\_iops\_v2**(gauge)                          | Maximum Read IOPS per Node.*Shown as operation*                                        |
| **alibabacloud.kafka.instance\_max\_write\_iops\_v2**(gauge)                         | Maximum Write IOPS per Node.*Shown as operation*                                       |
| **alibabacloud.kafka.instance\_message\_input\_ratio\_v2**(gauge)                    | Instance message input ratio.*Shown as percent*                                        |
| **alibabacloud.kafka.instance\_message\_output\_ratio\_v2**(gauge)                   | Instance message output ratio.*Shown as percent*                                       |
| **alibabacloud.kafka.instance\_produce\_throttle\_queue\_size\_v2**(gauge)           | Throttled Sending Requests of Instance.*Shown as instance*                             |
| **alibabacloud.kafka.instance\_rebalance\_time\_v2**(gauge)                          | Maximum Rebalance Time of Instance.*Shown as millisecond*                              |
| **alibabacloud.kafka.instance\_total\_connection**(gauge)                            | Instance total connections.*Shown as connection*                                       |
| **alibabacloud.kafka.instance\_total\_internet\_connection**(gauge)                  | Instance total internet connections.*Shown as connection*                              |
| **alibabacloud.kafka.partition\_instance\_ratio\_v2**(gauge)                         | Partition instance ratio.*Shown as percent*                                            |
| **alibabacloud.kafka.cluster\_message\_input**(rate)                                 | (Deprecated) Cluster message input rate.*Shown as byte*                                |
| **alibabacloud.kafka.group\_message\_num\_output**(rate)                             | Message number output.*Shown as message*                                               |
| **alibabacloud.kafka.group\_message\_num\_output\_onetopic**(rate)                   | Message number output per topic.*Shown as message*                                     |
| **alibabacloud.kafka.group\_message\_num\_output\_onetopic\_onepartition**(rate)     | (Deprecated) Message number output per topic per partition.*Shown as message*          |
| **alibabacloud.kafka.group\_topic\_accumulation\_consume\_cost\_time**(gauge)        | Estimated Time to Clear Topic Backlog for Consumer Group.*Shown as second*             |
| **alibabacloud.kafka.instance\_disk\_capacity.maximum**(gauge)                       | Instance disk capacity.*Shown as percent*                                              |
| **alibabacloud.kafka.instance\_disk\_log\_size.maximum**(gauge)                      | Instance disk log size.*Shown as byte*                                                 |
| **alibabacloud.kafka.instance\_internet\_rx.rate**(rate)                             | Instance internet inbound traffic.*Shown as bit*                                       |
| **alibabacloud.kafka.instance\_internet\_rxrate**(rate)                              | (Deprecated) Instance internet inbound traffic rate.*Shown as bit*                     |
| **alibabacloud.kafka.instance\_internet\_tx.rate**(rate)                             | Instance internet outbound traffic.*Shown as bit*                                      |
| **alibabacloud.kafka.instance\_internet\_txrate**(rate)                              | (Deprecated) Instance internet outbound traffic rate.*Shown as bit*                    |
| **alibabacloud.kafka.instance\_message\_input**(rate)                                | Instance message input.*Shown as byte*                                                 |
| **alibabacloud.kafka.instance\_message\_num\_input**(rate)                           | Instance message number input.*Shown as message*                                       |
| **alibabacloud.kafka.instance\_message\_num\_output**(rate)                          | Instance message number output.*Shown as message*                                      |
| **alibabacloud.kafka.instance\_message\_output**(rate)                               | Instance message output.*Shown as byte*                                                |
| **alibabacloud.kafka.instance\_reqs\_input**(rate)                                   | Instance requests input.*Shown as instance*                                            |
| **alibabacloud.kafka.instance\_reqs\_output**(rate)                                  | Instance requests output.*Shown as instance*                                           |
| **alibabacloud.kafka.message\_accumulation**(gauge)                                  | Message accumulation.*Shown as message*                                                |
| **alibabacloud.kafka.message\_accumulation\_onetopic**(gauge)                        | Message accumulation per topic.*Shown as message*                                      |
| **alibabacloud.kafka.topic\_message\_input**(rate)                                   | Topic message input.*Shown as byte*                                                    |
| **alibabacloud.kafka.topic\_message\_num\_input**(rate)                              | Topic message number input.*Shown as message*                                          |
| **alibabacloud.kafka.topic\_message\_num\_output**(rate)                             | Topic message number output.*Shown as message*                                         |
| **alibabacloud.kafka.topic\_message\_output**(rate)                                  | Topic message output.*Shown as byte*                                                   |
| **alibabacloud.kafka.topic\_message\_output\_input\_ratio**(gauge)                   | Topic message output/input ratio.*Shown as percent*                                    |
| **alibabacloud.kafka.topic\_reqs\_input**(rate)                                      | Topic requests input.*Shown as instance*                                               |
| **alibabacloud.kafka.topic\_reqs\_output**(rate)                                     | Topic requests output.*Shown as instance*                                              |

### Events{% #events %}

Alibaba Cloud Kafka does not include any events.

### Service Checks{% #service-checks %}

Alibaba Cloud Kafka does not include any service checks.

## Troubleshooting{% #troubleshooting %}

Need help? Contact [Datadog support](https://docs.datadoghq.com/help/).