---
title: Azure HD Insight
description: Track key Azure HDInsight metrics.
breadcrumbs: Docs > Integrations > Azure HD Insight
---

> For the complete documentation index, see [llms.txt](https://docs.datadoghq.com/llms.txt).

# Azure HD Insight

{% callout %}
# Important note for users on the following Datadog sites: us2.ddog-gov.com

{% alert level="info" %}
To find out if this integration is available in your organization, see your [Datadog Integrations](https://app.datadoghq.com/integrations) page or ask your organization administrator.

To initiate an exception request to enable this integration for your organization, email [support@ddog-gov.com](mailto:support@ddog-gov.com).
{% /alert %}

{% /callout %}

## Overview{% #overview %}

[Azure HDInsight](https://learn.microsoft.com/azure/hdinsight/hdinsight-overview) is a managed cloud service for running open source analytics frameworks, such as Apache Spark, Apache Hive, Apache Kafka, and Apache Hadoop.

Use the Datadog Azure integration to collect metrics from Azure HDInsight.

## Setup{% #setup %}

### Installation{% #installation %}

If you haven't already, set up the [Microsoft Azure integration](https://docs.datadoghq.com/integrations/azure.md) first. There are no other installation steps.

## Data Collected{% #data-collected %}

### Metrics{% #metrics %}

|  |
|  |
| **azure.hdinsight_clusters.categorized_gateway_requests**(count)                                     | The number of gateway requests by categories: (1xx/2xx/3xx/4xx/5xx)*Shown as request*       |
| **azure.hdinsight_clusters.count**(gauge)                                                              | The count of Azure HDInsight clusters                                                       |
| **azure.hdinsight_clusters.gateway_requests**(count)                                                  | The number of gateway requests*Shown as request*                                            |
| **azure.hdinsight_clusters.kafka_rest_proxy.consumer_request.m1_delta**(count)                     | Number of consumer requests to the Kafka REST proxy per second.*Shown as request*           |
| **azure.hdinsight_clusters.kafka_rest_proxy.consumer_request_fail.m1_delta**(count)               | Number of consumer request exceptions in the Kafka REST proxy per second.*Shown as request* |
| **azure.hdinsight_clusters.kafka_rest_proxy.consumer_request_time.p95**(gauge)                     | Message latency in a consumer request through the Kafka REST proxy.*Shown as millisecond*   |
| **azure.hdinsight_clusters.kafka_rest_proxy.consumer_request_waiting_in_queue_time.p95**(gauge) | Time a consumer request waits in the Kafka REST proxy queue.*Shown as millisecond*          |
| **azure.hdinsight_clusters.kafka_rest_proxy.messages_in.m1_delta**(count)                          | Number of producer messages through the Kafka REST proxy per second.*Shown as message*      |
| **azure.hdinsight_clusters.kafka_rest_proxy.messages_out.m1_delta**(count)                         | Number of consumer messages through the Kafka REST proxy per second.*Shown as message*      |
| **azure.hdinsight_clusters.kafka_rest_proxy.open_connections**(count)                               | Number of concurrent connections through the Kafka REST proxy.                              |
| **azure.hdinsight_clusters.kafka_rest_proxy.producer_request.m1_delta**(count)                     | Number of producer requests to the Kafka REST proxy per second.*Shown as request*           |
| **azure.hdinsight_clusters.kafka_rest_proxy.producer_request_fail.m1_delta**(count)               | Number of producer request exceptions in the Kafka REST proxy per second.*Shown as request* |
| **azure.hdinsight_clusters.kafka_rest_proxy.producer_request_time.p95**(gauge)                     | Message latency in a producer request through the Kafka REST proxy.*Shown as millisecond*   |
| **azure.hdinsight_clusters.kafka_rest_proxy.producer_request_waiting_in_queue_time.p95**(gauge) | Time a producer request waits in the Kafka REST proxy queue.*Shown as millisecond*          |
| **azure.hdinsight_clusters.num_active_workers**(gauge)                                               | Number of active workers.*Shown as worker*                                                  |
| **azure.hdinsight_clusters.pending_cpu**(gauge)                                                       | Number of pending CPU requests in YARN.                                                     |
| **azure.hdinsight_clusters.pending_memory**(gauge)                                                    | Number of pending memory requests in YARN.                                                  |

### Events{% #events %}

The Azure HDInsight integration does not include any events.

### Service Checks{% #service-checks %}

The Azure HDInsight integration does not include any service checks.

## Troubleshooting{% #troubleshooting %}

Need help? Contact [Datadog support](https://docs.datadoghq.com/help/).