Microsoft Azure HDInsight

Crawler Crawler

Overview

Azure HDInsight is a cloud service that makes it easy, fast, and cost-effective to process massive amounts of data.

Use the Datadog Azure integration to collect metrics from Azure HDInsight.

Setup

Installation

If you haven’t already, set up the Microsoft Azure integration first. There are no other installation steps.

Data Collected

Metrics

azure.hdinsight_clusters.categorized_gateway_requests
(count)
The number of gateway requests by categories: (1xx/2xx/3xx/4xx/5xx)
Shown as request
azure.hdinsight_clusters.count
(gauge)
The count of Azure HDInsight clusters
azure.hdinsight_clusters.gateway_requests
(count)
The number of gateway requests
Shown as request
azure.hdinsight_clusters.kafka_rest_proxy.consumer_request.m1_delta
(count)
The number of consumer requests to kafka REST proxy
azure.hdinsight_clusters.kafka_rest_proxy.consumer_request_fail.m1_delta
(count)
Consumer request exceptions
azure.hdinsight_clusters.kafka_rest_proxy.consumer_request_time.p95
(gauge)
Message latency in a consumer request through kafka REST proxy
Shown as millisecond
azure.hdinsight_clusters.kafka_rest_proxy.consumer_request_waiting_in_queue_time.p95
(gauge)
Consumer REST proxy queue length
Shown as millisecond
azure.hdinsight_clusters.kafka_rest_proxy.messages_in.m1_delta
(count)
The number of producer messages through kafka REST proxy
azure.hdinsight_clusters.kafka_rest_proxy.messages_out.m1_delta
(count)
The number of consumer messages through kafka REST proxy
azure.hdinsight_clusters.kafka_rest_proxy.open_connections
(count)
The number of concurrent connections through kafka REST proxy
azure.hdinsight_clusters.kafka_rest_proxy.producer_request.m1_delta
(count)
The number of producer requests to kafka REST proxy
azure.hdinsight_clusters.kafka_rest_proxy.producer_request_fail.m1_delta
(count)
The number of producer request exceptions
azure.hdinsight_clusters.kafka_rest_proxy.producer_request_time.p95
(gauge)
Message latency in a producer request through kafka REST proxy
Shown as millisecond
azure.hdinsight_clusters.kafka_rest_proxy.producer_request_waiting_in_queue_time.p95
(gauge)
Producer REST proxy queue length
Shown as millisecond
azure.hdinsight_clusters.num_active_workers
(gauge)
The number of active workers
azure.hdinsight_clusters.pending_cpu
(gauge)
Pending CPU requests in yarn
azure.hdinsight_clusters.pending_memory
(gauge)
Pending memory requests in yarn
azure.hdinsight_clusters.status
(gauge)
The status of Azure HDInsight clusters (deprecated)

Events

The Azure HDInsight integration does not include any events.

Service Checks

The Azure HDInsight integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.