Microsoft Azure Data Explorer

Crawler

Overview

Azure Data Explorer is a highly scalable and secure analytics service that enables you to do rich exploration of structured and unstructured data for instant insights. Optimized for ad-hoc queries, Azure Data Explorer enables data exploration over raw, structured, and semi-structured data delivering fast time to insight. Use Datadog to monitor your Azure Data Explorer performance and utilization in context with the rest of your applications and infrastructure.

Get metrics from Azure Data Explorer to:

Track ingestion, processing, and latency performance of your Data Explorer instances.
Monitor the utilization of your Data Explorer compute, memory, and network resources.

Setup

Installation

If you haven’t already, set up the Microsoft Azure integration first. There are no other installation steps.

Data Collected

Metrics

azure.kusto_clusters.ingestion_utilization (gauge)	The ratio of used ingestion slots in the cluster. Shown as percent
azure.kusto_clusters.keep_alive (gauge)	A sanity check that indicates the cluster responds to queries.
azure.kusto_clusters.ingestion_volume_in_mb (gauge)	The overall volume of ingested data to the cluster (in MB).
azure.kusto_clusters.ingestion_latency_in_seconds (gauge)	The ingestion time from the source to the cluster. Shown as second
azure.kusto_clusters.events_processed_for_eventiot_hubs (gauge)	The number of events processed by the cluster when ingesting from Event/IoT Hub. Shown as event
azure.kusto_clusters.ingestion_result (gauge)	The number of ingestion operations. Shown as operation
azure.kusto_clusters.cpu (gauge)	The CPU utilization level. Shown as percent
azure.kusto_clusters.continuous_export_num_of_exported_records (gauge)	The number of records exported, fired for every storage artifact written during the export operation. Shown as record
azure.kusto_clusters.export_utilization (gauge)	The export utilization. Shown as percent
azure.kusto_clusters.continuous_export_pending_count (gauge)	The number of pending continuous export jobs ready for execution. Shown as job
azure.kusto_clusters.continuous_export_max_lateness_minutes (gauge)	The max lateness in minutes of all continuous exports pending and ready for execution. Shown as minute
azure.kusto_clusters.continuous_export_result (gauge)	Indicates whether continuous export succeeded or failed.
azure.kusto_clusters.streaming_ingest_duration (gauge)	The streaming ingest duration in milliseconds. Shown as millisecond
azure.kusto_clusters.streaming_ingest_data_rate (rate)	The streaming ingest data rate (MB per second).
azure.kusto_clusters.streaming_ingest_request_rate (rate)	The streaming ingest request rate (requests per second). Shown as request
azure.kusto_clusters.streaming_ingest_result (gauge)	The streaming ingest result
azure.kusto_clusters.total_number_of_concurrent_queries (gauge)	The total number of concurrent queries. Shown as query
azure.kusto_clusters.total_number_of_throttled_queries (gauge)	The total number of throttled queries. Shown as query
azure.kusto_clusters.total_number_of_throttled_commands (gauge)	The total number of throttled commands. Shown as command
azure.kusto_clusters.total_number_of_extents (gauge)	The total number of data extents.

Events

The Azure Data Explorer integration does not include any events.

Service Checks

The Azure Data Explorer integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.