Microsoft Azure Data Factory

Microsoft Azure Data Factory

Crawler Crawler

Overview

Azure Data Factory is a cloud data integration service, to compose data storage, movement, and processing services into automated data pipelines.

Use the Datadog Azure integration to collect metrics from Data Factory.

Setup

Installation

If you haven’t already, set up the Microsoft Azure integration first. There are no other installation steps.

Data Collected

Metrics

azure.datafactory_datafactories.count
(gauge)
The count of datafactories
azure.datafactory_datafactories.failed_runs
(count)
The number of failed runs
azure.datafactory_datafactories.successful_runs
(count)
The number of successful runs
azure.datafactory_datafactories.status
(gauge)
The status of datafactories
azure.datafactory_factories.activity_cancelled_runs
(count)
The count of cancelled activity runs
azure.datafactory_factories.activity_failed_runs
(count)
The count of failed activity runs
azure.datafactory_factories.activity_succeeded_runs
(count)
The count of succeeded activity runs metrics
azure.datafactory_factories.count
(gauge)
The count of data factories
azure.datafactory_factories.factory_size_in_gb_units
(gauge)
The total factory size (GB unit)
Shown as gibibyte
azure.datafactory_factories.integration_runtime_available_memory
(gauge)
Integration runtime available memory
Shown as byte
azure.datafactory_factories.integration_runtime_available_node_number
(gauge)
Integration runtime available node count
azure.datafactory_factories.integration_runtime_average_task_pickup_delay
(gauge)
Integration runtime queue duration
Shown as second
azure.datafactory_factories.integration_runtime_cpu_percentage
(gauge)
Integration runtime CPU utilization
Shown as percent
azure.datafactory_factories.integration_runtime_queue_length
(gauge)
Integration runtime queue length
azure.datafactory_factories.max_allowed_factory_size_in_gb_units
(gauge)
The maximum allowed factory size (GB unit)
Shown as gibibyte
azure.datafactory_factories.max_allowed_resource_count
(gauge)
The maximum allowed entities
azure.datafactory_factories.pipeline_cancelled_runs
(count)
The number of cancelled pipeline runs
azure.datafactory_factories.pipeline_elapsed_time_runs
(count)
The number of elapsed time pipeline runs
azure.datafactory_factories.pipeline_failed_runs
(count)
The number of failed pipeline runs
azure.datafactory_factories.pipeline_succeeded_runs
(count)
The number of succeeded pipeline runs metrics
azure.datafactory_factories.resource_count
(gauge)
Total entities count
azure.datafactory_factories.ssis_integration_runtime_start_cancel
(count)
The number of cancelled SSIS integration runtime starts
azure.datafactory_factories.ssis_integration_runtime_start_failed
(count)
The number of failed SSIS integration runtime starts
azure.datafactory_factories.ssis_integration_runtime_start_succeeded
(count)
The number of succeeded SSIS integration runtime starts
azure.datafactory_factories.ssis_integration_runtime_stop_stuck
(count)
The number of stuck SSIS integration runtime stops
azure.datafactory_factories.ssis_integration_runtime_stop_succeeded
(count)
Succeeded SSIS integration runtime stops
azure.datafactory_factories.ssis_package_execution_cancel
(count)
The number of cancelled SSIS package executions
azure.datafactory_factories.ssis_package_execution_failed
(count)
The number of failed SSIS package executions
azure.datafactory_factories.ssis_package_execution_succeeded
(count)
The number of succeeded SSIS package executions
azure.datafactory_factories.status
(gauge)
The status of data factories
azure.datafactory_factories.trigger_cancelled_runs
(count)
The number of cancelled trigger runs metrics
azure.datafactory_factories.trigger_failed_runs
(count)
The number of failed trigger runs metrics
azure.datafactory_factories.trigger_succeeded_runs
(count)
The number of succeeded trigger runs metrics

Events

The Azure Data Factory integration does not include any events.

Service Checks

The Azure Data Factory integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.