Microsoft Fabric

Overview

Microsoft Fabric is an end-to-end data and analytics platform for enterprises. Fabric integrates workloads such as Synapse Data Engineering, Synapse Warehousing, and Power BI into a single SaaS solution. Use the Datadog integration to collect metrics from Azure Synapse in Microsoft Fabric.

Setup

Installation

If you haven’t already, set up the Microsoft Azure integration first. There are no other installation steps.

Data Collected

Metrics

azure.synapse_workspaces.builtin_sql_pool_data_processed_bytes
(count)
Amount of data processed by queries.
Shown as byte
azure.synapse_workspaces.builtin_sql_pool_login_attempts
(count)
Count of login attempts that succeeded or failed.
azure.synapse_workspaces.builtin_sql_pool_requests_ended
(count)
Count of requests that succeeded, failed, or were canceled.
azure.synapse_workspaces.integration_activity_runs_ended
(count)
Count of integration activities that succeeded, failed, or were canceled.
azure.synapse_workspaces.integration_link_connection_events
(count)
Number of Synapse Link connection events including start, stop, and failure.
azure.synapse_workspaces.integration_link_processed_changed_rows
(count)
Changed row count processed by Synapse Link.
azure.synapse_workspaces.integration_link_processed_data_volume
(count)
Data volume in bytes processed by Synapse Link.
Shown as byte
azure.synapse_workspaces.integration_link_processing_latency_in_seconds
(gauge)
Synapse Link data processing latency in seconds.
azure.synapse_workspaces.integration_link_table_events
(count)
Number of Synapse Link table events including snapshot, removal, and failure.
azure.synapse_workspaces.integration_pipeline_runs_ended
(count)
Count of integration pipeline runs that succeeded, failed, or were canceled.
azure.synapse_workspaces.integration_trigger_runs_ended
(count)
Count of integration triggers that succeeded, failed, or were canceled.
azure.synapse_workspaces.sql_streaming_backlogged_input_event_sources
(count)
This is a preview metric available in East US,West Europe. Number of input events sources backlogged.
azure.synapse_workspaces.sql_streaming_conversion_errors
(count)
This is a preview metric available in East US, West Europe. Number of output events that could not be converted to the expected output schema. Error policy can be changed to drop events that encounter this scenario.
azure.synapse_workspaces.sql_streaming_deserialization_error
(count)
This is a preview metric available in East US, West Europe. Number of input events that could not be deserialized.
azure.synapse_workspaces.sql_streaming_early_input_events
(count)
This is a preview metric available in East US, West Europe. Number of input events for which application time is considered early compared to arrival time, according to early arrival policy.
azure.synapse_workspaces.sql_streaming_input_event_bytes
(count)
This is a preview metric available in East US, West Europe. Amount of data received by the streaming job, in bytes. This can be used to validate that events are being sent to the input source.
azure.synapse_workspaces.sql_streaming_input_events
(count)
This is a preview metric available in East US, West Europe. Number of input events.
azure.synapse_workspaces.sql_streaming_input_events_sources_per_second
(count)
This is a preview metric available in East US, West Europe. Number of input events sources per second.
azure.synapse_workspaces.sql_streaming_late_input_events
(count)
This is a preview metric available in East US, West Europe. Number of input events for which application time is considered late compared to arrival time, according to late arrival policy.
azure.synapse_workspaces.sql_streaming_out_of_order_events
(count)
This is a preview metric available in East US, West Europe. Number of Event Hub Events (serialized messages) received by the Event Hub input adapter, received out of order that were either dropped or given an adjusted timestamp, based on the event ordering policy.
azure.synapse_workspaces.sql_streaming_output_events
(count)
This is a preview metric available in East US, West Europe. Number of output events.
azure.synapse_workspaces.sql_streaming_output_watermark_delay_seconds
(gauge)
This is a preview metric available in East US, West Europe. Output watermark delay in seconds.
azure.synapse_workspaces.sql_streaming_resource_utilization
(gauge)
This is a preview metric available in East US, West Europe.
Shown as percent
azure.synapse_workspaces.sql_streaming_runtime_errors
(count)
This is a preview metric available in East US, West Europe. Total number of errors related to query processing (excluding errors found while ingesting events or outputting results).
azure.synapse_workspaces.count
(gauge)
Count of Synapse workspaces.
azure.synapse_workspaces.status
(gauge)
Status of Synapse workspaces(deprecated).
azure.synapse_workspaces_bigdatapools.big_data_pool_allocated_cores
(gauge)
Allocated vCores for an Apache Spark Pool.
azure.synapse_workspaces_bigdatapools.big_data_pool_allocated_memory
(gauge)
Allocated Memory for Apache Spark pool (GB).
azure.synapse_workspaces_bigdatapools.big_data_pool_applications_active
(gauge)
Total Active Apache Spark pool Applications.
azure.synapse_workspaces_bigdatapools.big_data_pool_applications_ended
(count)
Count of Apache Spark pool applications ended.
azure.synapse_workspaces_bigdatapools.count
(gauge)
Count of Synapse workspaces bigDataPools.
azure.synapse_workspaces_bigdatapools.status
(gauge)
Status of Synapse workspaces bigDataPools(deprecated).
azure.synapse_workspaces_scopepools.scope_pool_job_pn_metric
(gauge)
PN (process node) duration (Milliseconds) used by each SCOPE job.
Shown as millisecond
azure.synapse_workspaces_scopepools.scope_pool_job_queued_duration_metric
(gauge)
Queued duration (Milliseconds) used by each SCOPE job.
Shown as millisecond
azure.synapse_workspaces_scopepools.scope_pool_job_running_duration_metric
(gauge)
Running duration (Milliseconds) used by each SCOPE job.
Shown as millisecond
azure.synapse_workspaces_scopepools.count
(gauge)
Count of Synapse workspaces scopePools.
azure.synapse_workspaces_scopepools.status
(gauge)
Status of Synapse workspaces scopePools(deprecated).
azure.synapse_workspaces_sqlpools.active_queries
(count)
Active queries. Using this metric unfiltered and unsplit displays all active queries running on the system.
azure.synapse_workspaces_sqlpools.adaptive_cache_hit_percent
(gauge)
Measures how well workloads are utilizing the adaptive cache. Use this metric with the cache hit percentage metric to determine whether to scale for additional capacity or rerun workloads to hydrate the cache.
Shown as percent
azure.synapse_workspaces_sqlpools.adaptive_cache_used_percent
(gauge)
Measures how well workloads are utilizing the adaptive cache. Use this metric with the cache used percentage metric to determine whether to scale for additional capacity or rerun workloads to hydrate the cache.
Shown as percent
azure.synapse_workspaces_sqlpools.connections
(count)
Count of total logins to the SQL pool.
azure.synapse_workspaces_sqlpools.connections_blocked_by_firewall
(count)
Count of connections blocked by firewall rules. Revisit access control policies for your SQL pool and monitor these connections if the count is high.
azure.synapse_workspaces_sqlpools.cpu_percent
(gauge)
CPU utilization across all nodes in the SQL pool.
Shown as percent
azure.synapse_workspaces_sqlpools.dwu_limit
(gauge)
Service level objective of the SQL pool.
azure.synapse_workspaces_sqlpools.dwu_used
(gauge)
Represents a high-level representation of usage across the SQL pool. Measured by DWU limit * DWU percentage.
azure.synapse_workspaces_sqlpools.dwu_used_percent
(gauge)
Represents a high-level representation of usage across the SQL pool. Measured by taking the maximum between CPU percentage and data input/output percentage.
Shown as percent
azure.synapse_workspaces_sqlpools.local_temp_db_used_percent
(gauge)
Local tempdb utilization across all compute nodes - values are emitted every five minute.
Shown as percent
azure.synapse_workspaces_sqlpools.memory_used_percent
(gauge)
Memory utilization across all nodes in the SQL pool.
Shown as percent
azure.synapse_workspaces_sqlpools.queued_queries
(count)
Cumulative count of requests queued after the max concurrency limit was reached.
azure.synapse_workspaces_sqlpools.wlg_active_queries
(count)
Active queries within the workload group. Using this metric unfiltered and unsplit displays all active queries running on the system.
azure.synapse_workspaces_sqlpools.wlg_active_queries_timeouts
(count)
Queries for the workload group that have timed out. Query timeouts are reported by this metric only once the query has started executing (it does not include wait time due to locking or resource waits).
azure.synapse_workspaces_sqlpools.wlg_allocation_by_effective_cap_resource_percent
(gauge)
Displays the percentage allocation of resources relative to the effective cap resource percent per workload group. This metric provides the effective utilization of the workload group.
Shown as percent
azure.synapse_workspaces_sqlpools.wlg_allocation_by_system_percent
(gauge)
Percentage allocation of resources relative to the entire system.
Shown as percent
azure.synapse_workspaces_sqlpools.wlg_effective_cap_resource_percent
(gauge)
Effective cap resource percent for the workload group. If there are other workload groups with minpercentageresource greater than 0, the effectivecappercentage_resource is lowered proportionally.
Shown as percent
azure.synapse_workspaces_sqlpools.wlg_effective_min_resource_percent
(gauge)
Effective min resource percentage setting allowed considering the service level and the workload group settings. The effective minpercentageresource can be adjusted higher on lower service levels.
Shown as percent
azure.synapse_workspaces_sqlpools.wlg_queued_queries
(count)
Cumulative count of requests queued after the max concurrency limit was reached.
azure.synapse_workspaces_sqlpools.count
(gauge)
Count of Synapse workspaces sqlPools.
azure.synapse_workspaces_sqlpools.status
(gauge)
Status of Synapse workspaces sqlPools(deprecated).

Service Checks

The Microsoft Fabric Integration does not include any service checks.

Events

The Microsoft Fabric Integration does not include any events.

Troubleshooting

Need help? Contact Datadog support.

Further Reading

Additional helpful documentation, links, and articles: