Prefect

Supported OS Linux Windows Mac OS

marketplace
Integration version1.1.1

Overview

Prefect Cloud is a fully managed, cloud-based orchestration platform built on top of the open-source Prefect framework. It is designed to help teams manage, schedule, monitor, and automate workflows across data engineering, machine learning, and business automation contexts — without the overhead of hosting and maintaining their own orchestration infrastructure.

This integration allows you to collect Prefect data as logs and metrics in Datadog, and includes an out-of-the-box dashboard.

  • Logs: Flow Runs, Task Runs, Deployments, Workspace Events
  • Metrics: Flow Success Metrics, Flow Duration Metrics, Flow Total Metrics, Flow SLA Violation Metrics, Flow Lateness Metrics, Flow Failure Rate Metrics

This integration also includes four out-of-the-box monitors to alert on:

  • Flow SLAs
  • Flow lateness
  • Failed flow runs
  • Failed task runs

Data Collected

Metrics

cds.prefect.volume
(gauge)
Total number of runs.
cds.prefect.successes
(gauge)
Total number of successful runs.
cds.prefect.duration
(gauge)
Duration of runs.
Shown as second
cds.prefect.lateness
(gauge)
Lateness of runs.
Shown as second
cds.prefect.failure_rate
(gauge)
Percentage of failed flows.
Shown as percent

Service Checks

cds.prefect.status

Returns CRITICAL if the user configurations are invalid or authentication fails. Returns OK otherwise.

Statuses: ok, critical

Support

For support or feature requests, contact Crest Data through the following channels:


This application is made available through the Marketplace and is supported by a Datadog Technology Partner. Click Here to purchase this application.