CI Pipeline Visibility in Datadog

CI Visibility is not available in the selected site () at this time.

Overview

Pipeline Visibility provides a pipeline-first view into your CI health by displaying important metrics and results from your pipelines. It helps you troubleshoot pipeline failures, address performance bottlenecks, and track CI performance and reliability over time.

Setup


Terminology

While the concept of a CI pipeline may vary depending on your provider, see how those concepts correspond to the definition of a CI pipeline in Datadog Pipeline Visibility:

DatadogGitHub Actions
PipelineWorkflow
JobJob
StepStep
DatadogGitLab
PipelinePipeline
StageStage
JobJob
Not available in DatadogScript
DatadogJenkins
PipelinePipeline
StageStage
JobStep
DatadogCircleCI
PipelineWorkflow
JobJob
Not available in DatadogStep
DatadogBuildkite
PipelinePipeline
JobJob
Not available in DatadogStep
DatadogTeamCity
PipelineBuild Chain
JobBuild
Not available in DatadogStep
DatadogAzure Pipelines
PipelinePipeline
StageStage
JobJob
Not available in DatadogStep
DatadogAWS CodePipeline
PipelinePipeline
StageStage
JobAction
DatadogOther CI Providers
PipelinePipeline
StageStage
JobJob
StepStep

If your CI provider is not supported, you can try setting up Pipeline Visibility through the public API endpoint.

Supported features

JenkinsGitLabCircleCIBuildkiteGitHub ActionsAzure PipelinesCodefreshTeamCityAWS CodePipelineOther CI Providers
Pipeline trace visualization

Visualization of pipeline executions with associated tracing.

Running pipelines

Identification of pipelines executions that are running with associated tracing.

Partial retries

Identification of partial retries (for example, when only a subset of jobs were retried).

Step spans

Step level spans are available for more granular visibility.

(But are presented as job spans)
Manual steps

Identification of when there is a job with a manual approval phase in the overall pipeline.

Approval wait time

Identification of the amount of time for which a pipeline or job has been waiting for a manual approval.

Queue time

Identification of the amount of time for which a pipeline or job was in the queue before execution.

Logs correlation

Retrieval of pipeline or job logs from the CI provider. Logs are displayed on the Logs tab in the Pipeline Execution view.

Infrastructure metric correlation

Correlation of host-level information for the Datadog Agent, CI pipelines, or job runners to CI pipeline execution data.

Custom spans for traced commands using datadog-ci

Support for sending command-level events to CI Visibility to be incorporated into pipeline flame graph visualization. You can then query and analyze these events.

Custom predefined tags

Support for setting static pipeline tags in the CI provider that do not change between executions.

Custom tags and measures at runtime

Support for adding user-defined text and numerical tags to pipelines and jobs in CI Visibility.

Parameters

Support for adding custom pipeline parameters that users set (for example, DYNAMICS_IS_CHILD:true). You can then search using these parameters in the CI Visibility Explorer to find all events with a specific parameter.

Pipeline failure reason

Identification of a specific reason behind a pipeline or job failure.

Use CI pipelines data

When creating a dashboard or a notebook, you can use CI pipeline data in your search query, which updates the visualization widget options. For more information, see the Dashboards and Notebooks documentation.

Alert on pipeline data

You can export your search query to a CI Pipeline monitor on the Pipelines Executions page or the Test Runs page by clicking the Export button.

Further reading