Pipeline Visibility in Datadog
CI Visibility is not available in the selected site () at this time.
Your pipelines appear in the Pipelines page under the CI menu.
Setup
Select your CI provider to set up pipeline visibility in Datadog:
Pipelines health overview
The Pipelines page shows aggregate stats for the default branch of each pipeline over the selected time frame, as well as the status of the latest pipeline execution. Use this page to see all your pipelines and get a quick view of their health. The Pipelines page shows metrics for the default branch, usually named something like main or prod.
Metrics shown include build frequency, failure rate, average duration, and 95th percentile duration. This information reveals which pipelines are high-usage and potentially high resource consumers. The last build result, duration, and last run time show you the effect of the last commit.
You can filter the page by pipeline name to see the pipelines you’re most concerned with. Click on a pipeline that is slow or failing to dig into details that show what commit might have introduced the performance regression or build error.
Pipeline details and branches
Click into a specific pipeline to see the Pipeline Details page which provides views of the data for the pipeline you selected over a specified time frame, and can display branches other than the default.
Get insights on the selected pipeline such as total and failed executions over time, build duration percentiles, and total time spent breakdown by stage. There are also summary tables for stages and jobs so you can quickly sort them in terms of duration, percentage of overall execution time, or failure rate.
When viewing the default branch for a pipeline, each stage and job summary table on the page contains a Duration Change graph that visualizes the absolute and relative change in duration of stages and jobs, along with a graph of Errored Executions.
When viewing a feature branch for a pipeline, there are two graphs for Errored Executions: one for failed executions in this feature branch, and another for comparing failures in this branch to other failures. You have the option to toggle between Other Branches and Specific Branch. Selecting Other Branches compares failed executions in this feature branch with aggregated failures across all other branches to help you distinguish between introduced (local) execution failures and inherited (global) execution failures. Toggling to Specific Branch directly compares failed executions in this feature branch with failed executions in another branch of your choice to help you specifically track changes in pipeline performance.
Optionally, you can directly compare failed executions in this feature branch with failed executions in another branch of your choice.
The pipeline execution list at the bottom shows all the times that pipeline (or its stages or jobs) ran during the selected time frame, for the selected branch. Use the facets on the left side to filter the list to exactly the pipelines, stages, or jobs you want to see.
Explore connections to services, resources, and network events
Click one of the executions to open the pipeline execution view and see the flame graph or span list for the pipeline and its stages. The Executions (n) list on the left side gives you quick access to the data for each retry of the pipeline for the same commit.
Click the CI provider link (gitlab-ci gitlab.pipeline > documentation in the following image) to investigate the Resource, Service, or Analytics page for the pipeline, stage, or job specifically. You can also find complete tags information and links to network monitoring events.
Explore connections to logs
If job log collection is supported and enabled for the CI provider, related log events can be found in the Logs tab of the pipeline execution view.
Note: Job log collection is supported for a limited set of providers:
Pipeline executions details and traces
On the Pipeline Executions page, you can see aggregated data about pipeline executions over the selected time frame. Use the search field and facets to scope the list down to the executions you want to investigate. Change the list to show pipelines, stages, or jobs using the buttons at the top.
Below are three graphs that visualize the durations of your most active pipelines, your failed pipelines over time, and the executions of your pipelines with an option to toggle to accumulated duration, respectively. These graphs are scoped to the level chosen at the top left (Pipeline, Stage, Job, and more.)
Each pipeline execution is reported as a trace, which includes stage and job information. Access individual pipeline, stage, and job execution traces by clicking on an execution in the list (similar to clicking into a pipeline execution from the Pipeline Details page).
Alternatively, click the Analytics button to interactively filter and group pipelines execution data into visualizations you can use to answer questions and share on dashboards.
Communicate about CI pipelines data
CI pipeline data is available when you create widgets in Dashboards and Notebooks.
Further reading
Additional helpful documentation, links, and articles:
