AI Impact

Este producto no es compatible con el sitio Datadog seleccionado. ().
Esta página aún no está disponible en español. Estamos trabajando en su traducción.
Si tienes alguna pregunta o comentario sobre nuestro actual proyecto de traducción, no dudes en ponerte en contacto con nosotros.
Join the Preview!

AI Impact is available to all Datadog customers in Preview.

Overview

AI Impact measures how AI coding tools—including coding assistants, review agents, and autonomous agents—affect your software delivery performance. Datadog detects AI contribution from several types of sources. Sources include co-author patterns in commit metadata, provider integrations, pull request labels, and data you send yourself.

Getting started

Datadog detects some AI activity automatically after DORA Metrics is set up with deployment, commit, and pull request data. AI tools may be identified through co-author signatures, review comments, and other author information in commits that commonly indicate AI involvement. To more completely capture AI activity in your organization, see Set Up AI Impact to configure sources and mapping rules that identify your specific AI tools and their contributions.

Impact metrics

MetricDefinition
AI-assisted PRsPRs containing at least one AI-assisted commit, divided by total PRs.
PR ThroughputNumber of PRs deployed per user per day for AI-assisted authors compared to non-assisted authors.
PR Cycle TimeMedian time from a PR’s first commit to merge for AI-assisted PRs compared to non-assisted PRs.
Change Failure RateFailure rate weighted by the proportion of AI-assisted commits in each deployment, compared to the weighted rate for non-assisted commits. For example, if a failed deployment has 3 out of 10 commits assisted by AI, only 30% of that failure is attributed to AI.
Recovery TimeMedian recovery time of failed deployments containing AI-assisted commits compared to deployments without.
Change Failure Rate only includes deployments linked to code changes. Configuration-only or infrastructure deployments are excluded to help the comparison reflect the impact of AI on code-related failures. This differs from standard DORA Change Failure Rate, which counts all deployment types.
For GitHub only, PR-level metrics exclude PRs whose commits are entirely bot-authored. This keeps automated activity out of the non-AI baseline.

Further Reading

Documentación, enlaces y artículos útiles adicionales:

Set up AI ImpactDOCUMENTATION more more Learn about DORA MetricsDOCUMENTATION more more Set up DORA MetricsDOCUMENTATION more more Learn how DORA metrics are calculatedDOCUMENTATION more more 5 pitfalls to avoid when measuring developer experience in the AI eraBLOG more more Measure the real impact of AI coding tools on software delivery with Datadog AI ImpactBLOG more more How to measure developer experience in the AI eraBLOG more more