GitHub Copilot

GitHub Copilot Overview Dashboard

Overview

Datadog’s GitHub Copilot integration gives you deep visibility into Copilot usage across your organization, helping you measure adoption, optimize team performance, and understand the impact of AI-powered code suggestions on your development workflows. With this integration, you can:

Analyze Copilot Adoption – Measure how frequently developers accept Copilot’s code suggestions and identify which stages of your development process leverage Copilot features.
Track License Distribution – Monitor the status of Copilot licenses assigned within your organization to ensure optimal utilization.
Understand User Engagement – Gain insights into how developers interact with Copilot, distinguishing between:
- Active users: Developers who have any Copilot related activity, including passively receiving a code suggestion or interacting with Copilot chat.
- Engaged users: Developers who actively engage with Copilot features, such as accepting a suggestion or generating a pull request summary. All engaged users are also active users.

Collected Metrics

Datadog delivers in-depth visibility into Copilot adoption and usage with granular insights broken down by team, programming language, IDE, and repository, including:

Copilot Usage Metrics – Track key Copilot interactions, including IDE code completions, chat activity (both in IDEs and GitHub.com), and pull request summaries. These metrics are available daily and require at least five active Copilot licenses in your enterprise.
- IDE Code Completion & Chat – Captures usage within IDEs, provided telemetry is enabled.
- GitHub.com Chat – Measures interactions with Copilot chat on GitHub.com.
- Pull Request Usage – Tracks Copilot-assisted PR activities, such as automated summaries.
Billing Metrics – Stay up to date with real-time visibility into Copilot seat assignments for the current billing cycle. Datadog continuously refreshes this data to provide an accurate, up-to-date view of license utilization. With Datadog’s GitHub Copilot integration, you can ensure that AI-assisted development is driving efficiency while maintaining full visibility into its adoption and impact across your teams.

Setup

To integrate GitHub Copilot with Datadog, Datadog connects to GitHub using OAuth. The authenticated user must have owner permissions in the organizations that want to be integrated.

Installation

Navigate to the Integrations Page and search for the “GitHub Copilot” Integration.
Click the tile.
To add an account to install the integration, click the Add GitHub Account button.
After reading the instructions in the modal, click the Authorize button, which redirects you to the GitHub login page.
On the access request screen, click Authorize. This allows Datadog to fetch Copilot metrics.
You’re redirected back to Datadog’s GitHub Copilot tile with a new account. Datadog recommends changing the account name to something that is easier to remember. You can add multiple accounts with access to different organizations.

Configuration

Validation

After the integration is installed, the metrics are available with the prefix `github_copilot'.

Data Collected

Metrics

github_copilot.organizations.billing.seats.total (count)	The total number of seats being billed for the organization as of the current billing cycle.
github_copilot.organizations.billing.seats.added_this_cycle (count)	Seats added during the current billing cycle.
github_copilot.organizations.billing.seats.pending_invitation (count)	The number of seats that have been assigned to users that have not yet accepted an invitation to this organization.
github_copilot.organizations.billing.seats.pending_cancellation (count)	The number of seats that are pending cancellation at the end of the current billing cycle.
github_copilot.organizations.billing.seats.active_this_cycle (count)	The number of seats that have used Copilot during the current billing cycle.
github_copilot.organizations.billing.seats.inactive_this_cycle (count)	The number of seats that have not used Copilot during the current billing cycle.
github_copilot.organizations.total_active_users (count)	The total number of Copilot users with activity belonging to any Copilot feature, globally, for the given day. Includes passive activity such as receiving a code suggestion, as well as engagement activity such as accepting a code suggestion or prompting chat. Does not include authentication events. Is not limited to the individual features detailed on the endpoint.
github_copilot.organizations.total_engaged_users (count)	The total number of Copilot users who engaged with any Copilot feature, for the given day. Examples include but are not limited to accepting a code suggestion, prompting Copilot chat, or triggering a PR Summary. Does not include authentication events. Is not limited to the individual features detailed on the endpoint.
github_copilot.organizations.copilot_ide_code_completions.total_engaged_users (count)	Number of users who accepted at least one Copilot code suggestion, across all active editors. Includes both full and partial acceptances.
github_copilot.organizations.copilot_ide_code_completions.languages.total_engaged_users (count)	Number of users who accepted at least one Copilot code completion suggestion for the given language. Includes both full and partial acceptances.
github_copilot.organizations.copilot_ide_code_completions.editors.total_engaged_users (count)	Number of users who accepted at least one Copilot code completion suggestion for the given editor. Includes both full and partial acceptances.
github_copilot.organizations.copilot_ide_code_completions.editors.models.total_engaged_users (count)	Number of users who accepted at least one Copilot code completion suggestion for the given editor, for the given language and model. Includes both full and partial acceptances.
github_copilot.organizations.copilot_ide_code_completions.editors.models.languages.total_engaged_users (count)	Number of users who accepted at least one Copilot code completion suggestion for the given editor, for the given language. Includes both full and partial acceptances.
github_copilot.organizations.copilot_ide_code_completions.editors.models.languages.total_code_suggestions (count)	The number of Copilot code suggestions generated for the given editor, for the given language.
github_copilot.organizations.copilot_ide_code_completions.editors.models.languages.total_code_acceptances (count)	The number of Copilot code suggestions accepted for the given editor, for the given language. Includes both full and partial acceptances.
github_copilot.organizations.copilot_ide_code_completions.editors.models.languages.total_code_lines_accepted (count)	The number of lines of code accepted from Copilot code suggestions for the given editor, for the given language
github_copilot.organizations.copilot_ide_code_completions.editors.models.languages.total_code_lines_suggested (count)	The number of lines of code suggested by Copilot code completions for the given editor, for the given language.
github_copilot.organizations.copilot_ide_chat.total_engaged_users (count)	Total number of users who prompted Copilot Chat in the IDE.
github_copilot.organizations.copilot_ide_chat.editors.total_engaged_users (count)	The number of users who prompted Copilot Chat in the specified editor.
github_copilot.organizations.copilot_ide_chat.editors.models.total_engaged_users (count)	The number of users who prompted Copilot Chat in the given editor and model.
github_copilot.organizations.copilot_ide_chat.editors.models.total_chats (count)	The total number of chats initiated by users in the given editor and model.
github_copilot.organizations.copilot_ide_chat.editors.models.total_chat_insertion_events (count)	The number of times users accepted a code suggestion from Copilot Chat using the 'Insert Code' UI element, for the given editor.
github_copilot.organizations.copilot_ide_chat.editors.models.total_chat_copy_events (count)	The number of times users copied a code suggestion from Copilot Chat using the keyboard, or the 'Copy' UI element, for the given editor.
github_copilot.organizations.copilot_dotcom_chat.total_engaged_users (count)	Total number of users who prompted Copilot Chat on github.com at least once.
github_copilot.organizations.copilot_dotcom_chat.models.total_engaged_users (count)	Total number of users who prompted Copilot Chat on github.com at least once for each model.
github_copilot.organizations.copilot_dotcom_chat.models.total_chats (count)	Total number of chats initiated by users on github.com.
github_copilot.organizations.copilot_dotcom_pull_requests.total_engaged_users (count)	The number of users who used Copilot for Pull Requests on github.com to generate a pull request summary at least once.
github_copilot.organizations.copilot_dotcom_pull_requests.repositories.total_engaged_users (count)	The number of users who generated pull request summaries using Copilot for Pull Requests in the given repository.
github_copilot.organizations.copilot_dotcom_pull_requests.repositories.models.total_engaged_users (count)	The number of users who generated pull request summaries using Copilot for Pull Requests in the given repository and model.
github_copilot.organizations.copilot_dotcom_pull_requests.repositories.models.total_pr_summaries_created (count)	The number of pull request summaries generated using Copilot for Pull Requests in the given repository.
github_copilot.organizations.teams.total_active_users (count)	The total number of Copilot users with activity belonging to any Copilot feature, globally, for the given day. Includes passive activity such as receiving a code suggestion, as well as engagement activity such as accepting a code suggestion or prompting chat. Does not include authentication events. Is not limited to the individual features detailed on the endpoint.
github_copilot.organizations.teams.total_engaged_users (count)	The total number of Copilot users who engaged with any Copilot feature, for the given day. Examples include but are not limited to accepting a code suggestion, prompting Copilot chat, or triggering a PR Summary. Does not include authentication events. Is not limited to the individual features detailed on the endpoint.
github_copilot.organizations.teams.copilot_ide_code_completions.total_engaged_users (count)	Number of users who accepted at least one Copilot code suggestion, across all active editors. Includes both full and partial acceptances.
github_copilot.organizations.teams.copilot_ide_code_completions.languages.total_engaged_users (count)	Number of users who accepted at least one Copilot code completion suggestion for the given language. Includes both full and partial acceptances.
github_copilot.organizations.teams.copilot_ide_code_completions.editors.total_engaged_users (count)	Number of users who accepted at least one Copilot code completion suggestion for the given editor. Includes both full and partial acceptances.
github_copilot.organizations.teams.copilot_ide_code_completions.editors.models.total_engaged_users (count)	Number of users who accepted at least one Copilot code completion suggestion for the given editor and model. Includes both full and partial acceptances.
github_copilot.organizations.teams.copilot_ide_code_completions.editors.models.languages.total_engaged_users (count)	Number of users who accepted at least one Copilot code completion suggestion for the given editor, for the given language and model. Includes both full and partial acceptances
github_copilot.organizations.teams.copilot_ide_code_completions.editors.models.languages.total_code_suggestions (count)	The number of Copilot code suggestions generated for the given editor, for the given language and model.
github_copilot.organizations.teams.copilot_ide_code_completions.editors.models.languages.total_code_acceptances (count)	The number of Copilot code suggestions accepted for the given editor, for the given language and model. Includes both full and partial acceptances.
github_copilot.organizations.teams.copilot_ide_code_completions.editors.models.languages.total_code_lines_accepted (count)	The number of lines of code accepted from Copilot code suggestions for the given editor, for the given language and model.
github_copilot.organizations.teams.copilot_ide_code_completions.editors.models.languages.total_code_lines_suggested (count)	The number of lines of code suggested by Copilot code completions for the given editor, for the given language and model.
github_copilot.organizations.teams.copilot_ide_chat.total_engaged_users (count)	Total number of users who prompted Copilot Chat in the IDE.
github_copilot.organizations.teams.copilot_ide_chat.editors.total_engaged_users (count)	The number of users who prompted Copilot Chat in the specified editor.
github_copilot.organizations.teams.copilot_ide_chat.editors.models.total_engaged_users (count)	The number of users who prompted Copilot Chat in the given editor and model.
github_copilot.organizations.teams.copilot_ide_chat.editors.models.total_chats (count)	The total number of chats initiated by users in the given editor and model.
github_copilot.organizations.teams.copilot_ide_chat.editors.models.total_chat_insertion_events (count)	The number of times users accepted a code suggestion from Copilot Chat using the 'Insert Code' UI element, for the given editor.
github_copilot.organizations.teams.copilot_ide_chat.editors.models.total_chat_copy_events (count)	The number of times users copied a code suggestion from Copilot Chat using the keyboard, or the 'Copy' UI element, for the given editor.
github_copilot.organizations.teams.copilot_dotcom_chat.total_engaged_users (count)	Total number of users who prompted Copilot Chat on github.com at least once.
github_copilot.organizations.teams.copilot_dotcom_chat.models.total_engaged_users (count)	Total number of users who prompted Copilot Chat on github.com at least once for each model.
github_copilot.organizations.teams.copilot_dotcom_chat.models.total_chats (count)	Total number of chats initiated by users on github.com.
github_copilot.organizations.teams.copilot_dotcom_pull_requests.total_engaged_users (count)	The number of users who used Copilot for Pull Requests on github.com to generate a pull request summary at least once.
github_copilot.organizations.teams.copilot_dotcom_pull_requests.repositories.total_engaged_users (count)	The number of users who generated pull request summaries using Copilot for Pull Requests in the given repository.
github_copilot.organizations.teams.copilot_dotcom_pull_requests.repositories.models.total_engaged_users (count)	The number of users who generated pull request summaries using Copilot for Pull Requests in the given repository and model.
github_copilot.organizations.teams.copilot_dotcom_pull_requests.repositories.models.total_pr_summaries_created (count)	The number of pull request summaries generated using Copilot for Pull Requests in the given repository.

Service Checks

GitHub Copilot does not include any service checks.

Events

GitHub Copilot does not include any events.

Troubleshooting

Need help? Contact Datadog support.