Datadog-Google BigQuery Integration

Overview

BigQuery is Google’s fully managed, petabyte scale, low cost enterprise data warehouse for analytics.

Get metrics from Google BigQuery to:

  • Visualize the performance of your BigQuery queries
  • Correlate the performance of your BigQuery queries with your applications

Setup

Installation

If you haven’t already, set up the Google Cloud Platform integration first. There are no other installation steps that need to be performed.

Data Collected

Metrics

gcp.bigquery.query.count
(count)
Queries in flight.
shown as query
gcp.bigquery.query.execution_times.avg
(gauge)
Average of query execution times.
shown as second
gcp.bigquery.query.execution_times.samplecount
(count)
Sample Count of query execution times.
shown as second
gcp.bigquery.query.execution_times.max
(gauge)
Maximum of query execution times.
shown as second
gcp.bigquery.query.execution_times.min
(gauge)
Minimum of query execution times.
shown as second
gcp.bigquery.query.execution_times.sumsqdev
(gauge)
Sum of Squared Deviation for query execution times.
shown as second
gcp.bigquery.query.scanned_bytes
(rate)
Number of scanned bytes. Note: this metric is available with a 12h delay
shown as byte
gcp.bigquery.query.scanned_bytes_billed
(rate)
Number of scanned bytes billed. Note: this metric is available with a 12h delay
shown as byte
gcp.bigquery.slots.allocated_for_project
(gauge)
Number of BigQuery slots currently allocated for the project.
shown as resource
gcp.bigquery.slots.allocated_for_reservation
(gauge)
Number of BigQuery slots currently allocated for the reservation.
shown as resource
gcp.bigquery.slots.total_available
(gauge)
Total number of BigQuery slots available for the project.
shown as resource
gcp.bigquery.storage.stored_bytes
(gauge)
Number of bytes stored. Note: this metric is available with a 12h delay
shown as byte
gcp.bigquery.storage.table_count
(gauge)
Number of tables. Note: this metric is available with a 12h delay
shown as table
gcp.bigquery.storage.uploaded_bytes
(rate)
Number of uploaded bytes. Note: this metric is available with a 12h delay
shown as byte
gcp.bigquery.storage.uploaded_bytes_billed
(rate)
Number of uploaded bytes billed. Note: this metric is available with a 12h delay
shown as byte
gcp.bigquery.storage.uploaded_row_count
(rate)
Number of uploaded rows. Note: this metric is available with a 12h delay
shown as byte