Présentation
BigQuery est l’entrepôt de données entièrement géré et à faible coût de Google qui stocke des pétaoctets de données à des fins d’analyse.
Recueillez des métriques de Google BigQuery pour :
- Visualiser les performances de vos requêtes BigQuery
- Corréler les performances de vos requêtes BigQuery avec vos applications
Configuration
Installation
Si vous ne l’avez pas déjà fait, configurez d’abord l’intégration Google Cloud Platform. Aucune autre procédure d’installation n’est requise.
Collecte de logs
Les logs Google BigQuery sont recueillis avec Google Cloud Logging et envoyés à un Cloud Pub/Sub via un forwarder Push HTTP. Si vous ne l’avez pas déjà fait, configurez un Cloud Pub/Sub à l’aide d’un forwarder Push HTTP.
Une fois cette opération effectuée, exportez vos logs Google BigQuery depuis Google Cloud Logging vers le Pub/Sub :
- Accédez à la page Google Cloud Logging et filtrez les logs Google BigQuery.
- Cliquez sur Create Export et nommez le récepteur.
- Choisissez Cloud Pub/Sub comme destination et sélectionnez le Pub/Sub créé à cette fin. Remarque : le Pub/Sub peut se situer dans un autre projet.
- Cliquez sur Create et attendez que le message de confirmation s’affiche.
Données collectées
Métriques
gcp.bigquery.job.num_in_flight
(gauge) | Number of in flight jobs
Shown as job |
gcp.bigquery.query.count
(gauge) | Queries in flight
Shown as query |
gcp.bigquery.query.execution_times.avg
(gauge) | Average of query execution times
Shown as second |
gcp.bigquery.query.execution_times.samplecount
(count) | Sample Count of query execution times
Shown as second |
gcp.bigquery.query.execution_times.sumsqdev
(gauge) | Sum of Squared Deviation for query execution times
Shown as second |
gcp.bigquery.query.scanned_bytes
(rate) | Number of scanned bytes. Note: this metric is available with a 6h delay
Shown as byte |
gcp.bigquery.query.scanned_bytes_billed
(rate) | Number of scanned bytes billed. Note: this metric is available with a 6h delay
Shown as byte |
gcp.bigquery.query.statement_scanned_bytes
(rate) | Scanned bytes broken down by statement type. Note: this metric is available with a 6h delay
Shown as byte |
gcp.bigquery.query.statement_scanned_bytes_billed
(rate) | Scanned bytes billed broken down by statement type. Note: this metric is available with a 6h delay
Shown as byte |
gcp.bigquery.slots.allocated
(gauge) | Number of BigQuery slots currently allocated for project, slot allocation can be broken down based on reservation and job type |
gcp.bigquery.slots.allocated_for_project
(gauge) | Number of BigQuery slots currently allocated for the project |
gcp.bigquery.slots.allocated_for_project_and_job_type
(gauge) | Number of BigQuery slots currently allocated for the project and job type |
gcp.bigquery.slots.allocated_for_reservation
(gauge) | Number of BigQuery slots currently allocated for project in the reservation |
gcp.bigquery.slots.total_allocated_for_reservation
(gauge) | Number of BigQuery slots currently allocated across all projects in the reservation |
gcp.bigquery.storage.stored_bytes
(gauge) | Number of bytes stored. Note: this metric is available with a 3h delay
Shown as byte |
gcp.bigquery.storage.table_count
(gauge) | Number of tables. Note: this metric is available with a 3h delay
Shown as table |
gcp.bigquery.storage.uploaded_bytes
(rate) | Number of uploaded bytes. Note: this metric is available with a 6h delay
Shown as byte |
gcp.bigquery.storage.uploaded_bytes_billed
(rate) | Number of uploaded bytes billed. Note: this metric is available with a 6h delay
Shown as byte |
gcp.bigquery.storage.uploaded_row_count
(rate) | Number of uploaded rows. Note: this metric is available with a 6h delay
Shown as row |
Événements
L’intégration Google BigQuery n’inclut aucun événement.
Checks de service
L’intégration Google BigQuery n’inclut aucun check de service.
Dépannage
Besoin d’aide ? Contactez l’assistance Datadog.
