New announcements for Serverless, Network, RUM, and more from Dash! New announcements from Dash!

Google Bigtable

Crawler Crawler

Overview

Bigtable is Google’s NoSQL Big Data database service. It’s the same database that powers many core Google services, including Search, Analytics, Maps, and Gmail.

Use the Datadog Google Cloud Platform integration to collect metrics from Google Bigtable.

Setup

Installation

If you haven’t already, set up the Google Cloud Platform integration first. There are no other installation steps.

Log collection

Google Bigtable logs are collected with Stackdriver and sent to a Cloud pub/sub with an HTTP push forwarder. If you haven’t already, set up a Cloud pub/sub with an HTTP push forwarder.

Once this is done, export your Google Bigtable logs from Stackdriver to the pub/sub:

  1. Go to the Stackdriver page and filter the Google Bigtable logs.
  2. Click Create Export and name the sink.
  3. Choose “Cloud Pub/Sub” as the destination and select the pub/sub that was created for that purpose. Note: The pub/sub can be located in a different project.
  4. Click Create and wait for the confirmation message to show up.

Data Collected

Metrics

gcp.bigtable.cluster.cpu_load
(gauge)
CPU load of a cluster.
Shown as percent
gcp.bigtable.cluster.cpu_load_hottest_node
(gauge)
CPU load of the busiest node in a cluster.
Shown as percent
gcp.bigtable.cluster.disk_load
(gauge)
Utilization of HDD disks in a cluster
Shown as percent
gcp.bigtable.cluster.node_count
(gauge)
Number of nodes in a cluster.
Shown as node
gcp.bigtable.cluster.storage_utilization
(gauge)
Storage used as a fraction of total storage capacity.
Shown as percent
gcp.bigtable.disk.bytes_used
(gauge)
Amount of compressed data for tables stored in a cluster.
Shown as byte
gcp.bigtable.disk.storage_capacity
(gauge)
Capacity of compressed data for tables that can be stored in a cluster.
Shown as byte
gcp.bigtable.replication.latencies.avg
(gauge)
Distribution of replication request latencies for a table.
Shown as millisecond
gcp.bigtable.replication.latencies.samplecount
(count)
Sample count for replication request latencies
Shown as millisecond
gcp.bigtable.replication.latencies.sumsqdev
(gauge)
Sum of squared deviation for replication request latencies
Shown as second
gcp.bigtable.server.error_count
(gauge)
Number of server requests for a table that failed with an error.
Shown as error
gcp.bigtable.server.latencies.avg
(gauge)
Distribution of server request latencies for a table.
Shown as millisecond
gcp.bigtable.server.latencies.samplecount
(count)
Sample count for server request latencies
Shown as millisecond
gcp.bigtable.server.latencies.sumsqdev
(gauge)
Sum of squared deviation for server request latencies
Shown as second
gcp.bigtable.server.modified_rows_count
(gauge)
Number of rows modified by server requests for a table.
gcp.bigtable.server.received_bytes_count
(gauge)
Number of uncompressed bytes of request data received by servers for a table.
Shown as byte
gcp.bigtable.server.request_count
(gauge)
Number of server requests for a table.
Shown as request
gcp.bigtable.server.returned_rows_count
(gauge)
Number of rows returned by server requests for a table.
gcp.bigtable.server.sent_bytes_count
(gauge)
Number of uncompressed bytes of response data sent by servers for a table.
Shown as byte
gcp.bigtable.table.bytes_used
(gauge)
Amount of compressed data stored in a table.
Shown as byte

Events

The Google Bigtable integration does not include any events.

Service Checks

The Google Bigtable integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.