Google Storage

Crawler

Overview

Google Cloud Storage is unified object storage for developers and enterprises, from live data serving to data analytics/ML to data archiving.

Get metrics from Google Storage to:

Visualize the performance of your Storage services.
Correlate the performance of your Storage services with your applications.

Setup

Installation

If you haven’t already, set up the Google Cloud Platform integration first. There are no other installation steps.

Configuration

To collect custom Cloud Storage labels as tags, enable the cloud asset inventory permission.

Log collection

Google Cloud Storage logs are collected with Stackdriver and sent to a Cloud pub/sub with an HTTP push forwarder. If you haven’t already, set up a Cloud pub/sub with an HTTP push forwarder.

Once this is done, export your Google Cloud Storage logs from Stackdriver to the pub/sub:

Go to the Stackdriver page and filter the Google Cloud Storage logs.
Click Create Export and name the sink.
Choose “Cloud Pub/Sub” as the destination and select the pub/sub that was created for that purpose. Note: The pub/sub can be located in a different project.
Click Create and wait for the confirmation message to show up.

Data Collected

Metrics

gcp.storage.api.request_count (count)	Number of API calls. Shown as request
gcp.storage.network.received_bytes_count (count)	Number of bytes received over the network. Shown as byte
gcp.storage.network.sent_bytes_count (count)	Number of bytes sent over the network. Shown as byte
gcp.storage.storage.object_count (gauge)	Total number of objects per bucket. Shown as object

Events

The Google Cloud Storage integration does not include any events.

Service Checks

The Google Cloud Storage integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.

On this Page