New announcements for Serverless, Network, RUM, and more from Dash!

Google Pub/Sub

Crawler Crawler

Overview

Google Cloud Pub/Sub brings the scalability, flexibility, and reliability of enterprise message-oriented middleware to the cloud.

Get metrics from Google Pub/Sub to:

  • Visualize the performance of your Pub/Sub topics and subscriptions
  • Correlate the performance of your Pub/sub topics and subscriptions with your applications

Setup

Metric collection

Installation

If you haven’t already, set up the Google Cloud Platform integration first. There are no other installation steps.

Log collection

Google Cloud Pub/Sub logs are collected with Stackdriver and sent to a Cloud Pub/Sub with a HTTP Push forwarder. If you haven’t already, set up the Cloud Pub/sub with a HTTP push forwarder.

Once this is done, export your Google Cloud Pub/Sub logs from Stackdriver to the Pub/sub:

  1. Go to the Stackdriver page and filter the Google Cloud Pub/Sub logs.
  2. Click Create Export and name the sink accordingly.
  3. Choose Cloud Pub/Sub as the destination and select the Pub/Sub that was created for that purpose. Note: The Pub/Sub can be located in a different project.
  1. Click Create and wait for the confirmation message to show up.

Data Collected

Metrics

gcp.pubsub.snapshot.backlog_bytes
(gauge)
Total byte size of the messages retained in a snapshot.
shown as byte
gcp.pubsub.snapshot.backlog_bytes_by_region
(gauge)
Total byte size of the messages retained in a snapshot, broken down by Cloud region.
shown as byte
gcp.pubsub.snapshot.config_updates_count
(count)
Cumulative count of configuration changes, grouped by operation type and result.
shown as update
gcp.pubsub.snapshot.num_messages
(gauge)
Number of messages retained in a snapshot.
shown as message
gcp.pubsub.snapshot.num_messages_by_region
(gauge)
Number of messages retained in a snapshot, broken down by Cloud region.
shown as message
gcp.pubsub.snapshot.oldest_message_age
(gauge)
Age (in seconds) of the oldest message retained in a snapshot.
shown as second
gcp.pubsub.snapshot.oldest_message_age_by_region
(gauge)
Age (in seconds) of the oldest message retained in a snapshot, broken down by Cloud region.
shown as second
gcp.pubsub.subscription.backlog_bytes
(gauge)
Approximate size of the message backlog in a subscription.
shown as byte
gcp.pubsub.subscription.byte_cost
(count)
Cost of operations per subscription measured.
shown as byte
gcp.pubsub.subscription.config_updates_count
(count)
Number of configuration changes for subscriptions.
shown as occurrence
gcp.pubsub.subscription.mod_ack_deadline_message_operation_count
(count)
Number of ModifyAckDeadline operations.
shown as operation
gcp.pubsub.subscription.mod_ack_deadline_request_count
(count)
Number of ModifyAckDeadline requests.
shown as request
gcp.pubsub.subscription.num_outstanding_messages
(gauge)
Messages delivered but not yet acknowledged.
shown as message
gcp.pubsub.subscription.num_retained_acked_messages
(gauge)
Number of acknowledged messages retained in a subscription.
shown as message
gcp.pubsub.subscription.num_retained_acked_messages_by_region
(gauge)
Number of acknowledged messages retained in a subscription, broken down by Cloud region.
shown as message
gcp.pubsub.subscription.num_unacked_messages_by_region
(gauge)
Number of unacknowledged messages in a subscription, broken down by Cloud region.
shown as message
gcp.pubsub.subscription.num_undelivered_messages
(gauge)
Messages pending to be delivered.
shown as message
gcp.pubsub.subscription.oldest_retained_acked_message_age
(gauge)
Age (in seconds) of the oldest acknowledged message retained in a subscription.
shown as second
gcp.pubsub.subscription.oldest_retained_acked_message_age_by_region
(gauge)
Age (in seconds) of the oldest acknowledged message retained in a subscription, broken down by Cloud region.
shown as second
gcp.pubsub.subscription.oldest_unacked_message_age
(gauge)
Age of the oldest unacknowledged message in a subscription.
shown as second
gcp.pubsub.subscription.oldest_unacked_message_age_by_region
(gauge)
Age (in seconds) of the oldest unacknowledged message in a subscription, broken down by Cloud region.
shown as second
gcp.pubsub.subscription.pull_ack_message_operation_count
(count)
Number of acknowledge message operations.
shown as operation
gcp.pubsub.subscription.pull_ack_request_count
(count)
Delta count of message pull acknowledgement requests.
shown as request
gcp.pubsub.subscription.pull_message_operation_count
(count)
Number of pull message operations.
shown as operation
gcp.pubsub.subscription.pull_request_count
(count)
Number of message pull requests.
shown as request
gcp.pubsub.subscription.push_request_count
(count)
Number of message push attempts.
shown as request
gcp.pubsub.subscription.push_request_latencies.avg
(gauge)
Average of push request latencies.
shown as microsecond
gcp.pubsub.subscription.push_request_latencies.samplecount
(count)
Sample Count for push request latencies.
shown as microsecond
gcp.pubsub.subscription.push_request_latencies.sumsqdev
(gauge)
Sum of Squared Deviation for push request latencies.
shown as microsecond
gcp.pubsub.subscription.retained_acked_bytes
(gauge)
Total byte size of the acknowledged messages retained in a subscription.
shown as byte
gcp.pubsub.subscription.retained_acked_bytes_by_region
(gauge)
Total byte size of the acknowledged messages retained in a subscription, broken down by Cloud region.
shown as byte
gcp.pubsub.subscription.seek_request_count
(count)
Cumulative count of seek attempts, grouped by result.
shown as request
gcp.pubsub.subscription.streaming_pull_ack_message_operation_count
(count)
Cumulative count of StreamingPull acknowledge message operations, grouped by result.
shown as operation
gcp.pubsub.subscription.streaming_pull_ack_request_count
(count)
Cumulative count of streaming pull requests with non-empty acknowledge ids, grouped by result.
shown as request
gcp.pubsub.subscription.streaming_pull_message_operation_count
(count)
Cumulative count of streaming pull message operations, grouped by result.
shown as operation
gcp.pubsub.subscription.streaming_pull_mod_ack_deadline_message_operation_count
(count)
Cumulative count of StreamingPull ModifyAckDeadline operations, grouped by result.
shown as operation
gcp.pubsub.subscription.streaming_pull_mod_ack_deadline_request_count
(count)
Cumulative count of streaming pull requests with non-empty ModifyAckDeadline fields, grouped by result.
shown as request
gcp.pubsub.subscription.streaming_pull_response_count
(count)
Cumulative count of streaming pull responses, grouped by result.
shown as response
gcp.pubsub.subscription.unacked_bytes_by_region
(gauge)
Total byte size of the unacknowledged messages in a subscription, broken down by Cloud region.
shown as byte
gcp.pubsub.topic.byte_cost
(count)
Byte cost of operations per topic.
shown as byte
gcp.pubsub.topic.config_updates_count
(count)
Number of configuration changes for topics.
shown as occurrence
gcp.pubsub.topic.message_sizes.avg
(gauge)
Average of publish message sizes.
shown as byte
gcp.pubsub.topic.message_sizes.samplecount
(count)
Sample Count for publish message sizes.
shown as byte
gcp.pubsub.topic.message_sizes.sumsqdev
(gauge)
Sum of Squared Deviation for publish message sizes.
shown as byte
gcp.pubsub.topic.num_retained_acked_messages_by_region
(gauge)
Number of acknowledged messages retained in a topic, broken down by Cloud region.
shown as message
gcp.pubsub.topic.num_unacked_messages_by_region
(gauge)
Number of unacknowledged messages in a topic, broken down by Cloud region.
shown as message
gcp.pubsub.topic.oldest_retained_acked_message_age_by_region
(gauge)
Age (in seconds) of the oldest acknowledged message retained in a topic, broken down by Cloud region.
shown as second
gcp.pubsub.topic.oldest_unacked_message_age_by_region
(gauge)
Age (in seconds) of the oldest unacknowledged message in a topic, broken down by Cloud region.
shown as second
gcp.pubsub.topic.retained_acked_bytes_by_region
(gauge)
Total byte size of the acknowledged messages retained in a topic, broken down by Cloud region.
shown as byte
gcp.pubsub.topic.send_message_operation_count
(count)
Number of publish message operations.
shown as operation
gcp.pubsub.topic.send_request_count
(count)
Number of message send requests.
shown as request
gcp.pubsub.topic.unacked_bytes_by_region
(gauge)
Total byte size of the unacknowledged messages in a topic, broken down by Cloud region.
shown as byte

Events

The Google Cloud Pub/Sub integration does not include any events.

Service Checks

The Google Cloud Pub/Sub integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.