Google Pub/Sub

개요

Google Cloud Pub/Sub는 엔터프라이즈 메시지 중심 미들웨어의 확장성, 유연성, 안정성을 클라우드에서 제공해 드립니다.

Google Pub/Sub 메트릭을 수집하면 다음을 할 수 있습니다.

  • Pub/Sub 토픽 및 구독의 성과를 시각화합니다.
  • Pub/Sub 토픽 성능 및 구독과 애플리케이션의 상관관계를 파악합니다.

설정

메트릭 수집

설치

아직 설치하지 않았다면 먼저 Google 클라우드 플랫폼 통합을 설정합니다. 그 외 다른 설치가 필요하지 않습니다.

설정

커스텀 Pub/Sub 레이블을 태그로 수집하려면 클라우드 에셋 인벤토리 권한을 활성화합니다.

로그 수집

Google Cloud Pub/Sub 로그는 Google Cloud Logging으로 수집하여 클라우드 Pub/Sub 토픽을 통해 데이터 플로우 작업으로 전송됩니다. 아직 설정하지 않았다면 Datadog 데이터 플로우 템플릿으로 로깅을 설정하세요.

해당 작업이 완료되면 Google Cloud Logging에서 Google Cloud Pub/Sub 로그를 다음 Pub/Sub 주제로 내보냅니다.

  1. Google Cloud Logging 페이지로 이동해 Google Cloud Pub/Sub 로그를 필터링하세요.

  2. Create Sink를 클릭하고 그에 따라 싱크 이름을 지정합니다.

  3. “Cloud Pub/Sub"를 대상으로 선택하고 해당 목적으로 생성된 Pub/Sub 주제를 선택합니다. 참고: Pub/Sub 주제는 다른 프로젝트에 있을 수 있습니다.

    Google Cloud Pub/Sub 로그를 Pub Sub로 내보내기

  4. Create를 클릭하고 확인 메시지가 나타날 때까지 기다립니다.

수집한 데이터

메트릭

gcp.pubsub.snapshot.backlog_bytes
(gauge)		Total byte size of the messages retained in a snapshot.
Shown as byte
gcp.pubsub.snapshot.backlog_bytes_by_region
(gauge)		Total byte size of the messages retained in a snapshot, broken down by Cloud region.
Shown as byte
gcp.pubsub.snapshot.config_updates_count
(count)		Cumulative count of configuration changes, grouped by operation type and result.
Shown as update
gcp.pubsub.snapshot.num_messages
(gauge)		Number of messages retained in a snapshot.
Shown as message
gcp.pubsub.snapshot.num_messages_by_region
(gauge)		Number of messages retained in a snapshot, broken down by Cloud region.
Shown as message
gcp.pubsub.snapshot.oldest_message_age
(gauge)		Age (in seconds) of the oldest message retained in a snapshot.
Shown as second
gcp.pubsub.snapshot.oldest_message_age_by_region
(gauge)		Age (in seconds) of the oldest message retained in a snapshot, broken down by Cloud region.
Shown as second
gcp.pubsub.subscription.ack_latencies.avg
(gauge)		Average of ack latencies.
Shown as millisecond
gcp.pubsub.subscription.ack_latencies.samplecount
(count)		Sample Count for ack latencies.
Shown as millisecond
gcp.pubsub.subscription.ack_latencies.sumsqdev
(gauge)		Sum of Squared Deviation for ack latencies.
Shown as millisecond
gcp.pubsub.subscription.ack_message_count
(count)		Cumulative count of messages acknowledged by Acknowledge requests, grouped by delivery type.
Shown as byte
gcp.pubsub.subscription.backlog_bytes
(gauge)		Approximate size of the message backlog in a subscription.
Shown as byte
gcp.pubsub.subscription.byte_cost
(count)		Cost of operations per subscription measured.
Shown as byte
gcp.pubsub.subscription.config_updates_count
(count)		Number of configuration changes for subscriptions.
Shown as occurrence
gcp.pubsub.subscription.dead_letter_message_count
(count)		Cumulative count of messages published to dead letter topic.
Shown as message
gcp.pubsub.subscription.delivery_latency_health_score
(gauge)		A score that measures the health of a subscription.
Shown as occurrence
gcp.pubsub.subscription.exactly_once_warning_count
(count)		Count of instances (acks and modacks that may have failed) that may lead to message redeliveries.
Shown as occurrence
gcp.pubsub.subscription.expired_ack_deadlines_count
(count)		Cumulative count of messages whose ack deadline expired while the messages was outstanding to a subscriber client.
Shown as message
gcp.pubsub.subscription.mod_ack_deadline_message_count
(count)		Cumulative count of messages whose deadline was updated by ModifyAckDeadline requests.
Shown as message
gcp.pubsub.subscription.mod_ack_deadline_message_operation_count
(count)		Number of ModifyAckDeadline operations.
Shown as operation
gcp.pubsub.subscription.mod_ack_deadline_request_count
(count)		Number of ModifyAckDeadline requests.
Shown as request
gcp.pubsub.subscription.num_outstanding_messages
(gauge)		Messages delivered but not yet acknowledged.
Shown as message
gcp.pubsub.subscription.num_retained_acked_messages
(gauge)		Number of acknowledged messages retained in a subscription.
Shown as message
gcp.pubsub.subscription.num_retained_acked_messages_by_region
(gauge)		Number of acknowledged messages retained in a subscription, broken down by Cloud region.
Shown as message
gcp.pubsub.subscription.num_unacked_messages_by_region
(gauge)		Number of unacknowledged messages in a subscription, broken down by Cloud region.
Shown as message
gcp.pubsub.subscription.num_undelivered_messages
(gauge)		Messages pending to be delivered.
Shown as message
gcp.pubsub.subscription.oldest_retained_acked_message_age
(gauge)		Age (in seconds) of the oldest acknowledged message retained in a subscription.
Shown as second
gcp.pubsub.subscription.oldest_retained_acked_message_age_by_region
(gauge)		Age (in seconds) of the oldest acknowledged message retained in a subscription, broken down by Cloud region.
Shown as second
gcp.pubsub.subscription.oldest_unacked_message_age
(gauge)		Age of the oldest unacknowledged message in a subscription.
Shown as second
gcp.pubsub.subscription.oldest_unacked_message_age_by_region
(gauge)		Age (in seconds) of the oldest unacknowledged message in a subscription, broken down by Cloud region.
Shown as second
gcp.pubsub.subscription.pull_ack_message_operation_count
(count)		Number of acknowledge message operations.
Shown as operation
gcp.pubsub.subscription.pull_ack_request_count
(count)		Delta count of message pull acknowledgement requests.
Shown as request
gcp.pubsub.subscription.pull_message_operation_count
(count)		Number of pull message operations.
Shown as operation
gcp.pubsub.subscription.pull_request_count
(count)		Number of message pull requests.
Shown as request
gcp.pubsub.subscription.push_request_count
(count)		Number of message push attempts.
Shown as request
gcp.pubsub.subscription.push_request_latencies.avg
(gauge)		Average of push request latencies.
Shown as microsecond
gcp.pubsub.subscription.push_request_latencies.samplecount
(count)		Sample Count for push request latencies.
Shown as microsecond
gcp.pubsub.subscription.push_request_latencies.sumsqdev
(gauge)		Sum of Squared Deviation for push request latencies.
Shown as microsecond
gcp.pubsub.subscription.retained_acked_bytes
(gauge)		Total byte size of the acknowledged messages retained in a subscription.
Shown as byte
gcp.pubsub.subscription.retained_acked_bytes_by_region
(gauge)		Total byte size of the acknowledged messages retained in a subscription, broken down by Cloud region.
Shown as byte
gcp.pubsub.subscription.seek_request_count
(count)		Cumulative count of seek attempts, grouped by result.
Shown as request
gcp.pubsub.subscription.sent_message_count
(count)		Cumulative count of messages sent by Cloud Pub/Sub to subscriber clients.
Shown as message
gcp.pubsub.subscription.streaming_pull_ack_message_operation_count
(count)		Cumulative count of StreamingPull acknowledge message operations, grouped by result.
Shown as operation
gcp.pubsub.subscription.streaming_pull_ack_request_count
(count)		Cumulative count of streaming pull requests with non-empty acknowledge ids, grouped by result.
Shown as request
gcp.pubsub.subscription.streaming_pull_message_operation_count
(count)		Cumulative count of streaming pull message operations, grouped by result.
Shown as operation
gcp.pubsub.subscription.streaming_pull_mod_ack_deadline_message_operation_count
(count)		Cumulative count of StreamingPull ModifyAckDeadline operations, grouped by result.
Shown as operation
gcp.pubsub.subscription.streaming_pull_mod_ack_deadline_request_count
(count)		Cumulative count of streaming pull requests with non-empty ModifyAckDeadline fields, grouped by result.
Shown as request
gcp.pubsub.subscription.streaming_pull_response_count
(count)		Cumulative count of streaming pull responses, grouped by result.
Shown as response
gcp.pubsub.subscription.unacked_bytes_by_region
(gauge)		Total byte size of the unacknowledged messages in a subscription, broken down by Cloud region.
Shown as byte
gcp.pubsub.topic.byte_cost
(count)		Byte cost of operations per topic.
Shown as byte
gcp.pubsub.topic.config_updates_count
(count)		Number of configuration changes for topics.
Shown as occurrence
gcp.pubsub.topic.message_sizes.avg
(gauge)		Average of publish message sizes.
Shown as byte
gcp.pubsub.topic.message_sizes.samplecount
(count)		Sample Count for publish message sizes.
Shown as byte
gcp.pubsub.topic.message_sizes.sumsqdev
(gauge)		Sum of Squared Deviation for publish message sizes.
Shown as byte
gcp.pubsub.topic.num_retained_acked_messages_by_region
(gauge)		Number of acknowledged messages retained in a topic, broken down by Cloud region.
Shown as message
gcp.pubsub.topic.num_retained_messages
(gauge)		Number of messages retained in a topic.
Shown as message
gcp.pubsub.topic.num_unacked_messages_by_region
(gauge)		Number of unacknowledged messages in a topic, broken down by Cloud region.
Shown as message
gcp.pubsub.topic.oldest_retained_acked_message_age_by_region
(gauge)		Age (in seconds) of the oldest acknowledged message retained in a topic, broken down by Cloud region.
Shown as second
gcp.pubsub.topic.oldest_retained_message_age
(gauge)		Age (in seconds) of the oldest message retained in a topic.
Shown as second
gcp.pubsub.topic.oldest_unacked_message_age_by_region
(gauge)		Age (in seconds) of the oldest unacknowledged message in a topic, broken down by Cloud region.
Shown as second
gcp.pubsub.topic.retained_acked_bytes_by_region
(gauge)		Total byte size of the acknowledged messages retained in a topic, broken down by Cloud region.
Shown as byte
gcp.pubsub.topic.retained_bytes
(gauge)		Total byte size of the messages retained in a topic.
Shown as byte
gcp.pubsub.topic.send_message_operation_count
(count)		Number of publish message operations.
Shown as operation
gcp.pubsub.topic.send_request_count
(count)		Number of message send requests.
Shown as request
gcp.pubsub.topic.send_request_latencies.avg
(gauge)		Average of topic send request latencies.
Shown as microsecond
gcp.pubsub.topic.send_request_latencies.samplecount
(count)		Sample Count for topic send request latencies.
Shown as microsecond
gcp.pubsub.topic.send_request_latencies.sumsqdev
(gauge)		Sum of Squared Deviation for topic send request latencies.
Shown as microsecond
gcp.pubsub.topic.unacked_bytes_by_region
(gauge)		Total byte size of the unacknowledged messages in a topic, broken down by Cloud region.
Shown as byte

이벤트

Google Cloud Pub/Sub 통합은 이벤트를 포함하지 않습니다.

서비스 점검

Google Cloud Pub/Sub 통합은 서비스 점검을 포함하지 않습니다.

트러블슈팅

도움이 필요하신가요? Datadog 지원팀에 문의하세요.