Google Bigtable

개요

Bigtable은 Google의 NoSQL 빅데이터 데이터베이스 서비스입니다. 검색, 애널리틱스, 지도, Gmail 등 많은 주요 Google 서비스를 제공하는 데 사용되는 동일한 데이터베이스입니다.

Datadog Google Cloud Platform 통합을 사용하여 Google Bigtable에서 메트릭을 수집합니다.

설정

설치

아직 설치하지 않았다면 먼저 Google 클라우드 플랫폼 통합을 설정합니다. 그 외 다른 설치가 필요하지 않습니다.

로그 수집

Google Bigtable 로그는 Google Cloud Logging으로 수집하여 클라우드 Pub/Sub 토픽을 통해 데이터 플로우 작업으로 전송됩니다. 아직 설정하지 않았다면 Datadog 데이터 플로우 템플릿으로 로깅을 설정하세요.

해당 작업이 완료되면 Google Cloud Logging에서 Google Bigtable 로그를 다음 Pub/Sub 주제로 내보냅니다.

Google Cloud Logging 페이지로 이동해 Google Bigtable 로그를 필터링하세요.
Create Export를 클릭하고 싱크 이름을 지정하세요.
“Cloud Pub/Sub"를 대상으로 선택하고 해당 목적으로 생성된 Pub/Sub 주제를 선택합니다. 참고: Pub/Sub 주제는 다른 프로젝트에 있을 수 있습니다.
Create를 클릭하고 확인 메시지가 나타날 때까지 기다립니다.

수집한 데이터

메트릭

gcp.bigtable.backup.bytes_used (gauge)	Backup storage used. Shown as byte
gcp.bigtable.autoscaling.max_node_count (gauge)	Maximum number of nodes in an autoscaled cluster. Shown as node
gcp.bigtable.autoscaling.min_node_count (gauge)	Minimum number of nodes in an autoscaled cluster. Shown as node
gcp.bigtable.autoscaling.recommended_node_count_for_cpu (gauge)	Recommended number of nodes in an autoscaled cluster based on CPU usage. Shown as node
gcp.bigtable.autoscaling.recommended_node_count_for_storage (gauge)	Recommended number of nodes in an autoscaled cluster based on storage usage. Shown as node
gcp.bigtable.cluster.cpu_load (gauge)	CPU load of a cluster.
gcp.bigtable.cluster.cpu_load_by_app_profile_by_method_by_table (gauge)	CPU load of a cluster split by app profile, method, and table.
gcp.bigtable.cluster.cpu_load_hottest_node (gauge)	CPU load of the busiest node in a cluster.
gcp.bigtable.cluster.disk_load (gauge)	Utilization of HDD disks in a cluster.
gcp.bigtable.cluster.node_count (gauge)	Number of nodes in a cluster. Shown as node
gcp.bigtable.cluster.storage_utilization (gauge)	Storage used as a fraction of total storage capacity.
gcp.bigtable.disk.bytes_used (gauge)	Amount of compressed data for tables stored in a cluster. Shown as byte
gcp.bigtable.disk.storage_capacity (gauge)	Capacity of compressed data for tables that can be stored in a cluster. Shown as byte
gcp.bigtable.replication.latencies.avg (gauge)	Distribution of replication request latencies for a table. Shown as millisecond
gcp.bigtable.replication.latencies.samplecount (gauge)	Sample count for replication request latencies. Shown as sample
gcp.bigtable.replication.latencies.sumsqdev (gauge)	Sum of squared deviation for replication request latencies. Shown as second
gcp.bigtable.replication.latency.avg (gauge)	Distribution of replication request latencies for a table. Shown as millisecond
gcp.bigtable.replication.latency.samplecount (gauge)	Sample count for replication request latencies. Shown as sample
gcp.bigtable.replication.latency.sumsqdev (gauge)	Sum of squared deviation for replication request latencies. Shown as second
gcp.bigtable.replication.max_delay (gauge)	Upper bound for replication delay between clusters of a table. Shown as second
gcp.bigtable.server.error_count (count)	Number of server requests for a table that failed with an error. Shown as error
gcp.bigtable.server.latencies.avg (gauge)	Distribution of replication request latencies for a table. Shown as millisecond
gcp.bigtable.server.latencies.samplecount (gauge)	Sample count for replication request latencies. Shown as sample
gcp.bigtable.server.latencies.sumsqdev (gauge)	Sum of squared deviation for replication request latencies. Shown as second
gcp.bigtable.server.modified_rows_count (count)	Number of rows modified by server requests for a table. Shown as row
gcp.bigtable.server.multi_cluster_failovers_count (count)	Number of failovers during multi-cluster requests.
gcp.bigtable.server.received_bytes_count (count)	Number of uncompressed bytes of request data received by servers for a table. Shown as byte
gcp.bigtable.server.request_count (count)	Number of server requests for a table. Shown as request
gcp.bigtable.server.returned_rows_count (count)	Number of rows returned by server requests for a table. Shown as row
gcp.bigtable.server.sent_bytes_count (count)	Number of uncompressed bytes of response data sent by servers for a table. Shown as byte
gcp.bigtable.table.bytes_used (gauge)	Amount of compressed data stored in a table. Shown as byte

이벤트

Google Bigtable 통합은 이벤트를 포함하지 않습니다.

서비스 점검

Google Bigtable 통합은 서비스 점검을 포함하지 않습니다.

트러블슈팅

도움이 필요하신가요? Datadog 지원팀에 문의하세요.