AWS Storage Gateway

Overview

AWS Storage Gateway provides seamless and secure integration between an organization’s IT environment and AWS’s storage infrastructure.

Enable this integration to see in Datadog all your Storage Gateway metrics.

Setup

Installation

If you haven’t already, set up the Amazon Web Services integration first.

Metric collection

  1. In the AWS integration page, ensure that StorageGateway is enabled under the Metric Collection tab.
  2. Install the Datadog - AWS Storage Gateway integration.

Log collection

Enable logging

Configure AWS Storage Gateway to send logs either to a S3 bucket or to CloudWatch.

Note: If you log to a S3 bucket, make sure that amazon_storage_gateway is set as Target prefix.

Send logs to Datadog

  1. If you haven’t already, set up the Datadog Forwarder Lambda function.

  2. Once the Lambda function is installed, manually add a trigger on the S3 bucket or CloudWatch log group that contains your AWS Storage Gateway logs in the AWS console:

Data Collected

Metrics

aws.storagegateway.cache_hit_percent
(gauge)
Percent of application reads served from the cache.
Shown as percent
aws.storagegateway.cache_percent_dirty
(gauge)
Percent of the gateway's cache that has not been persisted to AWS.
Shown as percent
aws.storagegateway.cache_percent_used
(gauge)
Percent use of the gateway's cache storage.
Shown as percent
aws.storagegateway.cloud_bytes_downloaded
(count)
The total number of compressed bytes that the gateway downloaded from AWS.
Shown as byte
aws.storagegateway.cloud_bytes_uploaded
(count)
The total number of compressed bytes that the gateway uploaded to AWS.
Shown as byte
aws.storagegateway.cloud_download_latency
(gauge)
The total number of milliseconds spent reading data from AWS.
Shown as millisecond
aws.storagegateway.queued_writes
(count)
The number of bytes waiting to be written to AWS. These bytes are kept in your gateway's working storage.
Shown as byte
aws.storagegateway.read_bytes
(count)
The total number of bytes read from your on-premises applications in the reporting period for all volumes in the gateway.
Shown as byte
aws.storagegateway.read_time
(gauge)
The total number of milliseconds spent to do read operations from your on-premises applications for all volumes in the gateway.
Shown as millisecond
aws.storagegateway.time_since_last_recovery_point
(gauge)
The time since the last available recovery point.
Shown as second
aws.storagegateway.total_cache_size
(gauge)
The total size of the cache in bytes. This metric applies only to the gateway-cached volume setup.
Shown as byte
aws.storagegateway.upload_buffer_free
(gauge)
The total amount of unused space in the gateway's upload buffer.
Shown as byte
aws.storagegateway.upload_buffer_percent_used
(gauge)
Percent use of the gateway's upload buffer.
Shown as percent
aws.storagegateway.upload_buffer_used
(gauge)
The total number of bytes being used in the gateway's upload buffer.
Shown as byte
aws.storagegateway.working_storage_free
(gauge)
The total amount of unused space in the gateway's working storage.
Shown as byte
aws.storagegateway.working_storage_percent_used
(gauge)
Percent use of the gateway's upload buffer.
Shown as percent
aws.storagegateway.working_storage_used
(gauge)
The total number of bytes being used in the gateway's upload buffer.
Shown as byte
aws.storagegateway.write_bytes
(count)
The total number of bytes written to your on-premises applications for all volumes in the gateway.
Shown as byte
aws.storagegateway.write_time
(gauge)
The total number of milliseconds spent to do write operations from your on-premises applications for all volumes in the gateway.
Shown as millisecond

Each of the metrics retrieved from AWS are assigned the same tags that appear in the AWS console, including but not limited to host name, security-groups, and more.

Events

The AWS Storage Gateway integration does not include any events.

Service Checks

The AWS Storage Gateway integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.