Amazon S3 Storage Lens

Overview

Amazon S3 Storage Lens provides a single view of usage and activity across your Amazon S3 storage. You can use S3 Storage Lens to generate summary insights, such as finding out how much storage you have across your entire organization, or which are the fastest growing buckets and prefixes. Identify outliers in your storage metrics, and then drill down to further investigate the source of the spike in usage or activity.

Enable this integration to see all your S3 Storage Lens metrics in Datadog.

Setup

Installation

If you haven’t already, set up the Amazon Web Services integration first.

Metric collection

  1. Enable CloudWatch publishing for S3 Storage Lens within your AWS account. You must be using “Advanced metrics and recommendations” to use this feature.
  2. In the AWS integration page, ensure that S3 Storage Lens is enabled under the Metric Collection tab.
  3. Install the Datadog - Amazon S3 Storage Lens integration.

Note: S3 Storage Lens metrics are daily metrics and are published to CloudWatch once per day.

Data Collected

Metrics

aws.s3.storagelens.4xx_errors
(gauge)		The total number of HTTP 4xx server errors in scope.
Shown as error
aws.s3.storagelens.5xx_errors
(gauge)		The total number of HTTP 5xx server errors in scope.
Shown as error
aws.s3.storagelens.all_requests
(gauge)		The total number of HTTP requests made.
Shown as request
aws.s3.storagelens.bytes_downloaded
(gauge)		The total number bytes downloaded.
Shown as byte
aws.s3.storagelens.bytes_uploaded
(gauge)		The total number bytes uploaded.
Shown as byte
aws.s3.storagelens.current_version_object_count
(gauge)		The total number of objects that are current version.
Shown as object
aws.s3.storagelens.current_version_storage_bytes
(gauge)		The total number of bytes that are current version.
Shown as byte
aws.s3.storagelens.delete_marker_object_count
(gauge)		The total number of objects with a delete marker.
Shown as object
aws.s3.storagelens.delete_requests
(gauge)		The total number of HTTP DELETE requests made.
Shown as request
aws.s3.storagelens.encrypted_object_count
(gauge)		The total number of objects that are encrypted with S3 server-side encryption.
Shown as object
aws.s3.storagelens.encrypted_storage_bytes
(gauge)		The total number of bytes that are encrypted with S3 server-side encryption.
Shown as byte
aws.s3.storagelens.get_requests
(gauge)		The total number of HTTP GET requests made.
Shown as request
aws.s3.storagelens.head_requests
(gauge)		The total number of HTTP HEAD requests made.
Shown as request
aws.s3.storagelens.incomplete_multipart_upload_object_count
(gauge)		The total number of objects with incomplete multipart uploads.
Shown as object
aws.s3.storagelens.incomplete_multipart_upload_storage_bytes
(gauge)		The total number of bytes with incomplete multipart uploads.
Shown as byte
aws.s3.storagelens.list_requests
(gauge)		The total number of HTTP requests made that list contents.
Shown as request
aws.s3.storagelens.non_current_version_object_count
(gauge)		The total number of objects that are not current version.
Shown as object
aws.s3.storagelens.non_current_version_storage_bytes
(gauge)		The total number of bytes that are not current version.
Shown as byte
aws.s3.storagelens.object_count
(gauge)		The total number of objects.
Shown as object
aws.s3.storagelens.object_lock_enabled_object_count
(gauge)		The total number of objects with Object Lock enabled.
Shown as object
aws.s3.storagelens.object_lock_enabled_storage_bytes
(gauge)		The total number of bytes with Object Lock enabled.
Shown as byte
aws.s3.storagelens.post_requests
(gauge)		The total number of HTTP POST requests made.
Shown as request
aws.s3.storagelens.put_requests
(gauge)		The total number of HTTP PUT requests made.
Shown as request
aws.s3.storagelens.replicated_object_count
(gauge)		The total number of objects that are replicated.
Shown as object
aws.s3.storagelens.replicated_storage_bytes
(gauge)		The total number of bytes that are replicated.
Shown as byte
aws.s3.storagelens.select_requests
(gauge)		The total number of select requests made.
Shown as request
aws.s3.storagelens.select_returned_bytes
(gauge)		The total number of select bytes returned.
Shown as byte
aws.s3.storagelens.select_scanned_bytes
(gauge)		The total number of select bytes scanned.
Shown as byte
aws.s3.storagelens.storage_bytes
(gauge)		The total number of storage bytes.
Shown as byte

Events

The Amazon S3 Storage Lens integration does not include any events.

Service Checks

The Amazon S3 Storage Lens integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.

Further Reading

Additional helpful documentation, links, and articles:

Monitor and optimize S3 storage with Amazon S3 Storage Lens metricsBLOG more more