Amazon S3

Monitor S3 metrics and optimize storage costs at the prefix level with Storage Monitoring (Preview).

Overview

Amazon S3 is a highly available and scalable cloud storage service.

Enable this integration to see in Datadog all your S3 metrics.

Notes:

  • This integration requires the permission s3:GetBucketTagging to be fully enabled.
  • S3 request metrics must be enabled on the buckets themselves. For more information, see Monitoring metrics with Amazon CloudWatch.

Setup

Installation

If you haven’t already, set up the Amazon Web Services integration first.

Metric collection

  1. In the AWS integration page, ensure that S3 is enabled under the Metric Collection tab.
  2. Install the Datadog - Amazon S3 integration.

Log collection

Enable S3 access logs

  1. Go to the S3 bucket.
  2. Click Properties.
  3. Go to the Services Access Logging section and click Edit.
  4. Select Enable.
  5. Select the S3 bucket to send the logs to.

For more information, see Enabling Amazon S3 server access logging.

Send logs to Datadog

  1. If you haven’t already, set up the Datadog Forwarder Lambda function in your AWS account.

  2. Once the Lambda function is installed, there are two ways to collect your S3 access logs:

    • Automatically: S3 logs are managed automatically if you grant Datadog access with a set of permissions. See Automatically Set Up Triggers for more information on configuring automatic log collection on the Datadog Forwarder Lambda function.
    • Manually: In the AWS console, add a trigger on the S3 bucket that contains your S3 access logs. See the manual installation steps.

Manual installation steps

  1. If you haven’t already, set up the Datadog Forwarder Lambda function in your AWS account.
  2. Once set up, go to the Datadog Forwarder Lambda function. In the Function Overview section, click on Add Trigger.
  3. Select the S3 trigger for the Trigger Configuration.
  4. Select the S3 bucket that contains your S3 logs.
  5. Leave the event type as All object create events.
  6. Click Add to add the trigger to your Lambda.

Go to the Log Explorer to start exploring your logs.

For more information on collecting AWS Services logs, see Send AWS Services Logs with the Datadog Lambda Function.

Data Collected

Metrics

See metric-spec.yaml for a list of metrics provided by this integration.

Events

The Amazon S3 integration does not include any events.

Service Checks

The Amazon S3 integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.