Datadog Synthetics is now available!

AWS VPC

Crawler Crawler

Overview

Amazon Virtual Private Cloud (Amazon VPC) enables you to launch AWS resources into your virtual network. VPC Flow Logs is a feature that allows you to capture information about the IP traffic going to and from network interfaces in your VPC.

Setup

Installation

The Amazon Web Services integration must be set up in Datadog.

Metric collection

There are no additional steps required to collect AWS VPC metrics.

Log Collection

Enable VPC Flow log logging

VPC flow logs can be sent to an S3 bucket or a Cloudwatch Log group. Click on the VPC you want to monitor in the list, then choose Create Flow logs in the Flow Logs tab at the bottom of the screen:

flow logs

Select the All filter to get both accepted and rejected connections, then select the appropriate S3 bucket or the Log Group:

flow logs creation

Note: Specify vpc as prefix for the S3 file or CloudWatch log group names in order to have the Lambda automatically set the vpc source on the logs.

Send Logs to Datadog
  1. If you haven’t already, set up the Datadog log collection AWS Lambda function.

  2. Once the Lambda function is installed, manually add a trigger on the S3 bucket or Cloudwatch Log Group that contains your VPC flow logs via the AWS console. Then, in your Lambda, click on S3 or CloudWatch in the trigger list:

    S3 trigger configuration

    Configure your trigger by choosing the S3 bucket that contains your AWS VPC logs, then change the event type to Object Created (All). Finally, click on the add button.

    S3 lambda trigger

When finished, use the Datadog Log Explorer to view your logs.

Data Collected

Metrics

aws.vpc.flowlogs.action
(count)
ACCEPT or REJECT if the traffic was permitted or not by the securtiy groups or network ACLs
aws.vpc.flowlogs.bytes.per_request.max
(gauge)
The maximum number of bytes transferred per request during the capture window
shown as byte
aws.vpc.flowlogs.bytes.per_request.median
(gauge)
The median number of bytes transferred per request during the capture window
shown as byte
aws.vpc.flowlogs.bytes.per_request.min
(gauge)
The minimum number of bytes transferred per request during the capture window
shown as byte
aws.vpc.flowlogs.bytes.per_request.p90
(gauge)
The 90th percentile number of bytes transferred per request during the capture window
shown as byte
aws.vpc.flowlogs.bytes.per_request.p95
(gauge)
The 95th percentile number of bytes transferred per request during the capture window
shown as byte
aws.vpc.flowlogs.bytes.per_request.p99
(gauge)
The 99th percentile number of bytes transferred per request during the capture window
shown as byte
aws.vpc.flowlogs.bytes.total
(count)
The total number of bytes transferred during the capture window
shown as byte
aws.vpc.flowlogs.duration.per_request.max
(gauge)
The maximum duration per request during the capture window
shown as second
aws.vpc.flowlogs.duration.per_request.median
(gauge)
The median duration per request during the capture window
shown as second
aws.vpc.flowlogs.duration.per_request.min
(gauge)
The minimum duration per request during the capture window
shown as second
aws.vpc.flowlogs.duration.per_request.p90
(gauge)
The 90th percentile duration per request during the capture window
shown as second
aws.vpc.flowlogs.duration.per_request.p95
(gauge)
The 95th percentile duration per request during the capture window
shown as second
aws.vpc.flowlogs.duration.per_request.p99
(gauge)
The 99th percentile duration per request during the capture window
shown as second
aws.vpc.flowlogs.log_status
(count)
The logging status of the flow log: OK NODATA or SKIPDATA
aws.vpc.flowlogs.packets.per_request.max
(gauge)
The maximum number of packets transferred per request during the capture window
shown as packet
aws.vpc.flowlogs.packets.per_request.median
(gauge)
The median number of packets transferred per request during the capture window
shown as packet
aws.vpc.flowlogs.packets.per_request.min
(gauge)
The minimum number of packets transferred per request during the capture window
shown as packet
aws.vpc.flowlogs.packets.per_request.p90
(gauge)
The 90th percentile number of packets transferred per request during the capture window
shown as packet
aws.vpc.flowlogs.packets.per_request.p95
(gauge)
The 95th percentile number of packets transferred per request during the capture window
shown as packet
aws.vpc.flowlogs.packets.per_request.p99
(gauge)
The 99th percentile number of packets transferred per request during the capture window
shown as packet
aws.vpc.flowlogs.packets.total
(count)
The total number of packets transferred during the capture window
shown as packet

Each of the metrics retrieved from AWS is assigned the same tags that appear in the AWS console, including but not limited to host name, security-groups, and more.

Events

The AWS VPC integration does not include any events.

Service Checks

The AWS VPC integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.