AWS Manual Setup Guide

Overview

Use this guide to manually set up the Datadog AWS Integration.

    To set up the AWS integration manually, create an IAM policy and IAM role in your AWS account, and configure the role with an AWS External ID generated in your Datadog account. This allows Datadog’s AWS account to query AWS APIs on your behalf, and pull data into your Datadog account. The sections below detail the steps for creating each of these components, and then completing the setup in your Datadog account.

    Setting up S3 Log Archives using Role Delegation is in limited availability. Contact Datadog Support to request this feature in your Datadog for Government account.

    Setup

    Generate an external ID

    1. In the AWS integration configuration page, click Add AWS Account(s), and then select Manually.
    2. Choose which AWS partition your AWS account is scoped to. The partition is either aws for commercial regions, aws-cn for China*, or aws-us-gov for GovCloud. See Partitions in the AWS documentation for more information.

    1. Select Role Delegation for the access type. Role delegation is only supported for AWS accounts scoped to AWS commercial regions.

    1. Select Role Delegation for the access type. Role delegation is only supported for AWS accounts scoped to AWS commercial or AWS GovCloud regions.

    1. Copy the AWS External ID. For more information about the external ID, read the IAM User Guide. Note: The External ID remains available and is not regenerated for 48 hours, unless explicitly changed by a user or another AWS account is added to Datadog during this period. You can return to the Add AWS Account(s) page within that time period without the External ID changing.

    Create a Datadog integration IAM role

    Datadog assumes this role to collect data on your behalf.

    1. Go to the AWS IAM Console and click Create role.
    2. Select AWS account for the trusted entity type, and Another AWS account.

    1. Enter 464622532012 as the Account ID. This is Datadog’s account ID, and grants Datadog access to your AWS data.

    1. Enter 417141415827 as the Account ID. This is Datadog’s account ID, and grants Datadog access to your AWS data.

    1. Enter 412381753143 as the Account ID. This is Datadog’s account ID, and grants Datadog access to your AWS data.

    1. If the AWS account you want to integrate is a GovCloud account, enter 065115117704 as the Account ID, otherwise enter 392588925713. This is Datadog’s account ID, and grants Datadog access to your AWS data.

    1. Select Require external ID and enter the external ID copied in the previous section. Leave Require MFA disabled. For more details, see the Access to AWS accounts owned by third parties page in the AWS documentation.
    2. Click Next.
    3. To enable resource collection, attach the AWS SecurityAudit Policy to the role.
    4. Click Next.
    5. Give the role a name such as DatadogIntegrationRole. Optionally, provide a description and add tags to the role.
    6. Click Create Role.

    Create an inline IAM policy for the Datadog integration role

    This policy defines the permissions necessary for the Datadog integration role to collect data for every AWS integration offered by Datadog. These permissions may change as new AWS services are added to this integration.

    1. Select the Datadog integration role on the IAM roles page.
    2. Click Add permissions, and select Create inline policy.
    3. Select the JSON tab.
    4. Paste the permission policies in the textbox.
      Note: Optionally, you can add Condition elements to the IAM policy. For example, conditions can be used to restrict monitoring to certain regions.
    5. Click Next.
    6. Give the policy a name such as DatadogIntegrationPolicy.
    7. Click Create policy.

    Complete the setup in Datadog

    1. Return to the manual setup section of the AWS integration configuration page.
    2. Click the I confirm that the Datadog IAM Role has been added to the AWS Account checkbox.
    3. In the Account ID section, enter your account ID without dashes; for example, 123456789012. You can find the account ID in the ARN of the Datadog integration role, which follows the format arn:aws:iam::<ACCOUNT_ID>:role/<ROLE_NAME>.
    4. In the AWS Role Name section, enter the name of the Datadog integration role previously created. Note: The role name is case sensitive and must exactly match the role name in AWS.
    5. Click Save.
    6. Wait up to 10 minutes for data to start being collected, and then view the out-of-the-box AWS Overview Dashboard to see metrics sent by your AWS services and infrastructure.
    If there is a Datadog is not authorized to perform sts:AssumeRole error, follow the troubleshooting steps recommended in the UI, or read the troubleshooting guide.

    * All use of Datadog Services in (or in connection with environments within) mainland China is subject to the disclaimer published in the Restricted Service Locations section on our website.

    Setup

    AWS

    1. In your AWS console, create an IAM user to be used by the Datadog integration with the necessary permissions.
    2. Generate an access key and secret key for the Datadog integration IAM user.

    Datadog

    1. In the AWS integration tile, click Add AWS Account, and then select Manually.
    2. Select the Access Keys tab.
    3. Choose which AWS partition your AWS account is scoped to. The partition is either aws for commercial regions, aws-cn for China*, or aws-us-gov for GovCloud. See [Partitions][9] in the AWS documentation for more information.
    4. Click the I confirm that the IAM User for the Datadog Integration has been added to the AWS Account checkbox.
    5. Enter your Account ID, AWS Access Key and AWS Secret Key.
    6. Click Save.
    7. Wait up to 10 minutes for data to start being collected, and then view the out-of-the-box AWS Overview Dashboard to see metrics sent by your AWS services and infrastructure.

    * All use of Datadog Services in (or in connection with environments within) mainland China is subject to the disclaimer published in the Restricted Service Locations section on our website.

    AWS IAM permissions

    AWS IAM permissions enable Datadog to collect metrics, tags, EventBridge events, and other data necessary to monitor your AWS environment.

    To correctly set up the AWS Integration, you must attach the relevant IAM policies to the Datadog AWS Integration IAM Role in your AWS account.

    AWS integration IAM policy

    The set of permissions necessary to use all the integrations for individual AWS services.

    The following permissions included in the policy document use wild cards such as List* and Get*. If you require strict policies, use the complete action names as listed and reference the Amazon API documentation for your respective services.

    {
    "Version": "2012-10-17",
    "Statement": [
        {
            "Action": [
                "account:GetAccountInformation",
                "account:GetContactInformation",
                "airflow:GetEnvironment",
                "airflow:ListEnvironments",
                "amplify:List*",
                "aoss:BatchGetCollection",
                "aoss:ListCollections",
                "apigateway:GET",
                "appstream:Describe*",
                "aps:DescribeRuleGroupsNamespace",
                "aps:DescribeScraper",
                "aps:DescribeWorkspace",
                "aps:ListRuleGroupsNamespaces",
                "aps:ListScrapers",
                "aps:ListWorkspaces",
                "autoscaling:Describe*",
                "backup:List*",
                "batch:DescribeJobQueues",
                "batch:DescribeSchedulingPolicies",
                "batch:ListSchedulingPolicies",
                "bcm-data-exports:GetExport",
                "bcm-data-exports:ListExports",
                "bedrock:Get*",
                "bedrock:List*",
                "budgets:ViewBudget",
                "cassandra:Select",
                "cloudfront:GetDistributionConfig",
                "cloudfront:ListDistributions",
                "cloudhsm:DescribeBackups",
                "cloudhsm:DescribeClusters",
                "cloudtrail:DescribeTrails",
                "cloudtrail:GetTrail",
                "cloudtrail:GetTrailStatus",
                "cloudtrail:ListTrails",
                "cloudtrail:LookupEvents",
                "cloudwatch:Describe*",
                "cloudwatch:Get*",
                "cloudwatch:List*",
                "codeartifact:DescribeDomain",
                "codeartifact:DescribePackageGroup",
                "codeartifact:DescribeRepository",
                "codeartifact:ListDomains",
                "codeartifact:ListPackageGroups",
                "codeartifact:ListPackages",
                "codedeploy:BatchGet*",
                "codedeploy:List*",
                "codepipeline:ListWebhooks",
                "connect:Describe*",
                "connect:List*",
                "controltower:GetLandingZone",
                "controltower:ListEnabledBaselines",
                "controltower:ListEnabledControls",
                "controltower:ListLandingZones",
                "cur:DescribeReportDefinitions",
                "datazone:GetDomain",
                "datazone:ListDomains",
                "deadline:GetBudget",
                "deadline:GetLicenseEndpoint",
                "deadline:GetQueue",
                "deadline:List*",
                "directconnect:Describe*",
                "dlm:GetLifecyclePolicies",
                "dlm:GetLifecyclePolicy",
                "docdb-elastic:GetCluster",
                "docdb-elastic:GetClusterSnapshot",
                "docdb-elastic:ListClusterSnapshots",
                "drs:Describe*",
                "dsql:GetCluster",
                "dsql:ListClusters",
                "dynamodb:Describe*",
                "dynamodb:List*",
                "ec2:Describe*",
                "ec2:Get*",
                "ecs:Describe*",
                "ecs:List*",
                "eks:Describe*",
                "eks:List*",
                "elasticache:Describe*",
                "elasticache:List*",
                "elasticfilesystem:DescribeAccessPoints",
                "elasticfilesystem:DescribeFileSystems",
                "elasticfilesystem:DescribeTags",
                "elasticloadbalancing:Describe*",
                "elasticmapreduce:Describe*",
                "elasticmapreduce:List*",
                "emr-containers:ListManagedEndpoints",
                "emr-containers:ListSecurityConfigurations",
                "emr-containers:ListVirtualClusters",
                "es:DescribeElasticsearchDomains",
                "es:ListDomainNames",
                "es:ListTags",
                "events:CreateEventBus",
                "fsx:DescribeFileSystems",
                "fsx:ListTagsForResource",
                "glacier:GetVaultNotifications",
                "glue:ListRegistries",
                "grafana:DescribeWorkspace",
                "greengrass:Get*",
                "health:DescribeAffectedEntities",
                "health:DescribeEventDetails",
                "health:DescribeEvents",
                "iam:ListAccountAliases",
                "imagebuilder:Get*",
                "imagebuilder:List*",
                "iotsitewise:Describe*",
                "iotsitewise:List*",
                "iottwinmaker:Get*",
                "iottwinmaker:ListComponentTypes",
                "iottwinmaker:ListEntities",
                "iottwinmaker:ListScenes",
                "iotwireless:Get*",
                "iotwireless:List*",
                "ivs:GetChannel",
                "ivs:GetRecordingConfiguration",
                "ivs:List*",
                "ivschat:GetLoggingConfiguration",
                "ivschat:GetRoom",
                "ivschat:ListLoggingConfigurations",
                "ivschat:ListRooms",
                "kinesis:Describe*",
                "kinesis:List*",
                "lambda:GetFunction",
                "lambda:List*",
                "launchwizard:GetDeployment",
                "launchwizard:ListDeployments",
                "lightsail:GetInstancePortStates",
                "logs:DeleteSubscriptionFilter",
                "logs:DescribeLogGroups",
                "logs:DescribeLogStreams",
                "logs:DescribeSubscriptionFilters",
                "logs:FilterLogEvents",
                "logs:PutSubscriptionFilter",
                "logs:TestMetricFilter",
                "macie2:GetAllowList",
                "macie2:GetCustomDataIdentifier",
                "macie2:GetMacieSession",
                "macie2:ListAllowLists",
                "macie2:ListCustomDataIdentifiers",
                "macie2:ListMembers",
                "managedblockchain:Get*",
                "managedblockchain:List*",
                "memorydb:Describe*",
                "mobiletargeting:Get*",
                "mobiletargeting:ListJourneys",
                "mobiletargeting:ListTemplates",
                "networkmanager:Get*",
                "networkmanager:List*",
                "oam:ListAttachedLinks",
                "oam:ListSinks",
                "organizations:Describe*",
                "organizations:List*",
                "osis:GetPipeline",
                "osis:GetPipelineBlueprint",
                "osis:ListPipelineBlueprints",
                "osis:ListPipelines",
                "pca-connector-ad:ListConnectors",
                "pca-connector-ad:ListDirectoryRegistrations",
                "pca-connector-ad:ListTemplates",
                "pca-connector-scep:ListConnectors",
                "pipes:ListPipes",
                "proton:Get*",
                "proton:List*",
                "qbusiness:Get*",
                "qbusiness:ListDataAccessors",
                "qldb:ListJournalKinesisStreamsForLedger",
                "ram:GetResourceShareInvitations",
                "rbin:GetRule",
                "rbin:ListRules",
                "rds:Describe*",
                "rds:List*",
                "redshift-serverless:List*",
                "redshift:DescribeClusters",
                "redshift:DescribeLoggingStatus",
                "resiliencehub:DescribeApp",
                "resiliencehub:DescribeAppAssessment",
                "resiliencehub:List*",
                "resource-explorer-2:GetIndex",
                "resource-explorer-2:GetManagedView",
                "resource-explorer-2:GetView",
                "resource-explorer-2:ListManagedViews",
                "resource-explorer-2:ListViews",
                "resource-groups:GetGroup",
                "resource-groups:ListGroups",
                "route53:List*",
                "rum:GetAppMonitor",
                "rum:ListAppMonitors",
                "s3-outposts:ListRegionalBuckets",
                "s3:Get*",
                "s3:ListAllMyBuckets",
                "s3:PutBucketNotification",
                "savingsplans:DescribeSavingsPlanRates",
                "savingsplans:DescribeSavingsPlans",
                "scheduler:GetSchedule",
                "scheduler:ListScheduleGroups",
                "scheduler:ListSchedules",
                "ses:Get*",
                "ses:List*",
                "signer:GetSigningProfile",
                "signer:ListSigningProfiles",
                "sms-voice:Describe*",
                "sns:GetSubscriptionAttributes",
                "sns:List*",
                "sns:Publish",
                "social-messaging:GetLinkedWhatsAppBusinessAccount",
                "social-messaging:ListLinkedWhatsAppBusinessAccounts",
                "sqs:ListQueues",
                "ssm:GetServiceSetting",
                "ssm:ListCommands",
                "states:DescribeStateMachine",
                "states:ListStateMachines",
                "support:DescribeTrustedAdvisor*",
                "support:RefreshTrustedAdvisorCheck",
                "tag:GetResources",
                "tag:GetTagKeys",
                "tag:GetTagValues",
                "timestream:DescribeEndpoints",
                "timestream:ListTables",
                "waf-regional:GetRule",
                "waf-regional:GetRuleGroup",
                "waf-regional:ListRuleGroups",
                "waf-regional:ListRules",
                "waf:GetRule",
                "waf:GetRuleGroup",
                "waf:ListRuleGroups",
                "waf:ListRules",
                "wafv2:GetIPSet",
                "wafv2:GetRegexPatternSet",
                "wafv2:GetRuleGroup",
                "wafv2:ListLoggingConfigurations",
                "workmail:DescribeOrganization",
                "workmail:ListOrganizations",
                "xray:BatchGetTraces",
                "xray:GetTraceSummaries"
            ],
            "Effect": "Allow",
            "Resource": "*"
        }
    ]
}

    AWS resource collection IAM policy

    To use resource collection, you must attach AWS’s managed SecurityAudit Policy to your Datadog IAM role.

    Notes:

    • Warning messages appear on the AWS integration tile in Datadog if you enable resource collection, but do not have the AWS Security Audit Policy attached to your Datadog IAM role.
    • To enable Datadog to collect account management resources from account.GetAlternateContact and account.GetContactInformation, you need to enable trusted access for AWS account management.
    • AWS Govcloud and AWS China accounts are not currently supported.

    Additional helpful documentation, links, and articles:

    AWS IntegrationDOCUMENTATION more more Datadog Forwarder Lambda functionDOCUMENTATION more more Send AWS service logs with the Datadog Amazon Data Firehose destinationGUIDE more more Troubleshooting the AWS integrationGUIDE more more AWS CloudWatch metric streams with Amazon Data FirehoseGUIDE more more Key metrics for AWS monitoringBLOG more more How to monitor EC2 instances with DatadogBLOG more more Monitoring AWS Lambda with DatadogBLOG more more Introducing Datadog Cloud Security Posture ManagementBLOG more more Secure your infrastructure in real time with Datadog Cloud Workload SecurityBLOG more more Announcing Datadog Security MonitoringBLOG more more Best practices for tagging your infrastructure and applicationsBLOG more more