Log Collection for Amazon EKS Audit Logs

Overview

Amazon EKS audit logs give cluster administrators insight into actions within an EKS cluster. Once you enable log collection for your Amazon EKS audit logs, you can setup and use Datadog Cloud SIEM to monitor unwarranted actions or immediate threats as they occur within your EKS cluster.

Setup

Amazon EKS audit logs

New cluster

  1. If you do not have an Amazon EKS cluster, create one by following the Creating an Amazon EKS Cluster documentation.
  2. During setup, on the Configure logging page, enable Audit logs.

Existing cluster

  1. If you already have an Amazon EKS cluster configured, navigate to your cluster in the Amazon EKS console.
  2. Click on your EKS cluster.
  3. Click the Logging tab.
  4. Click the Manage logging button.
  5. Toggle the Audit option to Enabled and click the Save changes button.

Datadog AWS integration

Next, set up the AWS integration. Follow the AWS integration setup documentation.

Datadog Forwarder

Once your AWS integration set up is complete, install and configure the Datadog Forwarder. Follow the Datadog Forwarder installation documentation.

Note: The Lambda ARN is required for the Setup triggers step. Your Lambda ARN is available by navigating to Lambda > Functions > Your_Function_Name in the AWS console. The Function ARN is listed in the Function overview.

Log Explorer

Once setup of Amazon EKS audit logs, the Datadog AWS integration, and Datadog Forwarder are complete, your EKS audit logs are available in the Datadog Log Explorer.

Note: Logs may take a few seconds to begin streaming into Log Explorer.

To view only EKS audit logs in the Log Explorer, query source:kubernetes.audit in Log Explorer search or, under Source in the facets panel, select the kubernetes.audit facet to filter by EKS audit logs.

Cloud SIEM

You can use Datadog Cloud SIEM to detect potential misconfigurations or targeted attacks to your EKS clusters.

To start monitoring your Amazon EKS audit logs with Cloud SIEM, setup Cloud SIEM and create a custom log detection rule that generates a Security Signal in the Security Signals Explorer whenever a misconfiguration or threat is detected.

Setup

Setup and configure Cloud SIEM. See the in-app Cloud SIEM setup and configuration instructions.

Once Cloud SIEM is set up and configured, you can either create a new Cloud SIEM rule from scratch or export a query in Log Explorer to a new rule.

Review Security Monitoring Rules

See out-of-the-box Cloud SIEM detection rules that are detecting threats in your environment. For more information on searching, editing, and cloning these rules, see creating and managing detection rules.

Create a new Cloud SIEM rule

To create a rule, navigate to the in-app Rule Setup and Configuration page. To complete your setup, see the Log Detection Rules documentation.

Export a query to a rule in Log Explorer

  1. In the Log Explorer, create a query in the search bar. For example, filter by source:kubernetes.audit @objectRef.resource:pods @objectRef.subresource:exec @http.method:create @http.status_code:[101 TO 299].
  2. Click the Export button and select Export to detection rule.
  3. This feature exports your query and defines it in the second step of the Log Detection rule setup. Select a detection method. In this instance, select New Value. Select the @usr.name attribute in the Detect new value dropdown menu. This alerts you for the first time when a user execs into a pod. After the first alert, Datadog won’t alert on the same user again. Alternatively, to detect when these events exceed a user-defined threshold, use threshold rule for the detection method.
  4. Follow the Log Detection Rules documentation to learn how to complete the rest of your rule configuration.