Prerequisites

• Kubernetes cluster version v1.20.X+
• Helm
• The kubectl CLI

Installation

1. Install the Datadog Operator by running the following commands:

   helm repo add datadog https://helm.datadoghq.com
   helm install my-datadog-operator datadog/datadog-operator
   

2. Create a Kubernetes Secret to store your Datadog API key.

   kubectl create secret generic datadog-secret --from-literal api-key=<DATADOG_API_KEY> --from-literal app-key=<DATADOG_APP_KEY>
   

   • Replace <DATADOG_API_KEY> with your Datadog API key.
   • Replace <DATADOG_APP_KEY> with your Datadog app key.

3. Create a file, datadog-agent.yaml, that contains the following configuration:

   kind: DatadogAgent
   apiVersion: datadoghq.com/v2alpha1
   metadata:
     name: datadog
   spec:
     features:
       apm:
         enabled: true
         hostPortConfig:
           enabled: true
           hostPort: 8126
       admissionController:
         enabled: true
         mutateUnlabelled: false
       # (Optional) Uncomment the next three lines to enable logs collection
       # logCollection:
         # enabled: true
         # containerCollectAll: true
     global:
       site: <DATADOG_SITE>
       credentials:
         apiSecret:
           secretName: datadog-secret
           keyName: api-key
         appSecret:
           secretName: datadog-secret
           keyName: app-key
     override:
       nodeAgent:
         image:
           tag: <DATADOG_AGENT_VERSION>
   

   Replace <DATADOG_SITE> with your Datadog site. Your site is . (Ensure the correct SITE is selected on the right).

   Replace <DATADOG_AGENT_VERSION> with version 7.55.0 or later.

   Optional: Uncomment the logCollection section to start collecting application logs which will be correlated to Spark job run traces. Once enabled, logs are collected from all discovered containers by default. See the Kubernetes log collection documentation for more details on the setup process.

4. Deploy the Datadog Agent with the above configuration file:

   kubectl apply -f /path/to/your/datadog-agent.yaml
   

1. Create a Kubernetes Secret to store your Datadog API key.

   kubectl create secret generic datadog-secret --from-literal api-key=<DATADOG_API_KEY> --from-literal app-key=<DATADOG_APP_KEY>
   

   • Replace <DATADOG_API_KEY> with your Datadog API key.
   • Replace <DATADOG_APP_KEY> with your Datadog app key.

2. Create a file, datadog-values.yaml, that contains the following configuration:

   datadog:
     apiKeyExistingSecret: datadog-secret
     appKeyExistingSecret: datadog-secret
     site: <DATADOG_SITE>
     apm:
       portEnabled: true
       port: 8126
     # (Optional) Uncomment the next three lines to enable logs collection
     # logs:
       # enabled: true
       # containerCollectAll: true
   
   agents:
     image:
       tag: <DATADOG_AGENT_VERSION>
   
   clusterAgent:
     admissionController:
       enabled: true
       muteUnlabelled: false
   

   Replace <DATADOG_SITE> with your Datadog site. Your site is . (Ensure the correct SITE is selected on the right).

   Replace <DATADOG_AGENT_VERSION> with version 7.55.0 or later.

   Optional: Uncomment the logs section to start collecting application logs which will be correlated to Spark job run traces. Once enabled, logs are collected from all discovered containers by default. See the Kubernetes log collection documentation for more details on the setup process.

3. Run the following command:

   helm install <RELEASE_NAME> \
    -f datadog-values.yaml \
    --set targetSystem=<TARGET_SYSTEM> \
    datadog/datadog
   

   • Replace <RELEASE_NAME> with your release name. For example, datadog-agent.

   • Replace <TARGET_SYSTEM> with the name of your OS. For example, linux or windows.