Amazon EMR Serverless

Integration version1.1.0

To find out if this integration is available in your organization, see your Datadog Integrations page or ask your organization administrator.

To initiate an exception request to enable this integration for your organization, email support@ddog-gov.com.

Overview

A serverless runtime environment for running big data frameworks like Apache Spark and Hive.

Enable this integration to see all your Amazon EMR Serverless metrics in Datadog.

Setup

Installation

If you haven’t already, set up the Amazon Web Services integration first.

Metric collection

  1. In the AWS integration tile, ensure that EMRServerless is enabled under the Metric Collection tab.
  2. Install the Datadog - Amazon EMR Serverless integration.

Data Collected

Metrics

aws.emrserverless.cancelled_jobs
(gauge)
The number of jobs in a cancelled state.
Shown as job
aws.emrserverless.cancelling_jobs
(gauge)
The number of jobs in a cancelling state.
Shown as job
aws.emrserverless.cpuallocated
(gauge)
The total number of vCPUs allocated.
Shown as core
aws.emrserverless.failed_jobs
(gauge)
The number of jobs in a failed state.
Shown as job
aws.emrserverless.failed_sessions
(gauge)
The number of sessions in a failed state.
Shown as session
aws.emrserverless.idle_worker_count
(gauge)
The number of workers that are idle.
aws.emrserverless.max_cpu_allowed
(gauge)
The maximum number of vCPUs allowed for the application.
Shown as core
aws.emrserverless.max_memory_allowed
(gauge)
The maximum amount of memory allowed for the application.
Shown as gibibyte
aws.emrserverless.max_storage_allowed
(gauge)
The maximum amount of storage allowed for the application.
Shown as gibibyte
aws.emrserverless.memory_allocated
(gauge)
The total amount of memory allocated.
Shown as gibibyte
aws.emrserverless.pending_creation_worker_count
(gauge)
The number of workers pending creation.
aws.emrserverless.pending_jobs
(gauge)
The number of jobs in a pending state.
Shown as job
aws.emrserverless.running_jobs
(gauge)
The number of jobs in a running state.
Shown as job
aws.emrserverless.running_jobs.maximum
(gauge)
The maximum number of jobs in a running state.
Shown as job
aws.emrserverless.running_jobs.minimum
(gauge)
The minimum number of jobs in a running state.
Shown as job
aws.emrserverless.running_worker_count
(gauge)
The number of workers in use by the application.
aws.emrserverless.running_worker_count.maximum
(gauge)
The maximum number of workers in use by the application.
aws.emrserverless.running_worker_count.minimum
(gauge)
The minimum number of workers in use by the application.
aws.emrserverless.scheduled_jobs
(gauge)
The number of jobs in a scheduled state.
Shown as job
aws.emrserverless.started_sessions
(gauge)
The number of sessions in a started state.
Shown as session
aws.emrserverless.starting_sessions
(gauge)
The number of sessions in a starting state.
Shown as session
aws.emrserverless.storage_allocated
(gauge)
The total amount of disk storage allocated.
Shown as gibibyte
aws.emrserverless.submitted_jobs
(gauge)
The number of jobs in a submitted state.
Shown as job
aws.emrserverless.submitted_sessions
(gauge)
The number of sessions in a submitted state.
Shown as session
aws.emrserverless.success_jobs
(gauge)
The number of jobs in a success state.
Shown as job
aws.emrserverless.terminated_sessions
(gauge)
The number of sessions in a terminated state.
Shown as session
aws.emrserverless.terminating_sessions
(gauge)
The number of sessions in a terminating state.
Shown as session
aws.emrserverless.total_worker_count
(gauge)
The number of workers available.
aws.emrserverless.worker_cpu_allocated
(gauge)
The total number of vCPU cores allocated for workers in a job run.
Shown as core
aws.emrserverless.worker_cpu_used
(gauge)
The total number of vCPU cores utilized by workers in a job run.
Shown as core
aws.emrserverless.worker_ephemeral_storage_allocated
(gauge)
The amount of ephemeral storage allocated for workers in a job run.
Shown as gibibyte
aws.emrserverless.worker_ephemeral_storage_used
(gauge)
The amount of ephemeral storage used by workers in a job run.
Shown as gibibyte
aws.emrserverless.worker_memory_allocated
(gauge)
The total amount of memory allocated for workers in a job run.
Shown as gibibyte
aws.emrserverless.worker_memory_used
(gauge)
The total amount of memory utilized by workers in a job run.
Shown as gibibyte
aws.emrserverless.worker_storage_read_bytes
(count)
The total number of bytes read from storage by workers in a job run.
Shown as byte
aws.emrserverless.worker_storage_write_bytes
(count)
The total number of bytes written to storage from workers in a job run.
Shown as byte

Events

The Amazon EMR Serverless integration does not include any events.

Service Checks

The Amazon EMR Serverless integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.