Amazon Kinesis Data Analytics

Crawler Crawler

Overview

Amazon Kinesis Data Analytics enables you to easily transform, query, and analyze streaming data in real-time using Apache Flink.

Enable this integration to see all your Amazon Kinesis Data Analytics metrics in Datadog.

Setup

Installation

If you haven’t already, set up the Amazon Web Services integration first.

Metric collection

  1. In the AWS integration tile, ensure that KinesisAnalytics is checked under metric collection.
  2. Install the Datadog - Amazon Kinesis Data Analytics integration.

Data Collected

Metrics

aws.kinesisanalytics.bytes
(count)
The number of bytes read (per input stream) or written (per output stream).
Shown as byte
aws.kinesisanalytics.kpus
(count)
The number of Kinesis Processing Units that are used to run your stream processing application. The average number of KPUs used each hour determines the billing for your application.
Shown as unit
aws.kinesisanalytics.millis_behind_latest
(gauge)
The average duration in milliseconds behind the current time that the application was reading from the streaming source.
Shown as millisecond
aws.kinesisanalytics.millis_behind_latest.minimum
(gauge)
The minimum duration in milliseconds behind the current time that the application was reading from the streaming source.
Shown as millisecond
aws.kinesisanalytics.millis_behind_latest.maximum
(gauge)
The maximum duration in milliseconds behind the current time that the application was reading from the streaming source
Shown as millisecond
aws.kinesisanalytics.records
(count)
The number of records read (per input stream) or written (per output stream).
Shown as record
aws.kinesisanalytics.success
(count)
The number of successful delivery attempts to the destination configured for your application.
Shown as unit
aws.kinesisanalytics.success.average
(gauge)
The fraction of delivery attempts to the destination configured for your application that are successful.
Shown as fraction
aws.kinesisanalytics.input_processing_duration
(gauge)
The average time taken for an input processing Lambda function invocation performed by Kinesis Data Analytics.
Shown as millisecond
aws.kinesisanalytics.input_processing_duration.minimum
(gauge)
The minimum time taken for an input processing Lambda function invocation performed by Kinesis Data Analytics.
Shown as millisecond
aws.kinesisanalytics.input_processing_duration.maximum
(gauge)
The maximum time taken for an input processing Lambda function invocation performed by Kinesis Data Analytics.
Shown as millisecond
aws.kinesisanalytics.input_processing_ok_records
(count)
The number of records returned by the input processing Lambda function that were marked with Ok status.
Shown as record
aws.kinesisanalytics.input_processing_ok_bytes
(count)
The sum of bytes of the records returned by the input processing Lambda function that were marked with Ok status.
Shown as byte
aws.kinesisanalytics.input_processing_dropped_records
(count)
The number of records returned by the input processing Lambda function that were marked with Dropped status.
Shown as record
aws.kinesisanalytics.input_processing_processing_failed_records
(count)
The number of records returned by the input processing Lambda function that were marked with ProcessingFailed status.
Shown as record
aws.kinesisanalytics.input_processing_success
(count)
The number of successful input processing Lambda invocations by Kinesis Data Analytics.
Shown as invocation
aws.kinesisanalytics.input_processing_success.average
(gauge)
The fraction of input processing Lambda invocations that were successful.
Shown as fraction
aws.kinesisanalytics.lambda_delivery_ok_records
(count)
The number of records returned by a delivery Lambda function that were marked with Ok status.
Shown as record
aws.kinesisanalytics.lambda_delivery_delivery_failed_records
(count)
The number of records returned by a delivery Lambda function that were marked with DeliveryFailed status.
Shown as record
aws.kinesisanalytics.lambda_delivery_duration
(gauge)
The average time taken for a delivery Lambda function invocation performed by Kinesis Data Analytics.
Shown as millisecond
aws.kinesisanalytics.lambda_delivery_duration.minimum
(gauge)
The minimum time taken for a delivery Lambda function invocation performed by Kinesis Data Analytics.
Shown as millisecond
aws.kinesisanalytics.lambda_delivery_duration.maximum
(gauge)
The maximum time taken for a delivery Lambda function invocation performed by Kinesis Data Analytics.
Shown as millisecond

Events

The Amazon Kinesis Data Analytics integration does not include any events.

Service Checks

The Amazon Kinesis Data Analytics integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.