Amazon Bedrock

Overview

Amazon Bedrock is a fully managed service that makes foundation models (FMs) from Amazon and leading AI startups available through an API, so you can choose from various FMs to find the model that’s best suited for your use case.

Enable this integration to see all your Bedrock metrics in Datadog.

Setup

Installation

If you haven’t already, set up the Amazon Web Services integration first.

Metric collection

In the AWS integration page, ensure that Bedrock is enabled under the Metric Collection tab.
Install the Datadog - Amazon Bedrock integration.

Data Collected

Metrics

aws.bedrock.content_filtered_count (count)	The total number of times the text output content was filtered. Shown as time
aws.bedrock.input_token_count (gauge)	The average number of input tokens used in prompts invoked for a model. Shown as token
aws.bedrock.input_token_count.maximum (gauge)	The maximum number of input tokens used in prompts invoked for a model. Shown as token
aws.bedrock.input_token_count.minimum (gauge)	The minimum number of input tokens used in prompts invoked for a model. Shown as token
aws.bedrock.input_token_count.sum (count)	The total number of input tokens used in prompts invoked for a model. Shown as token
aws.bedrock.invocation_client_errors (count)	The number of client invocation errors. Shown as error
aws.bedrock.invocation_latency (gauge)	Average latency of the invocations in milliseconds. Shown as millisecond
aws.bedrock.invocation_latency.maximum (gauge)	The maximum invocation latency over a 1 minute period. Shown as millisecond
aws.bedrock.invocation_latency.minimum (gauge)	The minimum invocation latency over a 1 minute period. Shown as millisecond
aws.bedrock.invocation_latency.p90 (gauge)	The 90th percentile of invocation latency over a 1 minute period. Shown as millisecond
aws.bedrock.invocation_latency.p95 (gauge)	The 95th percentile of invocation latency over a 1 minute period. Shown as millisecond
aws.bedrock.invocation_latency.p99 (gauge)	The 99th percentile of invocation latency over a 1 minute period. Shown as millisecond
aws.bedrock.invocation_server_errors (count)	The number of server invocation errors. Shown as error
aws.bedrock.invocation_throttles (count)	The number of invocation throttles. Shown as throttle
aws.bedrock.invocations (count)	The number of invocations sent to a model endpoint. Shown as invocation
aws.bedrock.output_image_count (gauge)	The average number of output images returned by model invocations over a 1 minute period. Shown as item
aws.bedrock.output_token_count (gauge)	The average number of output tokens returned by model invocations over a 1 minute period. Shown as token
aws.bedrock.output_token_count.maximum (gauge)	The maximum number of output tokens returned by model invocations over a 1 minute period. Shown as token
aws.bedrock.output_token_count.minimum (gauge)	The minimum number of output tokens returned by model invocations over a 1 minute period. Shown as token
aws.bedrock.output_token_count.sum (count)	The total number of output tokens returned by all model invocations. Shown as token

Events

The Amazon Bedrock integration does not include any events.

Service Checks

The Amazon Bedrock integration does not include any service checks.

Troubleshooting

Need help? Contact Datadog support.