Messages

このページは日本語には対応しておりません。随時翻訳に取り組んでいます。
翻訳に関してご質問やご意見ございましたら、お気軽にご連絡ください。

Use the Messages feature to view Kafka messages directly and troubleshoot your data streams efficiently. You can view messages at specific offsets within Kafka. Inspecting these messages can be crucial when troubleshooting issues related to specific services or data streams.

Setup

Before diving into detailed configuration steps, here’s an overview of what’s involved in setting up the Messages feature:

Step	Description	Setup Guide
Agent setup	An agent needs Kafka consumer integration enabled, be on at least version 7.69.0, and have remote configuration enabled	Agent Setup
Verify permissions	You need a few log access permissions, which usually come standard as well as `Data Streams Monitoring Capture Messages` enabled in Datadog	Required Permissions

Agent setup

Selecting an agent

Any Datadog agent having access to Kafka can be used for setup.

If you self-host Kafka, Datadog recommends setting up Messages on one of your Kafka brokers’ agents. Otherwise, choose any one agent your producer or consumer services communicate with that has access to your Kafka cluster.

Step-by-step guide

Complete the following steps on the same Datadog agent:

1. Verify agent version

Ensure your agent is running version 7.69.0 or later.

To check your agent version, run datadog-agent version on your host.

2. Enable remote configuration

Confirm that Remote Configuration is enabled for your agent (it is typically enabled by default). Verify this setting on the Fleet Automation page and also confirm it at the organizational level from the Remote Configuration settings page.

3. Configure Kafka consumer integration

Follow the steps detailed at Kafka consumer integration documentation to configure a Datadog agent for the Kafka consumer integration.

4. Verify setup

Review agent logs for kafka_consumer entries to confirm successful configuration.
Verify data ingestion by inspecting the kafka.broker_offset metric in Datadog’s Metrics Explorer, filtering by the relevant Kafka topics.

Required permissions

You must have the following permissions enabled:

Data Streams Monitoring Capture Messages
Logs Read Index Data
Logs Read Data
Logs Live Tail

You can verify your current permissions on your Profile page.

To enable permissions, edit an existing role or create a new one on the Roles page. If you don’t have adequate access to modify roles, contact your organization’s administrator.