Datadog-Fluentd Integration

Fluentd Dashboard

Overview

Get metrics from Fluentd to:

  • Visualize Fluentd performance.
  • Correlate the performance of Fluentd with the rest of your applications.

Setup

Installation

The Fluentd check is packaged with the Agent, so simply install the Agent on your Fluentd servers.

Configuration

Prepare Fluentd

In your fluentd configuration, add a monitor_agent source:

<source>
  @type monitor_agent
  bind 0.0.0.0
  port 24220
</source>

Connect the Datadog Agent

Create a file fluentd.yaml in the Agent’s conf.d directory. See the sample fluentd.yaml for all available configuration options:

init_config:

instances:
  - monitor_agent_url: http://localhost:24220/api/plugins.json
    #tag_by: "type" # defaults to 'plugin_id'
    #plugin_ids:    # collect metrics only on your chosen plugin_ids (optional)
    #  - plg1
    #  - plg2

Restart the Agent to begin sending Fluentd metrics to Datadog.

Validation

Run the Agent’s info subcommand and look for fluentd under the Checks section:

  Checks
  ======
    [...]

    fluentd
    -------
      - instance #0 [OK]
      - Collected 26 metrics, 0 events & 1 service check

    [...]

Data Collected

Metrics

fluentd.retry_count
(gauge)
The number of retries for this plugin.
shown as time
fluentd.buffer_queue_length
(gauge)
The length of the buffer queue for this plugin.
shown as buffer
fluentd.buffer_total_queued_size
(gauge)
The size of the buffer queue for this plugin.
shown as byte

Events

The FluentD check does not include any event at this time.

Service Checks

fluentd.is_ok:

Returns ‘Critical’ if the Agent cannot connect to Fluentd to collect metrics. This is the check which most other integrations would call can_connect.

Troubleshooting

Need help? Contact Datadog Support.

Further Reading