Network Performance Monitoring is now generally available! Network Monitoring is now available!

Fluent Bit

Overview

Configure Fluent Bit to collect, parse, and forward log data from several different sources to Datadog for monitoring. Fluent Bit has a small memory footprint (~450 KB), so you can use it to collect logs in environments with limited resources, such as containerized services and embedded Linux systems. Datadog’s Fluent Bit output plugin supports Fluent Bit v1.3.0+.

Setup

Log collection

Before you begin, you need to have a Datadog account, a Datadog API key, and you need to activate Datadog Logs Management.

  1. Install and configure Fluent Bit by using their reccomended method of a configuration file.
  2. Update your Fluent Bit configuration file to add Datadog as an output plugin. For more information on the configuration parameters, see the Configuration parameters table. For an example [OUTPUT] configuration section, see the Configuration file example.
  3. Once you start sending logs from Fluent Bit, verify the logs on the Datadog Logs Explorer page.

Configuration parameters

KeyDescriptionDefault
HostRequired - The Datadog server where you are sending your logs.US - http-intake.logs.datadoghq.com, EU - http-intake.logs.datadoghq.eu
TLSRequired - End-to-end security communications security protocol. Datadog recommends setting this to on.off
apikeyRequired - Your Datadog API key.
dd_serviceRecommended - The human readable name for your service generating the logs - the name of your application or database.
dd_sourceRecommended - A human readable name for the underlying technology of your service. For example, postgres or nginx.
dd_tagsOptional - The tags you want to assign to your logs in Datadog.

Configuration file example

[OUTPUT]
    Name        datadog
    Match       *
    Host        http-intake.logs.datadoghq.com
    TLS         on
    apikey      <my-datadog-api-key>
    dd_service  <my-app-service>
    dd_source   <my-app-source>
    dd_tags     team:logs,foo:bar

Troubleshooting

Need help? Contact Datadog support.

Further Reading

Additional helpful documentation, links, and articles: