Send Logs to Observability Pipelines with Filebeat

This product is not supported for your selected Datadog site. ().
This page is not yet available in Spanish. We are working on its translation.
If you have any questions or feedback about our current translation project, feel free to reach out to us!

Overview

Use the Logstash source to send logs to Observability Pipelines with Filebeat.

Setup

  1. Set up Filebeat if you haven’t already.

  2. In the filebeat.yml file:
    a. Comment out the Elasticsearch Output configuration section.
    b. Uncomment and configure the Logstash Output section:

    # ------------------------------ Logstash Output -------------------------------
    output.logstash:
    # The Logstash hosts
    hosts: ["<OPW_HOST>:9997"]
    

    <OPW_HOST> is the host IP address or the load balancer URL associated with the Observability Pipelines Worker.

    For CloudFormation installs, use the LoadBalancerDNS CloudFormation output for the URL.

    For Kubernetes installs, you can use the internal DNS record of the Observability Pipelines Worker service. For example: opw-observability-pipelines-worker.default.svc.cluster.local.

  3. Set up a pipeline with the Logstash source.