Fluentd and Fluent Bit Sources

이 제품은 선택한 Datadog 사이트에서 지원되지 않습니다. ().
이 페이지는 아직 한국어로 제공되지 않습니다. 번역 작업 중입니다.
현재 번역 프로젝트에 대한 질문이나 피드백이 있으신 경우 언제든지 연락주시기 바랍니다.
이용 가능:

Logs

Overview

Use Observability Pipelines’ Fluentd or Fluent Bit source to receive logs from the your Fluentd or Fluent Bit agent.

Prerequisites

To use Observability Pipelines’ Fluentd or Fluent Bit source, you need the following information available:

  1. The Observability Pipelines Worker listens on this bind address to receive logs from your applications. For example, 0.0.0.0:8088. Later on, you configure your applications to send logs to this address.
  2. The appropriate TLS certificates and the password you used to create your private key if your forwarders are globally configured to enable SSL.

Setup

Set up this source when you set up a pipeline. You can set up a pipeline in the UI, using the API, or with Terraform. The instructions in this section are for setting up the source in the UI.

Only enter the identifiers for the Fluent address and, if applicable, the TLS key pass. Do not enter the actual values.
  1. Enter the identifier for your Fluent address. If you leave it blank, the default is used.

Optional settings

Toggle the switch to Enable TLS.

  • If you are using Secrets Management, enter the identifier for the key pass. See Set secrets for the default used if the field is left blank.
  • The following certificate and key files are required:
    • Server Certificate Path: The path to the certificate file that has been signed by your Certificate Authority (CA) root file in DER, PEM, or CRT (X.509).
    • CA Certificate Path: The path to the certificate file that is your Certificate Authority (CA) root file in DER, PEM, or CRT (X.509).
    • Private Key Path: The path to the .key private key file that belongs to your Server Certificate Path in DER, PEM, or CRT (PKCS #8) format.
    • Notes:
      • The configuration data directory /var/lib/observability-pipelines-worker/config/ is automatically appended to the file paths. See Advanced Worker Configurations for more information.
      • The file must be readable by the observability-pipelines-worker group and user.

Set secrets

These are the defaults used for secret identifiers and environment variables.

Note: If you enter secret identifiers and then choose to use environment variables, the environment variable is the identifier entered and prepended with DD_OP. For example, if you entered PASSWORD_1 for a password identifier, the environment variable for that password is DD_OP_PASSWORD_1.

    • Fluent address identifier:
      • References the address on which the Observability Pipelines Worker listens for incoming log messages.
      • The default identifier is SOURCE_FLUENT_ADDRESS.
    • Fluent TLS passphrase identifier (when TLS is enabled):
      • The default identifier is SOURCE_FLUENT_KEY_PASS.
    • Fluent socket address and port:
      • The Observability Pipelines Worker listens on this address for incoming log messages.
      • The default environment variable is DD_OP_SOURCE_FLUENT_ADDRESS.
    • Fluent Bit TLS passphrase (when enabled):
      • The default environment variable is DD_OP_SOURCE_FLUENT_KEY_PASS.

    Send logs to the Observability Pipelines Worker over Fluent

    Fluent Bit configuration

    To configure Fluent Bit to send logs to the Observability Pipelines Worker, use the following output configuration:

    [OUTPUT]
	Name          forward
	Match         *
	# Update these to point to your Observability Pipelines Worker
	Host          127.0.0.1
	Port          24224

    Fluentd configuration

    To configure Fluentd to send logs to the Observability Pipelines Worker, use the following output configuration:

    <match *>
	  @type forward
	  <server>
		# Update these to point to your Observability Pipelines Worker
		name  local
		host  127.0.0.1
		port 24224
	  </server>
	  compress gzip
	</match>