Fluentd 및 Fluent Bit 소스

이 제품은 선택한 Datadog 사이트에서 지원되지 않습니다. ().
이용 가능:

로그

개요

Observability Pipelines의 Fluentd 또는 Fluent Bit 소스를 사용하면 Fluentd 또는 Fluent Bit 에이전트로부터 로그를 수신할 수 있습니다.

전제 조건

To use Observability Pipelines’ Fluentd or Fluent Bit source, you need the following information available:

  1. The Observability Pipelines Worker listens on this bind address to receive logs from your applications. For example, 0.0.0.0:8088. Later on, you configure your applications to send logs to this address.
  2. The appropriate TLS certificates and the password you used to create your private key if your forwarders are globally configured to enable SSL.

설정

시크릿 관리: Fluent 주소에 대한 식별자와 해당하는 경우 TLS 키 암호만 입력합니다. 실제 값은 입력하지 마세요.

파이프라인을 설정할 때 이 소스를 설정하세요. 파이프라인은 UI, API 또는 Terraform을 사용하여 설정할 수 있습니다. 이 섹션의 지침은 UI에서 소스를 설정하기 위한 것입니다.

파이프라인 UI에서 Fluent 소스를 선택한 후 Fluent 주소에 대한 식별자를 입력합니다. 비워두면 기본값이 사용됩니다.

If you enter secret identifiers and then choose to use environment variables, the environment variable is the identifier entered and prepended with DD_OP_. For example, if you entered PASSWORD_1 for a password identifier, the environment variable for that password is DD_OP_PASSWORD_1.

선택적 설정

Toggle the switch to Enable TLS.

  • If you are using Secrets Management, enter the identifier for the key pass. See Secret defaults for the default used if the field is left blank.
  • Enter the following certificate and key files:
    • Server Certificate Path: The path to the certificate file that has been signed by your Certificate Authority (CA) root file in DER, PEM, or CRT (X.509).
    • (Optional) CA Certificate Path: The path to the certificate file that is your Certificate Authority (CA) root file in DER, PEM, or CRT (X.509).
    • (Optional) Private Key Path: The path to the .key private key file that belongs to your Server Certificate Path in DER, PEM, or CRT (PKCS #8) format.
    • Notes:
      • The configuration data directory /var/lib/observability-pipelines-worker/config/ is automatically appended to the file paths. See Advanced Worker Configurations for more information.
      • The file must be readable by the observability-pipelines-worker group and user.
  • (Optional) Toggle Verify certificate to require connecting clients to present a valid client certificate. This enforces mutual TLS (mTLS), where the Worker verifies the identity of each connecting client.

시크릿 기본값

These are the defaults used for secret identifiers and environment variables.

    • Fluent 주소 식별자:
      • Observability Pipelines Worker가 들어오는 로그 메시지를 수신하는 주소를 참조합니다.
      • 기본 식별자는 SOURCE_FLUENT_ADDRESS입니다.
    • Fluent TLS 암호 식별자(TLS가 활성화된 경우):
      • 기본 식별자는 SOURCE_FLUENT_KEY_PASS입니다.
    • Fluent socket address and port:
      • The Observability Pipelines Worker listens on this address for incoming log messages.
      • The default environment variable is DD_OP_SOURCE_FLUENT_ADDRESS.
    • Fluent Bit TLS passphrase (when enabled):
      • The default environment variable is DD_OP_SOURCE_FLUENT_KEY_PASS.

    Fluent를 통해 Observability Pipelines Worker로 로그 전송

    Fluent Bit configuration

    To configure Fluent Bit to send logs to the Observability Pipelines Worker, use the following output configuration:

    [OUTPUT]
	Name          forward
	Match         *
	# Update these to point to your Observability Pipelines Worker
	Host          127.0.0.1
	Port          24224

    Fluentd configuration

    To configure Fluentd to send logs to the Observability Pipelines Worker, use the following output configuration:

    <match *>
	  @type forward
	  <server>
		# Update these to point to your Observability Pipelines Worker
		name  local
		host  127.0.0.1
		port 24224
	  </server>
	  compress gzip
	</match>

    상태 메트릭

    모든 소스에서 내보내는 구성 요소 메트릭 및 소스 버퍼 메트릭은 파이프라인 사용량 메트릭 설명서를 참조하세요. Fluent 소스 메트릭별로 필터링하거나 그룹화하려면 component_type:fluent 태그를 사용하세요.