Use Observability Pipelines’ OpenSearch destination to send logs to OpenSearch.

Setup

Set up the OpenSearch destination and its environment variables when you set up a pipeline. The information below is configured in the pipelines UI.

Set up the destination

1. Optionally, enter the name of the OpenSearch index. See template syntax if you want to route logs to different indexes based on specific fields in your logs.
2. Optionally, toggle the switch to enable Buffering Options.
   Note: Buffering options is in Preview. Contact your account manager to request access.
   • If left disabled, the maximum size for buffering is 500 events.
   • If enabled:
     1. Select the buffer type you want to set (Memory or Disk).
     2. Enter the buffer size and select the unit.

Set the environment variables

• OpenSearch authentication username:
  • Stored in the environment variable DD_OP_DESTINATION_OPENSEARCH_USERNAME.
• OpenSearch authentication password:
  • Stored in the environment variable DD_OP_DESTINATION_OPENSEARCH_PASSWORD.
• OpenSearch endpoint URL:
  • Stored in the environment variable DD_OP_DESTINATION_OPENSEARCH_ENDPOINT_URL.

How the destination works

Event batching

A batch of events is flushed when one of these parameters is met. See event batching for more information.