Planning and Launching Experiments

이 페이지는 아직 한국어로 제공되지 않습니다. 번역 작업 중입니다.
현재 번역 프로젝트에 대한 질문이나 피드백이 있으신 경우 언제든지 연락주시기 바랍니다.

Join the Preview!

Datadog Experiments is in Preview. Complete the form to request access.

Overview

Datadog Experiments allows you to measure the causal relationship that new experiences and features have on user outcomes. Datadog Experiments uses Feature Flags to randomly allocate traffic between two or more variations, using one of the variations as a control group.

This page walks you through planning and launching your experiments.

Setup

To create, configure, and launch your experiment, complete the following steps:

Step 1 - Create your experiment

Navigate to the Experiments page in Datadog Product Analytics.
Click + Create Experiment.
Enter your experiment name and hypothesis.

The experiment creation form with fields for experiment name and hypothesis.

Step 2 - Add metrics

After you’ve created an experiment, add your primary metric and optional guardrails. See Defining Metrics for details on how to create metrics.

The metrics configuration panel with options for primary metric and guardrails.

Add a sample size calculation (optional)

After selecting your experiment’s metrics, use the optional sample size calculator to determine how small of a change your experiment can reliably detect with your current sample size.

Select the Entrypoint Event of your experiment. This specifies when in the user journey they will be enrolled into the test.
Click Run calculation to see the Minimum Detectable Effects (MDE) your experiment has on your metrics. The MDE is the smallest difference that you are able to detect between your experiment’s variants.

The Sample Size Calculator modal with the Entrypoint Event dropdown highlighted.

Step 3 - Launch your experiment

After specifying your metrics, you can launch your experiment.

Select a Feature Flag that captures the variants you want to test. If you have not yet created a feature flag, see the Getting Started with Feature Flags page.
Click Set Up Experiment on Feature Flag to specify how you want to roll out your experiment. You can either launch the experiment to all traffic, or schedule a gradual rollout.

Next steps

Defining metrics: Define the metrics you want to measure during your experiments.
Reading Experiment Results: Review and explore your experiment results.
Minimum Detectable Effects: Choose appropriately sized MDEs.