Language

English Français 日本語 한국어 Español

Datadog Site

Site help
US1 US3 US5 EU AP1 AP2 UK1 US1-FED US2-FED
This product is not supported for your selected Datadog site. ().

Get experiment results

copy Copy pageCopied

GET https://api.ap1.datadoghq.com/api/v2/experiments/{experiment_id}/resultshttps://api.ap2.datadoghq.com/api/v2/experiments/{experiment_id}/resultshttps://api.datadoghq.eu/api/v2/experiments/{experiment_id}/resultshttps://api.ddog-gov.com/api/v2/experiments/{experiment_id}/resultshttps://api.us2.ddog-gov.com/api/v2/experiments/{experiment_id}/resultshttps://api.uk1.datadoghq.com/api/v2/experiments/{experiment_id}/resultshttps://api.datadoghq.com/api/v2/experiments/{experiment_id}/resultshttps://api.us3.datadoghq.com/api/v2/experiments/{experiment_id}/resultshttps://api.us5.datadoghq.com/api/v2/experiments/{experiment_id}/results

Overview

Get an experiment’s computed results: per-variant statistical analysis for the latest successful run. A historical run cannot be selected. Unavailable analysis statistics, including p_value and confidence_interval, are omitted. The numerator, denominator, and variant_metric_value fields can be null when their values are unavailable. Do not treat an omitted or null value as zero. This endpoint requires the product_analytics_experiments_read permission.

OAuth apps require the product_analytics_experiments_read authorization scope to access this endpoint.

Arguments

Path Parameters

Name

Type

Description

experiment_id [required]

string

The UUID of the experiment.

Response

OK

List of variant result resources.

Expand All

Field

Type

Description

data [required]

[object]

Resources returned in this response.

attributes

object

Details of the variant result.

assignment_count

int64

Number of subjects assigned to this variant.

experiment_id

string

ID of the experiment associated with this result.

is_control

boolean

Whether this variant is the experiment's control.

metrics

[object]

Metrics reported for this variant.

analyses

[object]

Statistical analyses calculated for this metric and variant.

confidence_interval

object

Lower and upper bounds of the reported statistical interval.

lower

double

Lower bound of the reported interval.

upper

double

Upper bound of the reported interval.

confidence_level

double

Configured nominal confidence level. Interval bounds can use an adjusted level for multiple testing or hybrid methods.

evsi

double

Expected reduction in minimum expected regret from collecting more sample data.

expectation_above_zero

double

Expected effect when the effect is positive.

expectation_below_zero

double

Expected effect when the effect is negative.

global_lift

double

Estimated lift across the population. Calculated as metric coverage multiplied by the experiment lift.

global_lift_lower_bound

double

Lower bound of the estimated lift across the population.

global_lift_upper_bound

double

Upper bound of the estimated lift across the population.

is_cuped_adjusted

boolean

Whether CUPED used pre-experiment data to reduce variance in this result.

is_unreliable

boolean

Whether the statistical result is marked as unreliable.

lift_type

enum

Whether the reported lift is relative or absolute. Allowed enum values: RELATIVE,ABSOLUTE,UNKNOWN

method

enum

Statistical method used to calculate this result. Allowed enum values: FIXED_SAMPLE,BAYESIAN,SEQUENTIAL,SEQUENTIAL_FIXED_HYBRID,UNKNOWN

minimum_expected_regret

double

The smaller expected opportunity cost of choosing treatment or control.

p_value

double

Probability, under the no-effect hypothesis, of a result at least as extreme as the observed result.

point_estimate

double

Estimated difference between the variant and control for this metric.

probability_above_zero

double

Estimated probability that the effect is greater than zero.

probability_below_zero

double

Estimated probability that the effect is less than zero.

standard_error

double

Estimated uncertainty in the effect estimate.

unreliable_reason

enum

Reason that the statistical result is marked as unreliable. Allowed enum values: CONTROL_DENOMINATOR_NEAR_ZERO,TREATMENT_DENOMINATOR_NEAR_ZERO,CONTROL_AND_TREATMENT_DENOMINATORS_NEAR_ZERO,CONTROL_MEAN_NEAR_ZERO,ZERO_VARIANCE,UNKNOWN

variant_metric_value

double

Metric value calculated for this variant.

z_score

double

Standardized statistic used to compare the observed effect with zero.

assignment_count

int64

Number of subjects assigned to this variant.

coverage

double

Estimated share of the global metric total from the eligible population if that population received control. The estimate can exceed 1.

coverage_summary

object

Population totals and allocation used to calculate metric coverage.

control_total

double

Total metric value for the control population in the coverage calculation.

coverage

double

Estimated share of the global metric total from the eligible population if that population received control. The estimate can exceed 1.

coverage_unavailable_reason

string

Reason that metric coverage could not be calculated.

eligible_population_total

double

Estimated metric total for the eligible population if that population received control.

experiment_total

double

Total metric value for the experiment population in the coverage calculation.

global_metric_total

double

Observed metric total across subjects inside and outside the experiment.

traffic_allocation

double

Fraction of eligible traffic allocated to the experiment, weighted by time.

coverage_unavailable_reason

string

Reason that metric coverage could not be calculated.

denominator

double

Aggregated denominator value for this metric and variant.

desired_change

enum

Direction of metric change considered desirable. Allowed enum values: METRIC_INCREASES,METRIC_DECREASES,UNKNOWN

metric_id

string

ID of the metric represented by this entry.

metric_name

string

Display name of the metric represented by this entry.

numerator

double

Aggregated numerator value for this metric and variant.

sub_metric_property_name

string

Name of the property used to split this metric result.

sub_metric_property_value

string

Property value represented by this split metric result.

variant_key

string

Key that identifies the experiment variant.

variant_name

string

Display name of the experiment variant.

id [required]

string

ID of the variant result.

type [required]

enum

Experiment variant results resource type. Allowed enum values: experiment-variant-results

default: experiment-variant-results

meta

object

Information about when experiment results were updated and whether they are stale.

is_stale

boolean

Whether the saved results require a refresh or their freshness cannot be confirmed. See stale_reasons for details.

results_last_updated

date-time

Time when the experiment results were last updated.

stale_reasons

[string]

Reasons the saved experiment results are stale.

{
  "data": [
    {
      "attributes": {
        "assignment_count": "integer",
        "experiment_id": "string",
        "is_control": false,
        "metrics": [
          {
            "analyses": [
              {
                "confidence_interval": {
                  "lower": "number",
                  "upper": "number"
                },
                "confidence_level": "number",
                "evsi": "number",
                "expectation_above_zero": "number",
                "expectation_below_zero": "number",
                "global_lift": "number",
                "global_lift_lower_bound": "number",
                "global_lift_upper_bound": "number",
                "is_cuped_adjusted": false,
                "is_unreliable": false,
                "lift_type": "string",
                "method": "string",
                "minimum_expected_regret": "number",
                "p_value": "number",
                "point_estimate": "number",
                "probability_above_zero": "number",
                "probability_below_zero": "number",
                "standard_error": "number",
                "unreliable_reason": "string",
                "variant_metric_value": "number",
                "z_score": "number"
              }
            ],
            "assignment_count": "integer",
            "coverage": "number",
            "coverage_summary": {
              "control_total": "number",
              "coverage": "number",
              "coverage_unavailable_reason": "string",
              "eligible_population_total": "number",
              "experiment_total": "number",
              "global_metric_total": "number",
              "traffic_allocation": "number"
            },
            "coverage_unavailable_reason": "string",
            "denominator": "number",
            "desired_change": "METRIC_INCREASES",
            "metric_id": "string",
            "metric_name": "string",
            "numerator": "number",
            "sub_metric_property_name": "string",
            "sub_metric_property_value": "string"
          }
        ],
        "variant_key": "string",
        "variant_name": "string"
      },
      "id": "550e8400-e29b-41d4-a716-446655440000:treatment",
      "type": "experiment-variant-results"
    }
  ],
  "meta": {
    "is_stale": true,
    "results_last_updated": "2026-08-05T09:25:00Z",
    "stale_reasons": [
      "ANALYSIS_PLAN_CHANGED"
    ]
  }
}

Malformed experiment ID (not a valid UUID), or the experiment is not configured for analysis.

API error response.

Expand All

Field

Type

Description

errors [required]

[object]

A list of errors.

detail

string

A human-readable explanation specific to this occurrence of the error.

meta

object

Non-standard meta-information about the error

source

object

References to the source of the error.

header

string

A string indicating the name of a single request header which caused the error.

parameter

string

A string indicating which URI query parameter caused the error.

pointer

string

A JSON pointer to the value in the request document that caused the error.

status

string

Status code of the response.

title

string

Short human-readable summary of the error.

{
  "errors": [
    {
      "detail": "Missing required attribute in body",
      "meta": {},
      "source": {
        "header": "Authorization",
        "parameter": "limit",
        "pointer": "/data/attributes/title"
      },
      "status": "400",
      "title": "Bad Request"
    }
  ]
}

Missing or invalid authentication.

API error response.

Expand All

Field

Type

Description

errors [required]

[object]

A list of errors.

detail

string

A human-readable explanation specific to this occurrence of the error.

meta

object

Non-standard meta-information about the error

source

object

References to the source of the error.

header

string

A string indicating the name of a single request header which caused the error.

parameter

string

A string indicating which URI query parameter caused the error.

pointer

string

A JSON pointer to the value in the request document that caused the error.

status

string

Status code of the response.

title

string

Short human-readable summary of the error.

{
  "errors": [
    {
      "detail": "Missing required attribute in body",
      "meta": {},
      "source": {
        "header": "Authorization",
        "parameter": "limit",
        "pointer": "/data/attributes/title"
      },
      "status": "400",
      "title": "Bad Request"
    }
  ]
}

Authenticated caller lacks the product_analytics_experiments_read permission.

API error response.

Expand All

Field

Type

Description

errors [required]

[object]

A list of errors.

detail

string

A human-readable explanation specific to this occurrence of the error.

meta

object

Non-standard meta-information about the error

source

object

References to the source of the error.

header

string

A string indicating the name of a single request header which caused the error.

parameter

string

A string indicating which URI query parameter caused the error.

pointer

string

A JSON pointer to the value in the request document that caused the error.

status

string

Status code of the response.

title

string

Short human-readable summary of the error.

{
  "errors": [
    {
      "detail": "Missing required attribute in body",
      "meta": {},
      "source": {
        "header": "Authorization",
        "parameter": "limit",
        "pointer": "/data/attributes/title"
      },
      "status": "400",
      "title": "Bad Request"
    }
  ]
}

No experiment with this ID exists, or results are not available for it yet.

API error response.

Expand All

Field

Type

Description

errors [required]

[object]

A list of errors.

detail

string

A human-readable explanation specific to this occurrence of the error.

meta

object

Non-standard meta-information about the error

source

object

References to the source of the error.

header

string

A string indicating the name of a single request header which caused the error.

parameter

string

A string indicating which URI query parameter caused the error.

pointer

string

A JSON pointer to the value in the request document that caused the error.

status

string

Status code of the response.

title

string

Short human-readable summary of the error.

{
  "errors": [
    {
      "detail": "Missing required attribute in body",
      "meta": {},
      "source": {
        "header": "Authorization",
        "parameter": "limit",
        "pointer": "/data/attributes/title"
      },
      "status": "400",
      "title": "Bad Request"
    }
  ]
}

The experiment's metrics are incompatible with analysis.

API error response.

Expand All

Field

Type

Description

errors [required]

[object]

A list of errors.

detail

string

A human-readable explanation specific to this occurrence of the error.

meta

object

Non-standard meta-information about the error

source

object

References to the source of the error.

header

string

A string indicating the name of a single request header which caused the error.

parameter

string

A string indicating which URI query parameter caused the error.

pointer

string

A JSON pointer to the value in the request document that caused the error.

status

string

Status code of the response.

title

string

Short human-readable summary of the error.

{
  "errors": [
    {
      "detail": "Missing required attribute in body",
      "meta": {},
      "source": {
        "header": "Authorization",
        "parameter": "limit",
        "pointer": "/data/attributes/title"
      },
      "status": "400",
      "title": "Bad Request"
    }
  ]
}

Too many requests

API error response.

Expand All

Field

Type

Description

errors [required]

[string]

A list of errors.

{
  "errors": [
    "Bad Request"
  ]
}

Code Example

                  # Path parameters
export experiment_id="550e8400-e29b-41d4-a716-446655440000"
# Use a Personal Access Token or Service Access Token
export DD_BEARER_TOKEN="<PERSONAL_ACCESS_TOKEN OR SERVICE_ACCESS_TOKEN>"

# Curl command
curl -X GET "https://api.ap1.datadoghq.com"https://api.ap2.datadoghq.com"https://api.datadoghq.eu"https://api.ddog-gov.com"https://api.us2.ddog-gov.com"https://api.uk1.datadoghq.com"https://api.datadoghq.com"https://api.us3.datadoghq.com"https://api.us5.datadoghq.com/api/v2/experiments/${experiment_id}/results" \
-H "Accept: application/json" \
-H "Authorization: Bearer ${DD_BEARER_TOKEN}"