--- title: Aggregate tests events description: Datadog, the leading service for cloud-scale monitoring. breadcrumbs: Docs > API Reference > CI Visibility Tests --- # Aggregate tests events{% #aggregate-tests-events %} Copy pageCopied {% tab title="v2" %} | Datadog site | API endpoint | | ----------------- | ---------------------------------------------------------------------- | | ap1.datadoghq.com | POST https://api.ap1.datadoghq.com/api/v2/ci/tests/analytics/aggregate | | ap2.datadoghq.com | POST https://api.ap2.datadoghq.com/api/v2/ci/tests/analytics/aggregate | | app.datadoghq.eu | POST https://api.datadoghq.eu/api/v2/ci/tests/analytics/aggregate | | app.ddog-gov.com | POST https://api.ddog-gov.com/api/v2/ci/tests/analytics/aggregate | | us2.ddog-gov.com | POST https://api.us2.ddog-gov.com/api/v2/ci/tests/analytics/aggregate | | app.datadoghq.com | POST https://api.datadoghq.com/api/v2/ci/tests/analytics/aggregate | | us3.datadoghq.com | POST https://api.us3.datadoghq.com/api/v2/ci/tests/analytics/aggregate | | us5.datadoghq.com | POST https://api.us5.datadoghq.com/api/v2/ci/tests/analytics/aggregate | ### Overview The API endpoint to aggregate CI Visibility test events into buckets of computed metrics and timeseries. This endpoint requires any of the following permissions: `ci_visibility_read``test_optimization_read` OAuth apps require the `test_optimization_read` authorization [scope](https://docs.datadoghq.com/api/latest/scopes.md#ci-visibility-tests) to access this endpoint. ### Request #### Body Data (required) {% tab title="Model" %} | Parent field | Field | Type | Description | | ------------ | ----------------------------- | ------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------- | | | compute | [object] | The list of metrics or timeseries to compute for the retrieved buckets. | | compute | aggregation [*required*] | enum | An aggregation function. Allowed enum values: `count,cardinality,pc75,pc90,pc95,pc98,pc99,sum,min,max` | | compute | interval | string | The time buckets' size (only used for type=timeseries) Defaults to a resolution of 150 points. | | compute | metric | string | The metric to use. | | compute | type | enum | The type of compute. Allowed enum values: `timeseries,total` | | | filter | object | The search and filter query settings. | | filter | from | string | The minimum time for the requested events; supports date, math, and regular timestamps (in milliseconds). | | filter | query | string | The search query following the CI Visibility Explorer search syntax. | | filter | to | string | The maximum time for the requested events, supports date, math, and regular timestamps (in milliseconds). | | | group_by | [object] | The rules for the group-by. | | group_by | facet [*required*] | string | The name of the facet to use (required). | | group_by | histogram | object | Used to perform a histogram computation (only for measure facets). At most, 100 buckets are allowed, the number of buckets is `(max - min)/interval`. | | histogram | interval [*required*] | double | The bin size of the histogram buckets. | | histogram | max [*required*] | double | The maximum value for the measure used in the histogram (values greater than this one are filtered out). | | histogram | min [*required*] | double | The minimum value for the measure used in the histogram (values smaller than this one are filtered out). | | group_by | limit | int64 | The maximum buckets to return for this group-by. | | group_by | missing | | The value to use for logs that don't have the facet used to group-by. | | missing | Option 1 | string | The missing value to use if there is a string valued facet. | | missing | Option 2 | double | The missing value to use if there is a number valued facet. | | group_by | sort | object | A sort rule. The `aggregation` field is required when `type` is `measure`. | | sort | aggregation | enum | An aggregation function. Allowed enum values: `count,cardinality,pc75,pc90,pc95,pc98,pc99,sum,min,max` | | sort | metric | string | The metric to sort by (only used for `type=measure`). | | sort | order | enum | The order to use, ascending or descending. Allowed enum values: `asc,desc` | | sort | type | enum | The type of sorting algorithm. Allowed enum values: `alphabetical,measure` | | group_by | total | | A resulting object to put the given computes in over all the matching records. | | total | Option 1 | boolean | If set to true, creates an additional bucket labeled "$facet_total". | | total | Option 2 | string | A string to use as the key value for the total bucket. | | total | Option 3 | double | A number to use as the key value for the total bucket. | | | options | object | Global query options that are used during the query. Only supply timezone or time offset, not both. Otherwise, the query fails. | | options | time_offset | int64 | The time offset (in seconds) to apply to the query. | | options | timezone | string | The timezone can be specified as GMT, UTC, an offset from UTC (like UTC+1), or as a Timezone Database identifier (like America/New_York). | {% /tab %} {% tab title="Example" %} ```json { "compute": [ { "aggregation": "count", "metric": "@test.is_flaky", "type": "total" } ], "filter": { "from": "now-15m", "query": "@language:(python OR go)", "to": "now" }, "group_by": [ { "facet": "@git.branch", "limit": 10, "sort": { "order": "asc" }, "total": false } ], "options": { "timezone": "GMT" } } ``` {% /tab %} ### Response {% tab title="200" %} OK {% tab title="Model" %} The response object for the test events aggregate API endpoint. | Parent field | Field | Type | Description | | -------------------- | ---------- | ------------- | ----------------------------------------------------------------------------------------------------------------------------------------- | | | data | object | The query results. | | data | buckets | [object] | The list of matching buckets, one item per bucket. | | buckets | by | object | The key-value pairs for each group-by. | | additionalProperties | | | The values for each group-by. | | buckets | computes | object | A map of the metric name to value for regular compute, or a list of values for a timeseries. | | additionalProperties | | | A bucket value, can either be a timeseries or a single value. | | | Option 1 | string | A single string value. | | | Option 2 | double | A single number value. | | | Option 3 | [object] | A timeseries array. | | Option 3 | time | date-time | The time value for this point. | | Option 3 | value | double | The value for this point. | | | links | object | Links attributes. | | links | next | string | Link for the next set of results. The request can also be made using the POST endpoint. | | | meta | object | The metadata associated with a request. | | meta | elapsed | int64 | The time elapsed in milliseconds. | | meta | page | object | Paging attributes. | | page | after | string | The cursor to use to get the next results, if any. To make the next request, use the same parameters with the addition of `page[cursor]`. | | meta | request_id | string | The identifier of the request. | | meta | status | enum | The status of the response. Allowed enum values: `done,timeout` | | meta | warnings | [object] | A list of warnings (non-fatal errors) encountered. Partial results may return if warnings are present in the response. | | warnings | code | string | A unique code for this type of warning. | | warnings | detail | string | A detailed explanation of this specific warning. | | warnings | title | string | A short human-readable summary of the warning. | {% /tab %} {% tab title="Example" %} ```json { "data": { "buckets": [ { "by": { "": "undefined" }, "computes": { "": { "description": "undefined", "type": "undefined" } } } ] }, "links": { "next": "https://app.datadoghq.com/api/v2/ci/tests/events?filter[query]=foo\u0026page[cursor]=eyJzdGFydEF0IjoiQVFBQUFYS2tMS3pPbm40NGV3QUFBQUJCV0V0clRFdDZVbG8zY3pCRmNsbHJiVmxDWlEifQ==" }, "meta": { "elapsed": 132, "page": { "after": "eyJzdGFydEF0IjoiQVFBQUFYS2tMS3pPbm40NGV3QUFBQUJCV0V0clRFdDZVbG8zY3pCRmNsbHJiVmxDWlEifQ==" }, "request_id": "MWlFUjVaWGZTTTZPYzM0VXp1OXU2d3xLSVpEMjZKQ0VKUTI0dEYtM3RSOFVR", "status": "done", "warnings": [ { "code": "unknown_index", "detail": "indexes: foo, bar", "title": "One or several indexes are missing or invalid, results hold data from the other indexes" } ] } } ``` {% /tab %} {% /tab %} {% tab title="400" %} Bad Request {% tab title="Model" %} API error response. | Field | Type | Description | | ------------------------ | -------- | ----------------- | | errors [*required*] | [string] | A list of errors. | {% /tab %} {% tab title="Example" %} ```json { "errors": [ "Bad Request" ] } ``` {% /tab %} {% /tab %} {% tab title="403" %} Not Authorized {% tab title="Model" %} API error response. | Field | Type | Description | | ------------------------ | -------- | ----------------- | | errors [*required*] | [string] | A list of errors. | {% /tab %} {% tab title="Example" %} ```json { "errors": [ "Bad Request" ] } ``` {% /tab %} {% /tab %} {% tab title="429" %} Too many requests {% tab title="Model" %} API error response. | Field | Type | Description | | ------------------------ | -------- | ----------------- | | errors [*required*] | [string] | A list of errors. | {% /tab %} {% tab title="Example" %} ```json { "errors": [ "Bad Request" ] } ``` {% /tab %} {% /tab %} ### Code Example ##### \## default # \# Curl command curl -X POST "https://api.datadoghq.com/api/v2/ci/tests/analytics/aggregate" \ -H "Accept: application/json" \ -H "Content-Type: application/json" \ -H "DD-API-KEY: ${DD_API_KEY}" \ -H "DD-APPLICATION-KEY: ${DD_APP_KEY}" \ -d @- << EOF { "compute": [ { "aggregation": "pc90", "interval": "5m", "metric": "@duration", "type": "timeseries" } ], "filter": { "from": "now-15m", "query": "@test.service:web-tests AND @test.status:fail", "to": "now" }, "group_by": [ { "facet": "@test.service", "histogram": { "interval": 10, "max": 100, "min": 50 }, "sort": { "aggregation": "count", "order": "asc" } } ], "options": { "timezone": "GMT" } } EOF ##### ```go // Aggregate tests events returns "OK" response package main import ( "context" "encoding/json" "fmt" "os" "github.com/DataDog/datadog-api-client-go/v2/api/datadog" "github.com/DataDog/datadog-api-client-go/v2/api/datadogV2" ) func main() { body := datadogV2.CIAppTestsAggregateRequest{ Compute: []datadogV2.CIAppCompute{ { Aggregation: datadogV2.CIAPPAGGREGATIONFUNCTION_COUNT, Metric: datadog.PtrString("@test.is_flaky"), Type: datadogV2.CIAPPCOMPUTETYPE_TOTAL.Ptr(), }, }, Filter: &datadogV2.CIAppTestsQueryFilter{ From: datadog.PtrString("now-15m"), Query: datadog.PtrString("@language:(python OR go)"), To: datadog.PtrString("now"), }, GroupBy: []datadogV2.CIAppTestsGroupBy{ { Facet: "@git.branch", Limit: datadog.PtrInt64(10), Sort: &datadogV2.CIAppAggregateSort{ Order: datadogV2.CIAPPSORTORDER_ASCENDING.Ptr(), }, Total: &datadogV2.CIAppGroupByTotal{ CIAppGroupByTotalBoolean: datadog.PtrBool(false)}, }, }, Options: &datadogV2.CIAppQueryOptions{ Timezone: datadog.PtrString("GMT"), }, } ctx := datadog.NewDefaultContext(context.Background()) configuration := datadog.NewConfiguration() apiClient := datadog.NewAPIClient(configuration) api := datadogV2.NewCIVisibilityTestsApi(apiClient) resp, r, err := api.AggregateCIAppTestEvents(ctx, body) if err != nil { fmt.Fprintf(os.Stderr, "Error when calling `CIVisibilityTestsApi.AggregateCIAppTestEvents`: %v\n", err) fmt.Fprintf(os.Stderr, "Full HTTP response: %v\n", r) } responseContent, _ := json.MarshalIndent(resp, "", " ") fmt.Fprintf(os.Stdout, "Response from `CIVisibilityTestsApi.AggregateCIAppTestEvents`:\n%s\n", responseContent) } ``` #### Instructions First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=go) and then save the example to `main.go` and run following commands: DD_SITE="datadoghq.com" DD_API_KEY="" DD_APP_KEY="" go run "main.go" ##### ```java // Aggregate tests events returns "OK" response import com.datadog.api.client.ApiClient; import com.datadog.api.client.ApiException; import com.datadog.api.client.v2.api.CiVisibilityTestsApi; import com.datadog.api.client.v2.model.CIAppAggregateSort; import com.datadog.api.client.v2.model.CIAppAggregationFunction; import com.datadog.api.client.v2.model.CIAppCompute; import com.datadog.api.client.v2.model.CIAppComputeType; import com.datadog.api.client.v2.model.CIAppGroupByTotal; import com.datadog.api.client.v2.model.CIAppQueryOptions; import com.datadog.api.client.v2.model.CIAppSortOrder; import com.datadog.api.client.v2.model.CIAppTestsAggregateRequest; import com.datadog.api.client.v2.model.CIAppTestsAnalyticsAggregateResponse; import com.datadog.api.client.v2.model.CIAppTestsGroupBy; import com.datadog.api.client.v2.model.CIAppTestsQueryFilter; import java.util.Collections; public class Example { public static void main(String[] args) { ApiClient defaultClient = ApiClient.getDefaultApiClient(); CiVisibilityTestsApi apiInstance = new CiVisibilityTestsApi(defaultClient); CIAppTestsAggregateRequest body = new CIAppTestsAggregateRequest() .compute( Collections.singletonList( new CIAppCompute() .aggregation(CIAppAggregationFunction.COUNT) .metric("@test.is_flaky") .type(CIAppComputeType.TOTAL))) .filter( new CIAppTestsQueryFilter() .from("now-15m") .query("@language:(python OR go)") .to("now")) .groupBy( Collections.singletonList( new CIAppTestsGroupBy() .facet("@git.branch") .limit(10L) .sort(new CIAppAggregateSort().order(CIAppSortOrder.ASCENDING)) .total(new CIAppGroupByTotal(false)))) .options(new CIAppQueryOptions().timezone("GMT")); try { CIAppTestsAnalyticsAggregateResponse result = apiInstance.aggregateCIAppTestEvents(body); System.out.println(result); } catch (ApiException e) { System.err.println("Exception when calling CiVisibilityTestsApi#aggregateCIAppTestEvents"); System.err.println("Status code: " + e.getCode()); System.err.println("Reason: " + e.getResponseBody()); System.err.println("Response headers: " + e.getResponseHeaders()); e.printStackTrace(); } } } ``` #### Instructions First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=java) and then save the example to `Example.java` and run following commands: DD_SITE="datadoghq.com" DD_API_KEY="" DD_APP_KEY="" java "Example.java" ##### ```python """ Aggregate tests events returns "OK" response """ from datadog_api_client import ApiClient, Configuration from datadog_api_client.v2.api.ci_visibility_tests_api import CIVisibilityTestsApi from datadog_api_client.v2.model.ci_app_aggregate_sort import CIAppAggregateSort from datadog_api_client.v2.model.ci_app_aggregation_function import CIAppAggregationFunction from datadog_api_client.v2.model.ci_app_compute import CIAppCompute from datadog_api_client.v2.model.ci_app_compute_type import CIAppComputeType from datadog_api_client.v2.model.ci_app_query_options import CIAppQueryOptions from datadog_api_client.v2.model.ci_app_sort_order import CIAppSortOrder from datadog_api_client.v2.model.ci_app_tests_aggregate_request import CIAppTestsAggregateRequest from datadog_api_client.v2.model.ci_app_tests_group_by import CIAppTestsGroupBy from datadog_api_client.v2.model.ci_app_tests_query_filter import CIAppTestsQueryFilter body = CIAppTestsAggregateRequest( compute=[ CIAppCompute( aggregation=CIAppAggregationFunction.COUNT, metric="@test.is_flaky", type=CIAppComputeType.TOTAL, ), ], filter=CIAppTestsQueryFilter( _from="now-15m", query="@language:(python OR go)", to="now", ), group_by=[ CIAppTestsGroupBy( facet="@git.branch", limit=10, sort=CIAppAggregateSort( order=CIAppSortOrder.ASCENDING, ), total=False, ), ], options=CIAppQueryOptions( timezone="GMT", ), ) configuration = Configuration() with ApiClient(configuration) as api_client: api_instance = CIVisibilityTestsApi(api_client) response = api_instance.aggregate_ci_app_test_events(body=body) print(response) ``` #### Instructions First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=python) and then save the example to `example.py` and run following commands: DD_SITE="datadoghq.com" DD_API_KEY="" DD_APP_KEY="" python3 "example.py" ##### ```ruby # Aggregate tests events returns "OK" response require "datadog_api_client" api_instance = DatadogAPIClient::V2::CIVisibilityTestsAPI.new body = DatadogAPIClient::V2::CIAppTestsAggregateRequest.new({ compute: [ DatadogAPIClient::V2::CIAppCompute.new({ aggregation: DatadogAPIClient::V2::CIAppAggregationFunction::COUNT, metric: "@test.is_flaky", type: DatadogAPIClient::V2::CIAppComputeType::TOTAL, }), ], filter: DatadogAPIClient::V2::CIAppTestsQueryFilter.new({ from: "now-15m", query: "@language:(python OR go)", to: "now", }), group_by: [ DatadogAPIClient::V2::CIAppTestsGroupBy.new({ facet: "@git.branch", limit: 10, sort: DatadogAPIClient::V2::CIAppAggregateSort.new({ order: DatadogAPIClient::V2::CIAppSortOrder::ASCENDING, }), total: false, }), ], options: DatadogAPIClient::V2::CIAppQueryOptions.new({ timezone: "GMT", }), }) p api_instance.aggregate_ci_app_test_events(body) ``` #### Instructions First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=ruby) and then save the example to `example.rb` and run following commands: DD_SITE="datadoghq.com" DD_API_KEY="" DD_APP_KEY="" rb "example.rb" ##### ```rust // Aggregate tests events returns "OK" response use datadog_api_client::datadog; use datadog_api_client::datadogV2::api_ci_visibility_tests::CIVisibilityTestsAPI; use datadog_api_client::datadogV2::model::CIAppAggregateSort; use datadog_api_client::datadogV2::model::CIAppAggregationFunction; use datadog_api_client::datadogV2::model::CIAppCompute; use datadog_api_client::datadogV2::model::CIAppComputeType; use datadog_api_client::datadogV2::model::CIAppGroupByTotal; use datadog_api_client::datadogV2::model::CIAppQueryOptions; use datadog_api_client::datadogV2::model::CIAppSortOrder; use datadog_api_client::datadogV2::model::CIAppTestsAggregateRequest; use datadog_api_client::datadogV2::model::CIAppTestsGroupBy; use datadog_api_client::datadogV2::model::CIAppTestsQueryFilter; #[tokio::main] async fn main() { let body = CIAppTestsAggregateRequest::new() .compute(vec![CIAppCompute::new(CIAppAggregationFunction::COUNT) .metric("@test.is_flaky".to_string()) .type_(CIAppComputeType::TOTAL)]) .filter( CIAppTestsQueryFilter::new() .from("now-15m".to_string()) .query("@language:(python OR go)".to_string()) .to("now".to_string()), ) .group_by(vec![CIAppTestsGroupBy::new("@git.branch".to_string()) .limit(10) .sort(CIAppAggregateSort::new().order(CIAppSortOrder::ASCENDING)) .total(CIAppGroupByTotal::CIAppGroupByTotalBoolean(false))]) .options(CIAppQueryOptions::new().timezone("GMT".to_string())); let configuration = datadog::Configuration::new(); let api = CIVisibilityTestsAPI::with_config(configuration); let resp = api.aggregate_ci_app_test_events(body).await; if let Ok(value) = resp { println!("{:#?}", value); } else { println!("{:#?}", resp.unwrap_err()); } } ``` #### Instructions First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=rust) and then save the example to `src/main.rs` and run following commands: DD_SITE="datadoghq.com" DD_API_KEY="" DD_APP_KEY="" cargo run ##### ```typescript /** * Aggregate tests events returns "OK" response */ import { client, v2 } from "@datadog/datadog-api-client"; const configuration = client.createConfiguration(); const apiInstance = new v2.CIVisibilityTestsApi(configuration); const params: v2.CIVisibilityTestsApiAggregateCIAppTestEventsRequest = { body: { compute: [ { aggregation: "count", metric: "@test.is_flaky", type: "total", }, ], filter: { from: "now-15m", query: "@language:(python OR go)", to: "now", }, groupBy: [ { facet: "@git.branch", limit: 10, sort: { order: "asc", }, total: false, }, ], options: { timezone: "GMT", }, }, }; apiInstance .aggregateCIAppTestEvents(params) .then((data: v2.CIAppTestsAnalyticsAggregateResponse) => { console.log( "API called successfully. Returned data: " + JSON.stringify(data) ); }) .catch((error: any) => console.error(error)); ``` #### Instructions First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=typescript) and then save the example to `example.ts` and run following commands: DD_SITE="datadoghq.com" DD_API_KEY="" DD_APP_KEY="" tsc "example.ts" {% /tab %}