---
title: Get annotated interactions by content IDs
description: Datadog, the leading service for cloud-scale monitoring.
breadcrumbs: Docs > API Reference > LLM Observability
---

> For the complete documentation index, see [llms.txt](https://docs.datadoghq.com/llms.txt).

# Get annotated interactions by content IDs{% #get-annotated-interactions-by-content-ids %}
Copy pageCopied
{% tab title="v2" %}
**Note**: This endpoint is in preview and is subject to change. If you have any feedback, contact [Datadog support](https://docs.datadoghq.com/help/).
| Datadog site      | API endpoint                                                               |
| ----------------- | -------------------------------------------------------------------------- |
| ap1.datadoghq.com | GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions |
| ap2.datadoghq.com | GET https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions |
| app.datadoghq.eu  | GET https://api.datadoghq.eu/api/v2/llm-obs/v1/annotated-interactions      |
| app.ddog-gov.com  | GET https://api.ddog-gov.com/api/v2/llm-obs/v1/annotated-interactions      |
| us2.ddog-gov.com  | GET https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotated-interactions  |
| uk1.datadoghq.com | GET https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions |
| app.datadoghq.com | GET https://api.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions     |
| us3.datadoghq.com | GET https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions |
| us5.datadoghq.com | GET https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions |

### Overview

Returns annotated interactions across all annotation queues for the given content IDs. Results include queue metadata (ID and name) for each interaction.

### Arguments

#### Query Strings

| Name                         | Type    | Description                                                                               |
| ---------------------------- | ------- | ----------------------------------------------------------------------------------------- |
| contentIds [*required*] | array   | One or more content IDs to retrieve annotated interactions for. At least one is required. |
| offset                       | integer | Pagination offset. Must be >= 0. Defaults to 0.                                           |
| limit                        | integer | Maximum number of results to return. Must be > 0. Defaults to 100.                        |

### Response

{% tab title="200" %}
OK
{% tab title="Model" %}
Response containing annotated interactions across all queues for the requested content IDs.

| Parent field           | Field                                    | Type      | Description                                                                                                                                                                                                  |
| ---------------------- | ---------------------------------------- | --------- | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
|                        | data [*required*]                   | object    | Data object for the cross-queue annotated interactions response.                                                                                                                                             |
| data                   | attributes [*required*]             | object    | Attributes of the cross-queue annotated interactions response.                                                                                                                                               |
| attributes             | annotated_interactions [*required*] | [object]  | List of annotated interactions across all queues for the requested content IDs.                                                                                                                              |
| annotated_interactions | annotations [*required*]            | [object]  | List of annotations for this interaction.                                                                                                                                                                    |
| annotations            | created_at [*required*]             | date-time | Timestamp when the annotation was created.                                                                                                                                                                   |
| annotations            | created_by [*required*]             | string    | Identifier of the user who created the annotation.                                                                                                                                                           |
| annotations            | id [*required*]                     | string    | Unique identifier of the annotation.                                                                                                                                                                         |
| annotations            | interaction_id [*required*]         | string    | Identifier of the interaction this annotation belongs to.                                                                                                                                                    |
| annotations            | label_values [*required*]           | object    | Label values for this annotation.                                                                                                                                                                            |
| annotations            | modified_at [*required*]            | date-time | Timestamp when the annotation was last modified.                                                                                                                                                             |
| annotations            | modified_by [*required*]            | string    | Identifier of the user who last modified the annotation.                                                                                                                                                     |
| annotated_interactions | content_id [*required*]             | string    | Upstream entity identifier (trace ID, session ID, or deterministic display_block ID).                                                                                                                        |
| annotated_interactions | created_at [*required*]             | date-time | Timestamp when the interaction was added to the queue.                                                                                                                                                       |
| annotated_interactions | display_block                            | [object]  | List of content blocks that make up a `display_block` interaction. Must contain at least one block.                                                                                                          |
| display_block          | alt                                      | string    | Alternative text for an `image` block.                                                                                                                                                                       |
| display_block          | content                                  |           | Block payload. A string for `markdown`, `header`, and `text`; an arbitrary JSON value (object, array, or scalar) for `json`. Omitted for `image`, `widget`, and `llmobs_trace`.                              |
| display_block          | height                                   | int64     | Optional rendered height. Must be positive when set.                                                                                                                                                         |
| display_block          | interactionType                          | enum      | Upstream interaction type referenced by an `llmobs_trace` block. Restricted to `trace` or `experiment_trace`. Allowed enum values: `trace,experiment_trace`                                                  |
| display_block          | label                                    | string    | Optional label rendered alongside the block.                                                                                                                                                                 |
| display_block          | level                                    | enum      | Visual size for a `header` block. Allowed enum values: `sm,md,lg,xl`                                                                                                                                         |
| display_block          | tileDef                                  |           | Tile definition for a `widget` block. Required for `widget`. The schema is owned by the frontend renderer.                                                                                                   |
| display_block          | timeFrame                                | object    | Unix-millis time range used by chart blocks.                                                                                                                                                                 |
| timeFrame              | end [*required*]                    | int64     | End of the range, in Unix milliseconds.                                                                                                                                                                      |
| timeFrame              | start [*required*]                  | int64     | Start of the range, in Unix milliseconds.                                                                                                                                                                    |
| display_block          | traceId                                  | string    | Trace identifier. Required for `llmobs_trace` blocks.                                                                                                                                                        |
| display_block          | type [*required*]                   | enum      | Discriminator for a single `display_block` content block. Adding a variant requires coordinated changes in the frontend renderer. Allowed enum values: `markdown,header,text,json,image,widget,llmobs_trace` |
| display_block          | url                                      | string    | URL of the image. Required for `image` blocks.                                                                                                                                                               |
| annotated_interactions | id [*required*]                     | string    | Unique identifier of the interaction.                                                                                                                                                                        |
| annotated_interactions | modified_at [*required*]            | date-time | Timestamp when the interaction was last updated.                                                                                                                                                             |
| annotated_interactions | queue_id [*required*]               | string    | Identifier of the annotation queue this interaction belongs to.                                                                                                                                              |
| annotated_interactions | queue_name [*required*]             | string    | Name of the annotation queue this interaction belongs to.                                                                                                                                                    |
| annotated_interactions | type [*required*]                   | enum      | Type of an annotated interaction. Allowed enum values: `trace,experiment_trace,session,display_block`                                                                                                        |
| attributes             | total_count [*required*]            | int32     | Total number of annotated interactions matching the query.                                                                                                                                                   |
| data                   | id [*required*]                     | string    | Opaque identifier for the response object.                                                                                                                                                                   |
| data                   | type [*required*]                   | enum      | Resource type for cross-queue annotated interactions lookup. Allowed enum values: `annotated_interactions_by_trace`                                                                                          |

{% /tab %}

{% tab title="Example" %}

```json
{
  "data": {
    "attributes": {
      "annotated_interactions": [
        {
          "annotations": [
            {
              "created_at": "2024-01-15T10:30:00Z",
              "created_by": "00000000-0000-0000-0000-000000000002",
              "id": "annotation-789",
              "interaction_id": "interaction-456",
              "label_values": [
                {}
              ],
              "modified_at": "2024-01-15T10:30:00Z",
              "modified_by": "00000000-0000-0000-0000-000000000002"
            }
          ],
          "content_id": "trace-abc-123",
          "created_at": "2025-06-01T12:00:00Z",
          "display_block": [
            {
              "alt": "Example image",
              "content": "## Triage Instructions",
              "height": 240,
              "interactionType": "trace",
              "label": "Triage Instructions",
              "level": "md",
              "tileDef": {
                "requests": [
                  {
                    "queries": [
                      {
                        "data_source": "metrics",
                        "name": "q",
                        "query": "avg:system.cpu.user{*}"
                      }
                    ],
                    "response_format": "timeseries",
                    "type": "line"
                  }
                ],
                "viz": "timeseries"
              },
              "timeFrame": {
                "end": 1705315800000,
                "start": 1705312200000
              },
              "traceId": "69fcc2bb0000000003113989d83069ba",
              "type": "markdown",
              "url": "https://example.com/image.png"
            }
          ],
          "id": "interaction-456",
          "modified_at": "2025-06-01T12:00:00Z",
          "queue_id": "queue-uuid-001",
          "queue_name": "My Annotation Queue",
          "type": "trace"
        }
      ],
      "total_count": 1
    },
    "id": "trace-query",
    "type": "annotated_interactions_by_trace"
  }
}
```

{% /tab %}

{% /tab %}

{% tab title="400" %}
Bad Request
{% tab title="Model" %}
API error response.

| Parent field | Field                    | Type     | Description                                                                     |
| ------------ | ------------------------ | -------- | ------------------------------------------------------------------------------- |
|              | errors [*required*] | [object] | A list of errors.                                                               |
| errors       | detail                   | string   | A human-readable explanation specific to this occurrence of the error.          |
| errors       | meta                     | object   | Non-standard meta-information about the error                                   |
| errors       | source                   | object   | References to the source of the error.                                          |
| source       | header                   | string   | A string indicating the name of a single request header which caused the error. |
| source       | parameter                | string   | A string indicating which URI query parameter caused the error.                 |
| source       | pointer                  | string   | A JSON pointer to the value in the request document that caused the error.      |
| errors       | status                   | string   | Status code of the response.                                                    |
| errors       | title                    | string   | Short human-readable summary of the error.                                      |

{% /tab %}

{% tab title="Example" %}

```json
{
  "errors": [
    {
      "detail": "Missing required attribute in body",
      "meta": {},
      "source": {
        "header": "Authorization",
        "parameter": "limit",
        "pointer": "/data/attributes/title"
      },
      "status": "400",
      "title": "Bad Request"
    }
  ]
}
```

{% /tab %}

{% /tab %}

{% tab title="401" %}
Unauthorized
{% tab title="Model" %}
API error response.

| Parent field | Field                    | Type     | Description                                                                     |
| ------------ | ------------------------ | -------- | ------------------------------------------------------------------------------- |
|              | errors [*required*] | [object] | A list of errors.                                                               |
| errors       | detail                   | string   | A human-readable explanation specific to this occurrence of the error.          |
| errors       | meta                     | object   | Non-standard meta-information about the error                                   |
| errors       | source                   | object   | References to the source of the error.                                          |
| source       | header                   | string   | A string indicating the name of a single request header which caused the error. |
| source       | parameter                | string   | A string indicating which URI query parameter caused the error.                 |
| source       | pointer                  | string   | A JSON pointer to the value in the request document that caused the error.      |
| errors       | status                   | string   | Status code of the response.                                                    |
| errors       | title                    | string   | Short human-readable summary of the error.                                      |

{% /tab %}

{% tab title="Example" %}

```json
{
  "errors": [
    {
      "detail": "Missing required attribute in body",
      "meta": {},
      "source": {
        "header": "Authorization",
        "parameter": "limit",
        "pointer": "/data/attributes/title"
      },
      "status": "400",
      "title": "Bad Request"
    }
  ]
}
```

{% /tab %}

{% /tab %}

{% tab title="403" %}
Forbidden
{% tab title="Model" %}
API error response.

| Parent field | Field                    | Type     | Description                                                                     |
| ------------ | ------------------------ | -------- | ------------------------------------------------------------------------------- |
|              | errors [*required*] | [object] | A list of errors.                                                               |
| errors       | detail                   | string   | A human-readable explanation specific to this occurrence of the error.          |
| errors       | meta                     | object   | Non-standard meta-information about the error                                   |
| errors       | source                   | object   | References to the source of the error.                                          |
| source       | header                   | string   | A string indicating the name of a single request header which caused the error. |
| source       | parameter                | string   | A string indicating which URI query parameter caused the error.                 |
| source       | pointer                  | string   | A JSON pointer to the value in the request document that caused the error.      |
| errors       | status                   | string   | Status code of the response.                                                    |
| errors       | title                    | string   | Short human-readable summary of the error.                                      |

{% /tab %}

{% tab title="Example" %}

```json
{
  "errors": [
    {
      "detail": "Missing required attribute in body",
      "meta": {},
      "source": {
        "header": "Authorization",
        "parameter": "limit",
        "pointer": "/data/attributes/title"
      },
      "status": "400",
      "title": "Bad Request"
    }
  ]
}
```

{% /tab %}

{% /tab %}

{% tab title="429" %}
Too many requests
{% tab title="Model" %}
API error response.

| Field                    | Type     | Description       |
| ------------------------ | -------- | ----------------- |
| errors [*required*] | [string] | A list of errors. |

{% /tab %}

{% tab title="Example" %}

```json
{
  "errors": [
    "Bad Request"
  ]
}
```

{% /tab %}

{% /tab %}

{% tab title="500" %}
Internal Server Error
{% tab title="Model" %}
API error response.

| Parent field | Field                    | Type     | Description                                                                     |
| ------------ | ------------------------ | -------- | ------------------------------------------------------------------------------- |
|              | errors [*required*] | [object] | A list of errors.                                                               |
| errors       | detail                   | string   | A human-readable explanation specific to this occurrence of the error.          |
| errors       | meta                     | object   | Non-standard meta-information about the error                                   |
| errors       | source                   | object   | References to the source of the error.                                          |
| source       | header                   | string   | A string indicating the name of a single request header which caused the error. |
| source       | parameter                | string   | A string indicating which URI query parameter caused the error.                 |
| source       | pointer                  | string   | A JSON pointer to the value in the request document that caused the error.      |
| errors       | status                   | string   | Status code of the response.                                                    |
| errors       | title                    | string   | Short human-readable summary of the error.                                      |

{% /tab %}

{% tab title="Example" %}

```json
{
  "errors": [
    {
      "detail": "Missing required attribute in body",
      "meta": {},
      "source": {
        "header": "Authorization",
        "parameter": "limit",
        "pointer": "/data/attributes/title"
      },
      "status": "400",
      "title": "Bad Request"
    }
  ]
}
```

{% /tab %}

{% /tab %}

### Code Example

##### 
                  \# Required query arguments export contentIds="CHANGE_ME" \# Curl command curl -X GET "https://api.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions?contentIds=${contentIds}" \
-H "Accept: application/json" \
-H "DD-API-KEY: ${DD_API_KEY}" \
-H "DD-APPLICATION-KEY: ${DD_APP_KEY}" 
                
##### 

```python
"""
Get annotated interactions by content IDs returns "OK" response
"""

from datadog_api_client import ApiClient, Configuration
from datadog_api_client.v2.api.llm_observability_api import LLMObservabilityApi

configuration = Configuration()
configuration.unstable_operations["get_llm_obs_annotated_interactions_by_trace_i_ds"] = True
with ApiClient(configuration) as api_client:
    api_instance = LLMObservabilityApi(api_client)
    response = api_instance.get_llm_obs_annotated_interactions_by_trace_i_ds(
        content_ids=[],
    )

    print(response)
```

#### Instructions

First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=python) and then save the example to `example.py` and run following commands:
    DD_SITE="datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" python3 "example.py"
##### 

```ruby
# Get annotated interactions by content IDs returns "OK" response

require "datadog_api_client"
DatadogAPIClient.configure do |config|
  config.unstable_operations["v2.get_llm_obs_annotated_interactions_by_trace_i_ds".to_sym] = true
end
api_instance = DatadogAPIClient::V2::LLMObservabilityAPI.new
p api_instance.get_llm_obs_annotated_interactions_by_trace_i_ds([])
```

#### Instructions

First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=ruby) and then save the example to `example.rb` and run following commands:
    DD_SITE="datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" rb "example.rb"
##### 

```go
// Get annotated interactions by content IDs returns "OK" response

package main

import (
	"context"
	"encoding/json"
	"fmt"
	"os"

	"github.com/DataDog/datadog-api-client-go/v2/api/datadog"
	"github.com/DataDog/datadog-api-client-go/v2/api/datadogV2"
)

func main() {
	ctx := datadog.NewDefaultContext(context.Background())
	configuration := datadog.NewConfiguration()
	configuration.SetUnstableOperationEnabled("v2.GetLLMObsAnnotatedInteractionsByTraceIDs", true)
	apiClient := datadog.NewAPIClient(configuration)
	api := datadogV2.NewLLMObservabilityApi(apiClient)
	resp, r, err := api.GetLLMObsAnnotatedInteractionsByTraceIDs(ctx, []string{}, *datadogV2.NewGetLLMObsAnnotatedInteractionsByTraceIDsOptionalParameters())

	if err != nil {
		fmt.Fprintf(os.Stderr, "Error when calling `LLMObservabilityApi.GetLLMObsAnnotatedInteractionsByTraceIDs`: %v\n", err)
		fmt.Fprintf(os.Stderr, "Full HTTP response: %v\n", r)
	}

	responseContent, _ := json.MarshalIndent(resp, "", "  ")
	fmt.Fprintf(os.Stdout, "Response from `LLMObservabilityApi.GetLLMObsAnnotatedInteractionsByTraceIDs`:\n%s\n", responseContent)
}
```

#### Instructions

First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=go) and then save the example to `main.go` and run following commands:
    DD_SITE="datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" go run "main.go"
##### 

```java
// Get annotated interactions by content IDs returns "OK" response

import com.datadog.api.client.ApiClient;
import com.datadog.api.client.ApiException;
import com.datadog.api.client.v2.api.LlmObservabilityApi;
import com.datadog.api.client.v2.model.LLMObsAnnotatedInteractionsByTraceResponse;
import java.util.Collections;

public class Example {
  public static void main(String[] args) {
    ApiClient defaultClient = ApiClient.getDefaultApiClient();
    defaultClient.setUnstableOperationEnabled("v2.getLLMObsAnnotatedInteractionsByTraceIDs", true);
    LlmObservabilityApi apiInstance = new LlmObservabilityApi(defaultClient);

    try {
      LLMObsAnnotatedInteractionsByTraceResponse result =
          apiInstance.getLLMObsAnnotatedInteractionsByTraceIDs(
              Collections.singletonList("contentIds"));
      System.out.println(result);
    } catch (ApiException e) {
      System.err.println(
          "Exception when calling LlmObservabilityApi#getLLMObsAnnotatedInteractionsByTraceIDs");
      System.err.println("Status code: " + e.getCode());
      System.err.println("Reason: " + e.getResponseBody());
      System.err.println("Response headers: " + e.getResponseHeaders());
      e.printStackTrace();
    }
  }
}
```

#### Instructions

First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=java) and then save the example to `Example.java` and run following commands:
    DD_SITE="datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" java "Example.java"
##### 

```rust
// Get annotated interactions by content IDs returns "OK" response
use datadog_api_client::datadog;
use datadog_api_client::datadogV2::api_llm_observability::GetLLMObsAnnotatedInteractionsByTraceIDsOptionalParams;
use datadog_api_client::datadogV2::api_llm_observability::LLMObservabilityAPI;

#[tokio::main]
async fn main() {
    let mut configuration = datadog::Configuration::new();
    configuration
        .set_unstable_operation_enabled("v2.GetLLMObsAnnotatedInteractionsByTraceIDs", true);
    let api = LLMObservabilityAPI::with_config(configuration);
    let resp = api
        .get_llm_obs_annotated_interactions_by_trace_i_ds(
            vec![],
            GetLLMObsAnnotatedInteractionsByTraceIDsOptionalParams::default(),
        )
        .await;
    if let Ok(value) = resp {
        println!("{:#?}", value);
    } else {
        println!("{:#?}", resp.unwrap_err());
    }
}
```

#### Instructions

First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=rust) and then save the example to `src/main.rs` and run following commands:
    DD_SITE="datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" cargo run
##### 

```typescript
/**
 * Get annotated interactions by content IDs returns "OK" response
 */

import { client, v2 } from "@datadog/datadog-api-client";

const configuration = client.createConfiguration();
configuration.unstableOperations[
  "v2.getLLMObsAnnotatedInteractionsByTraceIDs"
] = true;
const apiInstance = new v2.LLMObservabilityApi(configuration);

const params: v2.LLMObservabilityApiGetLLMObsAnnotatedInteractionsByTraceIDsRequest =
  {
    contentIds: [],
  };

apiInstance
  .getLLMObsAnnotatedInteractionsByTraceIDs(params)
  .then((data: v2.LLMObsAnnotatedInteractionsByTraceResponse) => {
    console.log(
      "API called successfully. Returned data: " + JSON.stringify(data)
    );
  })
  .catch((error: any) => console.error(error));
```

#### Instructions

First [install the library and its dependencies](https://docs.datadoghq.com/api/latest.md?code-lang=typescript) and then save the example to `example.ts` and run following commands:
    DD_SITE="datadoghq.com" DD_API_KEY="<DD_API_KEY>" DD_APP_KEY="<DD_APP_KEY>" tsc "example.ts"
{% /tab %}
