List annotation queues. Optionally filter by project ID or queue IDs. These parameters are mutually exclusive.
If neither is provided, all queues in the organization are returned.
Arguments
Query Strings
Name
Type
Description
projectId
string
Filter annotation queues by project ID. Cannot be used together with queueIds.
queueIds
array
Filter annotation queues by queue IDs (comma-separated). Cannot be used together with projectId.
Response containing a list of LLM Observability annotation queues.
Expand All
Field
Type
Description
data [required]
[object]
List of annotation queues.
attributes [required]
object
Attributes of an LLM Observability annotation queue.
annotation_schema
object
Schema defining the labels for an annotation queue.
label_schemas [required]
[object]
List of label schema definitions.
description
string
Description of the label.
has_assessment
boolean
Whether this label includes an assessment field.
has_reasoning
boolean
Whether this label includes a reasoning field.
id
string
Unique identifier of the label schema. Assigned by the server if not provided.
is_assessment
boolean
Whether the boolean label represents an assessment. Requires has_assessment to be true.
is_integer
boolean
Whether score values must be integers. Applicable to score-type labels.
is_required
boolean
Whether this label is required for an annotation.
max
double
Maximum value for score-type labels.
min
double
Minimum value for score-type labels.
name [required]
string
Name of the label. Must match the pattern ^[a-zA-Z0-9_-]+$ and be unique within the queue.
type [required]
enum
Type of a label in an annotation queue label schema.
Allowed enum values: score,categorical,boolean,text
values
[string]
Allowed values for categorical-type labels. Must contain at least one non-empty, unique value.
created_at [required]
date-time
Timestamp when the queue was created.
created_by [required]
string
Identifier of the user who created the queue.
description [required]
string
Description of the annotation queue.
modified_at [required]
date-time
Timestamp when the queue was last modified.
modified_by [required]
string
Identifier of the user who last modified the queue.
name [required]
string
Name of the annotation queue.
owned_by [required]
string
Identifier of the user who owns the queue.
project_id [required]
string
Identifier of the project this queue belongs to.
id [required]
string
Unique identifier of the annotation queue.
type [required]
enum
Resource type of an LLM Observability annotation queue.
Allowed enum values: queues
{"data":[{"attributes":{"annotation_schema":{"label_schemas":[{"description":"Rating of the response quality.","has_assessment":false,"has_reasoning":false,"id":"abc-123","is_assessment":false,"is_integer":false,"is_required":true,"max":5,"min":0,"name":"quality","type":"score","values":["good","bad","neutral"]}]},"created_at":"2024-01-15T10:30:00Z","created_by":"00000000-0000-0000-0000-000000000002","description":"Queue for annotating customer support traces","modified_at":"2024-01-15T10:30:00Z","modified_by":"00000000-0000-0000-0000-000000000002","name":"My annotation queue","owned_by":"00000000-0000-0000-0000-000000000002","project_id":"00000000-0000-0000-0000-000000000002"},"id":"00000000-0000-0000-0000-000000000001","type":"queues"}]}
DD_SITE="datadoghq.comus3.datadoghq.comus5.datadoghq.comdatadoghq.euap1.datadoghq.comap2.datadoghq.comddog-gov.comus2.ddog-gov.com"DD_API_KEY="<DD_API_KEY>"DD_APP_KEY="<DD_APP_KEY>"cargo run
/**
* List LLM Observability annotation queues returns "OK" response
*/import{client,v2}from"@datadog/datadog-api-client";constconfiguration=client.createConfiguration();configuration.unstableOperations["v2.listLLMObsAnnotationQueues"]=true;constapiInstance=newv2.LLMObservabilityApi(configuration);apiInstance.listLLMObsAnnotationQueues().then((data: v2.LLMObsAnnotationQueuesResponse)=>{console.log("API called successfully. Returned data: "+JSON.stringify(data));}).catch((error: any)=>console.error(error));