LLM Observability

Manage LLM Observability spans, data, projects, datasets, dataset records, experiments, prompts, and annotations.

List LLM Observability projects → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/projectshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/projectshttps://api.datadoghq.eu/api/v2/llm-obs/v1/projectshttps://api.ddog-gov.com/api/v2/llm-obs/v1/projectshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/projectshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/projectshttps://api.datadoghq.com/api/v2/llm-obs/v1/projectshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/projectshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/projects

Create an LLM Observability project → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/projectshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/projectshttps://api.datadoghq.eu/api/v2/llm-obs/v1/projectshttps://api.ddog-gov.com/api/v2/llm-obs/v1/projectshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/projectshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/projectshttps://api.datadoghq.com/api/v2/llm-obs/v1/projectshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/projectshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/projects

Update an LLM Observability project → preview

PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id}https://api.datadoghq.eu/api/v2/llm-obs/v1/projects/{project_id}https://api.ddog-gov.com/api/v2/llm-obs/v1/projects/{project_id}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/projects/{project_id}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id}https://api.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/projects/{project_id}

Delete LLM Observability projects → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/projects/deletehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/projects/deletehttps://api.datadoghq.eu/api/v2/llm-obs/v1/projects/deletehttps://api.ddog-gov.com/api/v2/llm-obs/v1/projects/deletehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/projects/deletehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/projects/deletehttps://api.datadoghq.com/api/v2/llm-obs/v1/projects/deletehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/projects/deletehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/projects/delete

List LLM Observability datasets → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets

Create an LLM Observability dataset → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasetshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets

List LLM Observability dataset records → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records

Append records to an LLM Observability dataset → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records

Update an LLM Observability dataset → preview

PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}https://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}https://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}https://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}

Update LLM Observability dataset records → preview

PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/recordshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records

Delete LLM Observability datasets → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/deletehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/deletehttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/deletehttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/deletehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/deletehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/deletehttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/deletehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/deletehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/delete

Delete LLM Observability dataset records → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/deletehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/deletehttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/deletehttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/deletehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/deletehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/deletehttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/deletehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/deletehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/records/delete

List LLM Observability experiments → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experimentshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experimentshttps://api.datadoghq.eu/api/v2/llm-obs/v1/experimentshttps://api.ddog-gov.com/api/v2/llm-obs/v1/experimentshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experimentshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experimentshttps://api.datadoghq.com/api/v2/llm-obs/v1/experimentshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/experimentshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments

Create an LLM Observability experiment → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experimentshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experimentshttps://api.datadoghq.eu/api/v2/llm-obs/v1/experimentshttps://api.ddog-gov.com/api/v2/llm-obs/v1/experimentshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experimentshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experimentshttps://api.datadoghq.com/api/v2/llm-obs/v1/experimentshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/experimentshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments

Update an LLM Observability experiment → preview

PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}https://api.datadoghq.eu/api/v2/llm-obs/v1/experiments/{experiment_id}https://api.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}https://api.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}

Delete LLM Observability experiments → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experiments/deletehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experiments/deletehttps://api.datadoghq.eu/api/v2/llm-obs/v1/experiments/deletehttps://api.ddog-gov.com/api/v2/llm-obs/v1/experiments/deletehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experiments/deletehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experiments/deletehttps://api.datadoghq.com/api/v2/llm-obs/v1/experiments/deletehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/experiments/deletehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments/delete

Push events for an LLM Observability experiment → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.datadoghq.eu/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events

List LLM Observability annotation queues → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queueshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queueshttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queueshttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queueshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queueshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queueshttps://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queueshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queueshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues

Create an LLM Observability annotation queue → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queueshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queueshttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queueshttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queueshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queueshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queueshttps://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queueshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queueshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues

Update an LLM Observability annotation queue → preview

PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}

Delete an LLM Observability annotation queue → preview

DELETE https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}

Add annotation queue interactions → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactionshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactionshttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactionshttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactionshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactionshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactionshttps://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactionshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactionshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions

Get annotated queue interactions → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactionshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactionshttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactionshttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactionshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactionshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactionshttps://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactionshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactionshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotated-interactions

Delete annotation queue interactions → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/deletehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/deletehttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/deletehttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/deletehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/deletehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/deletehttps://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/deletehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/deletehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/interactions/delete

Get a custom evaluator configuration → preview

GET https://api.ap1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.ap2.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.datadoghq.eu/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.us2.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.uk1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.us3.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.us5.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}

Create or update a custom evaluator configuration → preview

PUT https://api.ap1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.ap2.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.datadoghq.eu/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.us2.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.uk1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.us3.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.us5.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}

Delete a custom evaluator configuration → preview

DELETE https://api.ap1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.ap2.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.datadoghq.eu/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.us2.ddog-gov.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.uk1.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.us3.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}https://api.us5.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom/{eval_name}

Create or update annotations → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotationshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations

Delete annotations → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/deletehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/deletehttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/deletehttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/deletehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/deletehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/deletehttps://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/deletehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/deletehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/annotations/delete

List events for an LLM Observability experiment → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/eventshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/eventshttps://api.datadoghq.eu/api/v2/llm-obs/v3/experiments/{experiment_id}/eventshttps://api.ddog-gov.com/api/v2/llm-obs/v3/experiments/{experiment_id}/eventshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v3/experiments/{experiment_id}/eventshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/eventshttps://api.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/eventshttps://api.us3.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/eventshttps://api.us5.datadoghq.com/api/v2/llm-obs/v3/experiments/{experiment_id}/events

Search LLM Observability experimentation entities → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experimentation/searchhttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experimentation/searchhttps://api.datadoghq.eu/api/v2/llm-obs/v1/experimentation/searchhttps://api.ddog-gov.com/api/v2/llm-obs/v1/experimentation/searchhttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experimentation/searchhttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experimentation/searchhttps://api.datadoghq.com/api/v2/llm-obs/v1/experimentation/searchhttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/experimentation/searchhttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/experimentation/search

Simple search experimentation entities → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-searchhttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-searchhttps://api.datadoghq.eu/api/v2/llm-obs/v1/experimentation/simple-searchhttps://api.ddog-gov.com/api/v2/llm-obs/v1/experimentation/simple-searchhttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experimentation/simple-searchhttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-searchhttps://api.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-searchhttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-searchhttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/experimentation/simple-search

Aggregate LLM Observability experimentation → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experimentation/analyticshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experimentation/analyticshttps://api.datadoghq.eu/api/v2/llm-obs/v1/experimentation/analyticshttps://api.ddog-gov.com/api/v2/llm-obs/v1/experimentation/analyticshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experimentation/analyticshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experimentation/analyticshttps://api.datadoghq.com/api/v2/llm-obs/v1/experimentation/analyticshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/experimentation/analyticshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/experimentation/analytics

List LLM Observability spans → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/spans/eventshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/spans/eventshttps://api.datadoghq.eu/api/v2/llm-obs/v1/spans/eventshttps://api.ddog-gov.com/api/v2/llm-obs/v1/spans/eventshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/spans/eventshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/spans/eventshttps://api.datadoghq.com/api/v2/llm-obs/v1/spans/eventshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/spans/eventshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/spans/events

Search LLM Observability spans → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/spans/events/searchhttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/spans/events/searchhttps://api.datadoghq.eu/api/v2/llm-obs/v1/spans/events/searchhttps://api.ddog-gov.com/api/v2/llm-obs/v1/spans/events/searchhttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/spans/events/searchhttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/spans/events/searchhttps://api.datadoghq.com/api/v2/llm-obs/v1/spans/events/searchhttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/spans/events/searchhttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/spans/events/search

Delete LLM Observability data → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/deletion/data/llmobshttps://api.ap2.datadoghq.com/api/v2/llm-obs/deletion/data/llmobshttps://api.datadoghq.eu/api/v2/llm-obs/deletion/data/llmobshttps://api.ddog-gov.com/api/v2/llm-obs/deletion/data/llmobshttps://api.us2.ddog-gov.com/api/v2/llm-obs/deletion/data/llmobshttps://api.uk1.datadoghq.com/api/v2/llm-obs/deletion/data/llmobshttps://api.datadoghq.com/api/v2/llm-obs/deletion/data/llmobshttps://api.us3.datadoghq.com/api/v2/llm-obs/deletion/data/llmobshttps://api.us5.datadoghq.com/api/v2/llm-obs/deletion/data/llmobs

List LLM integration accounts → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accountshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accountshttps://api.datadoghq.eu/api/v2/llm-obs/v1/integrations/{integration}/accountshttps://api.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/accountshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/accountshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accountshttps://api.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accountshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accountshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/accounts

List LLM integration models → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/modelshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/modelshttps://api.datadoghq.eu/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/modelshttps://api.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/modelshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/modelshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/modelshttps://api.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/modelshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/modelshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/models

Run an LLM inference → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inferencehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inferencehttps://api.datadoghq.eu/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inferencehttps://api.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inferencehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inferencehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inferencehttps://api.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inferencehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inferencehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/integrations/{integration}/{account_id}/inference

Get annotated interactions by content IDs → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotated-interactionshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotated-interactionshttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotated-interactionshttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotated-interactionshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotated-interactionshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotated-interactionshttps://api.datadoghq.com/api/v2/llm-obs/v1/annotated-interactionshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotated-interactionshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotated-interactions

Get LLM Observability dataset draft state → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_statehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_statehttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_statehttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_statehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_statehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_statehttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_statehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_statehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state

Lock LLM Observability dataset draft state → preview

PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lockhttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lockhttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lockhttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lockhttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lockhttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lockhttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lockhttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lockhttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/lock

Unlock LLM Observability dataset draft state → preview

PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlockhttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlockhttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlockhttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlockhttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlockhttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlockhttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlockhttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlockhttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/draft_state/unlock

List LLM Observability dataset versions → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versionshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versionshttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versionshttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versionshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versionshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versionshttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versionshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versionshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/versions

Export an LLM Observability dataset → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/exporthttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/exporthttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/exporthttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/exporthttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/exporthttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/exporthttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/exporthttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/exporthttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/export

Batch update LLM Observability dataset records → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_updatehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_updatehttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_updatehttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_updatehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_updatehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_updatehttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_updatehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_updatehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/batch_update

Clone an LLM Observability dataset → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clonehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clonehttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clonehttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clonehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clonehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clonehttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clonehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clonehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/clone

Restore an LLM Observability dataset version → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restorehttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restorehttps://api.datadoghq.eu/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restorehttps://api.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restorehttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restorehttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restorehttps://api.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restorehttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restorehttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/{project_id}/datasets/{dataset_id}/restore

Upload records to an LLM Observability dataset → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/uploadhttps://api.ap2.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/uploadhttps://api.datadoghq.eu/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/uploadhttps://api.ddog-gov.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/uploadhttps://api.us2.ddog-gov.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/uploadhttps://api.uk1.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/uploadhttps://api.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/uploadhttps://api.us3.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/uploadhttps://api.us5.datadoghq.com/api/v2/llm-obs/v2/{project_id}/datasets/{dataset_id}/records/upload

List LLM Observability experiment spans (v1) → deprecated preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.datadoghq.eu/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/eventshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/experiments/{experiment_id}/events

List LLM Observability experiment events (v2) → deprecated preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/eventshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/eventshttps://api.datadoghq.eu/api/v2/llm-obs/v2/experiments/{experiment_id}/eventshttps://api.ddog-gov.com/api/v2/llm-obs/v2/experiments/{experiment_id}/eventshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v2/experiments/{experiment_id}/eventshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/eventshttps://api.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/eventshttps://api.us3.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/eventshttps://api.us5.datadoghq.com/api/v2/llm-obs/v2/experiments/{experiment_id}/events

Get annotation queue label schema → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema

Update annotation queue label schema → preview

PUT https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.datadoghq.eu/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schemahttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/annotation-queues/{queue_id}/label-schema

Create or update a patterns configuration → preview

PUT https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-configshttps://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs

Delete a patterns configuration → preview

DELETE https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id}https://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-configs/{config_id}https://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id}https://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/{config_id}

Trigger a patterns run → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-runshttps://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs

Get patterns run status → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/statushttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/statushttps://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-runs/statushttps://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runs/statushttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runs/statushttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/statushttps://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/statushttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/statushttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs/status

List patterns runs → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-runshttps://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-runs

List patterns topics → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topicshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topicshttps://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-topicshttps://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-topicshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-topicshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topicshttps://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topicshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topicshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics

List patterns clustered points → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-pointshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-pointshttps://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-clustered-pointshttps://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-clustered-pointshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-clustered-pointshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-pointshttps://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-pointshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-pointshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-clustered-points

List patterns topics with clustered points → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-pointshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-pointshttps://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-pointshttps://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-pointshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-pointshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-pointshttps://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-pointshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-pointshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-topics/with-cluster-points

Get a patterns configuration → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latesthttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latesthttps://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-configs/latesthttps://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs/latesthttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configs/latesthttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latesthttps://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latesthttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latesthttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs/latest

List patterns configurations → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.datadoghq.eu/api/v2/llm-obs/v1/topic-discovery-configshttps://api.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/topic-discovery-configs

List LLM Observability prompts → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/promptshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/promptshttps://api.datadoghq.eu/api/v2/llm-obs/v1/promptshttps://api.ddog-gov.com/api/v2/llm-obs/v1/promptshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/promptshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/promptshttps://api.datadoghq.com/api/v2/llm-obs/v1/promptshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/promptshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts

Create an LLM Observability prompt → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/promptshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/promptshttps://api.datadoghq.eu/api/v2/llm-obs/v1/promptshttps://api.ddog-gov.com/api/v2/llm-obs/v1/promptshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/promptshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/promptshttps://api.datadoghq.com/api/v2/llm-obs/v1/promptshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/promptshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts

Get an LLM Observability prompt → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}

Update an LLM Observability prompt → preview

PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}

Delete an LLM Observability prompt → preview

DELETE https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}

List versions of an LLM Observability prompt → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions

Create a new LLM Observability prompt version → preview

POST https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versionshttps://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions

Get a specific LLM Observability prompt version → preview

GET https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}

Update a specific LLM Observability prompt version → preview

PATCH https://api.ap1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.ap2.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.datadoghq.eu/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.us2.ddog-gov.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.uk1.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.us3.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}https://api.us5.datadoghq.com/api/v2/llm-obs/v1/prompts/{prompt_id}/versions/{version}

List custom evaluator configurations → preview

GET https://api.ap1.datadoghq.com/api/unstable/llm-obs/config/evaluators/customhttps://api.ap2.datadoghq.com/api/unstable/llm-obs/config/evaluators/customhttps://api.datadoghq.eu/api/unstable/llm-obs/config/evaluators/customhttps://api.ddog-gov.com/api/unstable/llm-obs/config/evaluators/customhttps://api.us2.ddog-gov.com/api/unstable/llm-obs/config/evaluators/customhttps://api.uk1.datadoghq.com/api/unstable/llm-obs/config/evaluators/customhttps://api.datadoghq.com/api/unstable/llm-obs/config/evaluators/customhttps://api.us3.datadoghq.com/api/unstable/llm-obs/config/evaluators/customhttps://api.us5.datadoghq.com/api/unstable/llm-obs/config/evaluators/custom