For AI agents: A markdown version of this page is available at https://docs.datadoghq.com/api/latest/llm-observability/aggregate-llm-observability-experimentation.md. A documentation index is available at /llms.txt.

Product
The integrated platform for monitoring & security
View Product Pricing
Observability
End-to-end, simplified visibility into your stack’s health & performance
Infrastructure
Infrastructure Monitoring
Custom Metrics
Network Monitoring
Container Monitoring
Kubernetes Autoscaling
Serverless Monitoring
Cloud Cost Management
Storage Management
GPU Monitoring
Applications
Application Performance Monitoring
Universal Service Monitoring
Continuous Profiler
Dynamic Instrumentation
Agent Observability
Data
Database Monitoring
Data Observability
Data Streams Monitoring
Logs
Log Management
Audit Trail
Observability Pipelines
Error Tracking
Bring Your Own Cloud Log Management
Sensitive Data Scanner
Infrastructure
Applications
Data
Logs
Security
Outpace AI-powered attacks with unified security and observability
Learn More
Code Security
Code Security
Software Composition Analysis
Static Code Analysis
Runtime Code Analysis
IaC Security
Secret Scanning
Cloud Security
Cloud Security
Sensitive Data Scanner
Cloud Security Posture Management
Cloud Infrastructure Entitlement Management
Vulnerability Management
Compliance
Cloud Workload Protection
App & API Protection
SIEM
Cloud SIEM
Bits Security Analyst
Digital Experience
Optimize front-end performance and enhance user experiences
Digital Experience
Product Analytics
Experiments
Browser Real User Monitoring
Mobile Real User Monitoring
Session Replay
Synthetic Monitoring
Mobile App Testing
Continuous Testing
Error Tracking
Dashboards
Software Delivery
Build, test, secure and ship quality code faster
Software Delivery
Continuous Testing
Internal Developer Portal (IDP)
CI Visibility
Test Optimization
Feature Flags
Code Coverage
Software Composition Analysis
DORA Metrics + AI Impact
Service Management
Integrated, streamlined workflows for faster time-to-resolution
Incident Response
Incident Management
Work Management
Service Level Objectives
Actions
Workflow Automation
Datadog Apps
Event Management
Context Graph
Internal Developer Portal (IDP)
Software Catalog
AI
Monitor and improve model performance. Pinpoint root causes and detect anomalies
AI for Datadog
Bits Investigation
Bits AI
Bits Chat
Bits Agent Builder
Bits Code
Bits Security Analyst
Datadog for AI
Agent Observability
MCP Server
Pup CLI
GPU Monitoring
Platform Capabilities
Built-in features & integrations that power the Datadog platform
Built-in Features
Bits AI
Bits Chat
Bits Agent Builder
Alerts
Custom Metrics
Dashboards
Notebooks
Mobile App
Fleet Automation
Access Control
Governance Console
DORA Metrics + AI Impact
Incident Management
Work Management
Workflow Automation
Teams
Extensibility
OpenTelemetry
integrations
IDE Plugins
MCP Server
Agent Directory
Datadog Apps
API
Marketplace
Pup CLI
Software Catalog
Service Level Objectives
Customers
Pricing
Solutions
Docs

Looking for Datadog logos?

You can find the logo assets on our press page.

Download Media Assets

About
Blog
Login
GET STARTED FREE FREE TRIAL

Home

Docs

API

Agents
Essentials
In The App
Incident Response
Actions & Remediations
Infrastructure
Cloud Cost
- Cloud Cost
Application Performance
Data Observability
Digital Experience
Software Delivery
Developer Integrations
- Source Code Integration
- IDE Plugins
  - JetBrains IDEs
  - VS Code & Cursor
Security
AI Observability
Log Management
Administration

Datadog Docs API

Overview
Changelog
Action Connection
Actions Datastores
Agent Observability
Agentless Scanning
AI Impact
- Send AI tool user activity
Annotations
API Management
APM
- Get service list
APM Retention Filters
APM Trace
- Get a trace by ID
- Get a pruned trace by ID
App Builder
Application Security
Audit
- Search Audit Logs events
- Get a list of Audit Logs events
Authentication
- Validate API key
AuthN Mappings
AWS Integration
AWS Logs Integration
Azure Integration
Bits AI
Case Management
Case Management Attribute
Case Management Type
Change Management
CI Visibility GitHub Accounts
- List GitHub CI Visibility status
- Update GitHub CI Visibility status
CI Visibility Logs
- Send CI job logs
CI Visibility Pipelines
CI Visibility Tests
Cloud Authentication
Cloud Cost Management
Cloud Network Monitoring
- Get all aggregated connections
- Get all aggregated DNS traffic
Cloudflare Integration
Code Coverage
Compliance
- Get the rule-based view of compliance findings
Confluent Cloud
Container Images
- Get all Container Images
Containers
- Get All Containers
CSM Agents
- Get all CSM Agents
- Get all CSM Serverless Agents
CSM Coverage Analysis
CSM Ownership
CSM Settings
CSM Threats
Customer Org
- Disable the authenticated customer organization
Dashboard Lists
Dashboard Secure Embed
Dashboard Sharing
- List shared dashboards for a dashboard
Dashboards
Data Deletion
Data Observability
- Run a data observability monitor
- Get data observability monitor run status
Databricks Integration
Datasets
DDSQL
- Execute a tabular DDSQL query
- Fetch the result of a DDSQL query
DEM
Deployment Gates
Domain Allowlist
- Get Domain Allowlist
- Sets Domain Allowlist
DORA Metrics
Downtimes
Elastic Cloud Integration
Embeddable Graphs
Entity Integration Configs
Entity Risk Scores
- List Entity Risk Scores
- Get Entity Risk Score
Error Tracking
Events
Execution Policy
Experiments
Fastly Integration
Feature Flags
Fleet Automation
Forms
GCP Integration
Google Chat Integration
Governance Console
High Availability MultiRegion
- Create or update HAMR organization connection
- Get HAMR organization connection
Hosts
Identity Providers
Incidents
Integrations
- List Integrations
IP Allowlist
- Get IP Allowlist
- Update IP Allowlist
IP Ranges
- List IP Ranges
Jira Integration
Key Management
Logs
Logs Archive Searches
- Create an Archive Search
- Get an Archive Search
Logs Archives
Logs Custom Destinations
Logs Indexes
Logs Metrics
Logs Pipelines
Logs Restriction Queries
Metrics
Microsoft Teams Integration
Model Lab API
Monitors
Network Device Monitoring
Network Health Insights
- List network health insights
Notebooks
OAuth2 Client Public
Observability Pipelines
OCI Integration
Okta Integration
On-Call
On-Call Paging
Opsgenie Integration
Org Authorized Clients
Org Connections
Org Groups
Organizations
PagerDuty Integration
Powerpack
Processes
- Get all processes
Product Analytics
Product Catalog
- List SKUs
Reference Tables
Report Schedules
Reporting And Sharing
- Create a graph snapshot
Restriction Policies
Roles
RUM
Rum Audience Management
RUM Config
RUM Insights
- Query aggregated waterfall
- Query aggregated long tasks
Rum Metrics
RUM Operations
RUM Remote Config
- Get a RUM SDK configuration
- Update a RUM SDK configuration
Rum Replay Heatmaps
Rum Replay Playlists
Rum Replay Sessions
- Get segments
Rum Replay Viewership
Rum Retention Filters
RUM Retention Quotas
Rum Teams Ownership
Salesforce Integration
SCIM
Scorecards
Seats
Security Monitoring
Sensitive Data Scanner
Service Accounts
Service Checks
- Submit a Service Check
Service Definition
Service Dependencies
- Get all APM service dependencies
- Get one APM service's dependencies
Service Level Objective Corrections
Service Level Objectives
ServiceNow Integration
Slack Integration
Snapshots
- Take graph snapshots
Snowflake Integration
Software Catalog
Spa
Spans
Spans Metrics
Static Analysis
Status Pages
Statuspage Integration
Stegadography
- Get widgets from an image
Storage Management
- Enable Storage Management for a bucket
- Delete a Storage Management configuration
Synthetics
Tag Rules
Tags
Teams
Test Optimization
Threat Intelligence
- Ingest STIX threat intelligence
Timeseries Anomaly Investigations
- Investigate a timeseries anomaly
Twilio Integration
Usage Metering
User Authorized Clients
Users
Webhooks Integration
Widgets
Workflow Automation

Docs > API Reference > LLM Observability

Language

English Français 日本語 한국어 Español

Datadog Site

US1 US3 US5 EU AP1 AP2 UK1 US1-FED US2-FED

Aggregate LLM Observability experimentation

Copy pageCopied

Can't find something?

Our friendly, knowledgeable solutions engineers are here to help!

Contact Us

- - Digital Experience
- - Software Delivery
- - Incident Response
    - Incident Management
    - Work Management
  - Actions
  - Context Graph
    - Software Catalog
- - AI for Datadog
  - Datadog for AI
- - Built-in Features
  - Extensibility
- Observability
- Digital Experience
  - Digital Experience
- Security
- Software Delivery
  - Software Delivery
- Service Management
  - Incident Response
    - Incident Management
    - Work Management
  - Actions
  - Context Graph
    - Software Catalog
- AI
  - AI for Datadog
  - Datadog for AI
- Platform Capabilities
  - Built-in Features
  - Extensibility

Download mobile app

Aggregate LLM Observability experimentation

How can I help you today?