Cost

Este producto no es compatible con el sitio Datadog seleccionado. ().
Esta página aún no está disponible en español. Estamos trabajando en su traducción.
Si tienes alguna pregunta o comentario sobre nuestro actual proyecto de traducción, no dudes en ponerte en contacto con nosotros.
Cost view for an app in LLM Observability.

Datadog LLM Observability automatically calculates an estimated cost for each LLM request, using providers’ public pricing models and token counts annotated on LLM/embedding spans.

By aggregating this information across traces and applications, you can gain insights into the user patterns of your LLM models and their impact on overall spending.

Use cases:

  • See and understand where LLM spend is coming from, at the model, request, and application levels
  • Track changes in token usage and cost over time to proactively guard against higher bills in the future
  • Correlate LLM cost with overall application performance, model versions, model providers, and prompt details in a single view

Set up monitoring costs

Datadog provides two ways to monitor your LLM costs:

Automatic

If your LLM requests involve any of the listed supported providers, Datadog automatically calculates the cost of each request based on the following:

  • Token counts attached to the LLM/embedding span, provided by either auto-instrumentation or manual user annotation
  • The model provider’s public pricing rates

Manual

To manually supply cost information, follow the instrumentation steps described in the SDK Reference or API.

If you provide partial cost information, Datadog tries to estimate missing information. For example, if you supply a total cost but not input/output cost values, Datadog uses provider pricing and token values annotated on your span to compute the input/output cost values. This can cause a mismatch between your manually provided total cost and the sum of Datadog’s computed input/output costs. Datadog always displays your provided total cost as-is, even if these values differ.

Supported providers

Datadog automatically calculates the cost of LLM requests made to the following supported providers using the publicly available pricing information from their official documentation.

Datadog only supports monitoring costs for text-based models.

Metrics

You can find cost metrics in LLM Observability Metrics.

The cost metrics include a source tag to indicate where the value originated:

  • source:auto — automatically calculated
  • source:user — manually provided

View costs in LLM Observability

View your app in LLM Observability and select Cost on the left. The Cost view features:

  • A high-level overview of your LLM usage over time including Total Cost, Cost Change, Total Tokens, and Token Change
  • Breakdown by Token Type: A breakdown of token usage, along with associated costs
  • Breakdown by Provider/Model or Prompt ID/Version: Cost and token usage broken down by LLM provider and model, or by individual prompts or prompt versions ( powered by Prompt Tracking)
  • Most Expensive LLM Calls: A list of your most expensive requests
Cost data in trace detail.

Cost data is also available within your application’s traces and spans, allowing you to understand cost at both the request (trace) and operation level (span). Click any trace or span to open a detailed side-panel view that includes cost metrics for the full trace and for each individual LLM call. At the top of the trace view, the banner shows aggregated cost information for the full trace, including estimated cost and total tokens. Hovering over these values reveals a breakdown of input and output token/costs.

Selecting an individual LLM span shows similar cost metrics specific to that LLM request.