---
title: AI Gateway
description: >-
  Route LLM requests through Datadog AI Gateway to control model access,
  routing, and spend, and to observe requests in Agent Observability.
breadcrumbs: Docs > AI Gateway
---

> For the complete documentation index, see [llms.txt](https://docs.datadoghq.com/llms.txt).

# AI Gateway

{% callout %}
# Important note for users on the following Datadog sites: app.ddog-gov.com, us2.ddog-gov.com

{% alert level="danger" %}
This product is not supported for your selected [Datadog site](https://docs.datadoghq.com/getting_started/site.md). ({% placeholder "user-datadog-site-name" /%}).
{% /alert %}

{% /callout %}

{% callout %}
# Important note for users on the following Datadog sites: app.datadoghq.com, us3.datadoghq.com, us5.datadoghq.com, app.datadoghq.eu, ap1.datadoghq.com, ap2.datadoghq.com, uk1.datadoghq.com

{% callout %}
##### Join the Preview!

AI Gateway is in Preview. Request access or contact your Customer Success Manager.

[Request Access](https://www.datadoghq.com/product-preview/ai-gateway/)
{% /callout %}

{% /callout %}

Datadog's AI Gateway lets you govern how your organization uses large language models (LLMs) by routing agent and application traffic through a single endpoint. Because every request passes through one control point, you can:

- Call models from multiple providers through one endpoint and one set of Datadog credentials
- Give callers a stable model identifier with [routing rules](https://docs.datadoghq.com/ai_gateway/routing.md) and ordered fallbacks
- Control which teams, users, and service accounts can use each model with [access policies](https://docs.datadoghq.com/ai_gateway/access_control.md)
- Bill Claude Code and Codex usage to each user's own Claude or ChatGPT subscription with [subscription providers](https://docs.datadoghq.com/ai_gateway/providers.md#use-subscription-providers)
- Track and cap spend with [budgets](https://docs.datadoghq.com/ai_gateway/spend_controls.md#set-budgets)
- Cap requests, tokens, and spend per minute with [rate limits](https://docs.datadoghq.com/ai_gateway/spend_controls.md#set-rate-limits)
- Investigate requests with spans in Agent Observability

## Get started{% #get-started %}

[Send your first request](https://docs.datadoghq.com/ai_gateway/getting_started.md) through AI Gateway and find it in Agent Observability.

## Configuration guides{% #configuration-guides %}

| Task                                                                             | Guide                                                                                 |
| -------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------- |
| Connect provider accounts and discover models                                    | [Connect Providers](https://docs.datadoghq.com/ai_gateway/providers.md)               |
| Authenticate applications and attribute their requests                           | [Connect Applications](https://docs.datadoghq.com/ai_gateway/applications.md)         |
| Choose request formats, endpoints, and model identifiers                         | [Send Requests](https://docs.datadoghq.com/ai_gateway/requests.md)                    |
| Create model aliases, split traffic by session, route by task, and add fallbacks | [Route Requests](https://docs.datadoghq.com/ai_gateway/routing.md)                    |
| Grant access to models and routing rules                                         | [Control Model Access](https://docs.datadoghq.com/ai_gateway/access_control.md)       |
| Set budgets and rate limits                                                      | [Control Spend and Usage](https://docs.datadoghq.com/ai_gateway/spend_controls.md)    |
| Control recorded prompt and response content                                     | [Security and Data Capture](https://docs.datadoghq.com/ai_gateway/security.md)        |
| Review usage and inspect requests                                                | [Observe AI Gateway Activity](https://docs.datadoghq.com/ai_gateway/observability.md) |
| Diagnose failed or missing requests                                              | [Troubleshooting](https://docs.datadoghq.com/ai_gateway/troubleshooting.md)           |

## Further reading{% #further-reading %}

Additional helpful documentation, links, and articles:

- [Agent Observability](https://docs.datadoghq.com/llm_observability.md)
- [Personal access tokens](https://docs.datadoghq.com/account_management/personal-access-tokens.md)
- [Service accounts](https://docs.datadoghq.com/account_management/org_settings/service_accounts.md)
- [Get Started with AI Gateway](https://docs.datadoghq.com/ai_gateway/getting_started.md)
