---
title: Databricks
description: >-
  Connect Databricks to Datadog Data Observability to monitor data quality,
  track usage, and detect issues.
breadcrumbs: >-
  Docs > Data Observability Overview > Quality Monitoring > Warehouse
  Integrations > Databricks
---

# Databricks

{% callout %}
# Important note for users on the following Datadog sites: app.ddog-gov.com

{% alert level="danger" %}
This product is not supported for your selected [Datadog site](https://docs.datadoghq.com/getting_started/site). ().
{% /alert %}

{% /callout %}

{% alert level="info" %}
The Quality Monitoring integration with Databricks only supports Unity Catalog. Reach out to your account representative if you use Hive Metastore.
{% /alert %}

## Overview{% #overview %}

The Databricks integration connects Datadog to your Databricks workspace to sync metadata and table-level metrics. Use it to monitor data freshness, detect anomalies, and trace lineage across your data stack.

**Note**: The instructions below are for Quality Monitoring. For Jobs Monitoring, see [Enable Data Observability: Jobs Monitoring for Databricks](https://docs.datadoghq.com/data_observability/jobs_monitoring/databricks/).

## Prerequisites{% #prerequisites %}

If your Databricks workspace restricts network access by IP, add the Datadog webhook IPs to your allowlist. For the list of IPs, see the `webhooks` section of IP ranges list.

## Set up your account in Databricks{% #set-up-your-account-in-databricks %}

### Step 1 - Connect the Databricks integration tile{% #step-1---connect-the-databricks-integration-tile %}

1. Complete the installation instructions in the [Databricks integration documentation](https://docs.datadoghq.com/integrations/databricks/) using Datadog's integration tile. Take note of the service principal's application ID and save it somewhere safe, because it will be referenced later.

**Note**: Workspace Admin permissions are not required for Quality Monitoring.

1. When configuring the integration, turn on the **Data Observability** toggle.

1. Click **Save Databricks Workspace**.

### Step 2 - Grant access{% #step-2---grant-access %}

First, grant access to system schemas for lineage:

```sql
GRANT USE CATALOG ON CATALOG system TO `<application_id>`;
GRANT USE SCHEMA ON CATALOG system TO `<application_id>`;
GRANT SELECT ON CATALOG system TO `<application_id>`;
```

Then, grant read-only access to the scope of data you want to monitor:

{% tab title="Full catalog access" %}
Use the full catalog access option for simpler setup. It automatically includes future tables without needing to update permissions.

```sql
GRANT USE_CATALOG ON CATALOG <catalog_name> TO `<application_id>`;
GRANT USE_SCHEMA ON CATALOG <catalog_name> TO `<application_id>`;
GRANT SELECT ON CATALOG <catalog_name> TO `<application_id>`;
```

{% /tab %}

{% tab title="Specific tables" %}
Use the specific tables option for least-privilege access or if you only need to monitor a subset of your data. You must update permissions when adding new tables.

```sql
GRANT USE_CATALOG ON CATALOG <catalog_name> TO `<application_id>`;
GRANT USE_SCHEMA ON SCHEMA <catalog_name>.<schema_name> TO `<application_id>`;
GRANT SELECT ON TABLE <catalog_name>.<schema_name>.<table_name> TO `<application_id>`;
```

{% /tab %}

These permissions are needed for the following reasons:

- `GRANT USE_CATALOG` is required to navigate into the catalog and discover schemas.
- `GRANT USE_SCHEMA` is required to enumerate tables and monitor schema-level health.
- `GRANT SELECT` is required for data quality monitoring, such as custom SQL or distribution checks.

## Next steps{% #next-steps %}

After you configure the integration, Datadog begins syncing your metadata and column-level lineage in the background. Initial syncs can take several hours depending on the size of your Databricks deployment.

After the initial sync completes, create a [Data Observability monitor](https://docs.datadoghq.com/monitors/types/data_observability/) to start alerting on freshness, row count, column-level metrics, and custom SQL metrics.

## Further reading{% #further-reading %}

- [Data Observability Overview](https://docs.datadoghq.com/data_observability/)
- [Data Observability Monitors](https://docs.datadoghq.com/monitors/types/data_observability/)