From 08e390a37117b12e18a76d8122b49d42a2ee91b1 Mon Sep 17 00:00:00 2001 From: Rosa Trieu Date: Mon, 15 Dec 2025 12:01:27 -0800 Subject: [PATCH 1/2] Add Data Obs reference to Databricks --- databricks/README.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/databricks/README.md b/databricks/README.md index 4d027a5d69865..1c29fe465b571 100644 --- a/databricks/README.md +++ b/databricks/README.md @@ -16,6 +16,8 @@ Datadog offers several Databricks monitoring capabilities. [Reference Tables][32] allow you to import metadata from your Databricks workspace into Datadog. These tables enrich your Datadog telemetry with critical context like workspace names, job definitions, cluster configurations, and user roles. +[Data Observability][36] helps data teams detect, resolve, and prevent issues affecting data quality, performance, and cost. It monitors anomalies in volume, freshness, null rates, and distributions, and integrates with pipelines to correlate issues with job runs, data streams, and infrastructure events. + Model serving metrics provide insights into how your Databricks model serving infrastructure is performing. With these metrics, you can detect endpoints that have high error rate, high latency, are over/under provisioned, and more. ## Setup @@ -133,5 +135,6 @@ You can troubleshoot issues yourself by enabling the [Databricks web terminal][1 [33]: https://docs.datadoghq.com/data_jobs/databricks [34]: https://docs.datadoghq.com/cloud_cost_management/ [35]: https://docs.databricks.com/aws/en/admin/system-tables/ +[36]: https://docs.datadoghq.com/data_observability/ [8]: https://docs.datadoghq.com/integrations/spark/#metrics [9]: https://docs.datadoghq.com/integrations/spark/#service-checks From 6aed86258b242e01500349bc807f803c44537aec Mon Sep 17 00:00:00 2001 From: Rosa Trieu Date: Mon, 15 Dec 2025 12:18:49 -0800 Subject: [PATCH 2/2] add steps too --- databricks/README.md | 6 ++++++ 1 file changed, 6 insertions(+) diff --git a/databricks/README.md b/databricks/README.md index 1c29fe465b571..84075ac4a2a74 100644 --- a/databricks/README.md +++ b/databricks/README.md @@ -91,6 +91,12 @@ First, [connect a new Databricks workspace](#connect-to-a-new-databricks-workspa 5. Click **Save**. +#### Data Observability + +1. Connect a workspace in Datadog's Databricks integration tile. +2. In the **Select products to set up integration** section, set **Data Observability** to **Enabled** to monitor data quality, freshness, and volume anomalies. +3. See [the docs for Data Observability][36] for more details on configuration and features. + #### Permissions For Datadog to access your Databricks cost data in Data Jobs Monitoring or [Cloud Cost Management][34], the user or service principal used to query [system tables][35] must have the following permissions: - `CAN USE` permission on the SQL Warehouse.