Skip to content
@databrickslabs

Databricks Labs

Labs projects to accelerate use cases on the Databricks Unified Analytics Platform

Pinned Loading

  1. ucx Public

    Automated migrations to Unity Catalog

    Python 264 90

  2. dolly Public

    Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

    Python 10.8k 1.2k

  3. mosaic Public

    An extension to the Apache Spark framework that allows easy and fast processing of very large geospatial datasets.

    Jupyter Notebook 288 72

  4. blueprint Public

    Baseline for Databricks Labs projects written in Python

    Python 27 10

Repositories

Showing 10 of 35 repositories
  • ucx Public

    Automated migrations to Unity Catalog

    Python 264 90 277 (6 issues need help) 20 Updated Feb 28, 2025
  • dbldatagen Public

    Generate relevant synthetic data quickly for your projects. The Databricks Labs synthetic data generator (aka `dbldatagen`) may be used to generate large simulated / synthetic data sets for test, POCs, and other uses in Databricks environments including in Delta Live Tables pipelines

    Python 394 69 13 14 Updated Feb 28, 2025
  • sandbox Public

    Experimental labs projects

    Go 26 11 26 17 Updated Feb 28, 2025
  • dqx Public

    Databricks framework to validate Data Quality of pySpark DataFrames

    Python 216 30 29 1 Updated Feb 28, 2025
  • lsql Public

    Lightweight SQL execution wrapper only on top of Databricks SDK

    Python 15 4 53 (1 issue needs help) 9 Updated Feb 28, 2025
  • remorph Public

    Accelerates migrations to Databricks by automating code conversion and migration validation

    Python 55 35 389 (7 issues need help) 17 Updated Feb 28, 2025
  • dlt-meta Public

    Metadata driven Databricks Delta Live Tables framework for bronze/silver pipelines

    Python 173 78 19 (4 issues need help) 2 Updated Feb 28, 2025
  • pytester Public

    Python Testing for Databricks

    Python 70 6 37 0 Updated Feb 27, 2025
  • tempo Public

    API for manipulating time series on top of Apache Spark: lagged time values, rolling statistics (mean, avg, sum, count, etc), AS OF joins, downsampling, and interpolation

    Jupyter Notebook 319 54 31 (1 issue needs help) 0 Updated Feb 21, 2025
  • brickster Public

    R Toolkit for Databricks

    R 61 Apache-2.0 11 5 1 Updated Feb 21, 2025