demo-databricks

This project demonstrates a data pipeline in Databricks using Python notebooks located in the @notebooks folder.

Notebooks

• 01_ingest_data: Loads raw data from external sources into Databricks.
• 02_transform_data: Cleans and transforms ingested data for analysis.
• 03_analyze_data: Performs exploratory data analysis and generates insights.
• 04_visualize_results: Creates visualizations from processed data.

Getting Started

1. Clone the repository.
2. Import the notebooks into your Databricks workspace.
3. Follow the notebook sequence to run the