End-to-End Real-World Data Engineering Project with Databricks

سرفصل های دوره

This comprehensive course offers a practical, hands-on approach to building a modern data pipeline using Databricks. Join instructor Deepak Goyal as he guides you through a real-world data engineering project that transforms a data lake into an efficient, analytics-ready solution using the Databricks ecosystem. Learn how an end-to-end project works in Databricks, how to implement the three-layer medallion architecture—bronze, silver, and gold—and how to use Spark SQL in a real-world data project. Ideal for professional data engineers as well as data analysts, this course can help you take your technical skills to the next level and put you in a more in-demand position to land the data role of your dreams.

01 - Introduction

01 - Project kickoff Data engineering with Databricks

02 - What you should know

02 - 1. Databricks Real-World Project Details

01 - Databricks case study Overview

02 - Data lakehouse High-level solution

03 - Databricks project architecture diagram

03 - 2. Databricks Project Setup

01 - Databricks account creation

02 - Initial folder creation

03 - Loading the sample data

04 - 3. Databricks Bronze Layer Implementation

01 - Create the Bronze layer database

02 - Create a Databricks notebook to load a CSV file to the customer delta table

03 - Create a Databricks notebook to load a JSON file to the product delta table

04 - Create a Databricks notebook to load a Parquet file to the order delta table

05 - 4. Databricks Silver Layer Implementation

01 - Create the Silver layer database

02 - Create a Databricks notebook to load the Silver layer Customer delta table

03 - Create a Databricks notebook to load the Silver layer Product delta table

04 - Create a Databricks notebook to load the Silver layer Order delta table

06 - 5. Databricks Gold Layer Implementation

01 - Create the Gold layer database

02 - Create a Databricks notebook to load the Gold table Part 1

03 - Create a Databricks notebook to load the Gold table Part 2

07 - 6. Databricks and Power BI Data Visualization

01 - Install Power BI Desktop

02 - Integrate Databricks and Power BI

03 - Create the Power BI dashboard from Databricks

08 - Conclusion

01 - Next steps

139,000 تومان

افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: LinkedIn Learning (Lynda)