End-to-End Real-World Data Engineering Project with Snowflake

سرفصل های دوره

This comprehensive course offers a hands-on deep dive into building a robust data pipeline using Snowflake, focusing on a real-world project case study. Join instructor Deepak Goyal as he shows you how to transform a data lake into a sophisticated Snowflake-based solution. Deepak covers the entire data lifecycle from ingestion to analytics-ready datasets. Learn how an end-to-end project works in Snowflake and how to implement the three-layer medallion architecture—bronze, silver, and gold. Ideal for professional data engineers as well as data analysts, this course can help you take your technical skills to the next level and put you in a more in-demand position to land the data role of your dreams.

01 - Introduction

01 - Project kickoff Data lake to Snowflake

02 - What you should know

02 - 1. Snowflake Real-World Project Details

01 - Snowflake real-world project case study Overview

02 - Data lake to Snowflake High-level solution

03 - Snowflake project architecture diagram

03 - 2. Snowflake Project Setup

01 - ADLS account creation

02 - Snowflake account creation

03 - Loading the sample data in ADLS

04 - Create external storage in Snowflake

04 - 3. Snowflake Bronze Layer Implementation

01 - Create the database in Snowflake and the Bronze layer schema

02 - Create the CSV file format in Snowflake to load CSV file data

03 - Create a Snowflake task to load customer data into the raw table

04 - Create the JSON file format in Snowflake to load JSON file data

05 - Create a Snowflake task to load product data into the raw table

06 - Create the Parquet file format in Snowflake to load Parquet file data

07 - Create a Snowflake task to load order data into the raw table

05 - 4. Snowflake Silver Layer Implementation

01 - Create the Silver layer schema in the database

02 - Create the stream in Snowflake to capture Customer table changes

03 - Create the stream in Snowflake to capture Product table changes

04 - Create the stream in Snowflake to capture Order table changes

05 - Create the task to merge customer changes in the Silver layer

06 - Create the task to merge product changes in the Silver layer

07 - Create the task to merge order changes in the Silver layer

06 - 5. Snowflake Gold Layer Implementation

01 - Create the Gold layer schema in the database

02 - Create the Gold layer demo table

03 - Create View 1 in the Gold layer

04 - Create View 2 in the Gold layer

07 - Conclusion

01 - Next steps

139,000 تومان

خرید اشتراک افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: LinkedIn Learning (Lynda)