Master Microsoft Fabric: A Complete End-to-End Project- CICD

سرفصل های دوره

Microsoft Fabric from Scratch includes Git, Lakehouse, Warehouse, Synapse Migration, end to end project with CICD- DP700

1 - Course Introduction

1 -Introduction

2 -Pre-requisites and benefits

3 -Project Architecture and learning structure

2 - Environment Setup

1 -Section Introduction

2 -Creating storage account in Azure

3 -Creating Azure Synapse Analytics Service in Azure

3 - 02. Understanding Microsoft Fabric

1 -Section Introduction

2 -Evolution of Data Architectures

3 -Delta Lake Structure

4 -Why Microsoft Fabric is needed

5 -Microsofts definition of Fabric

6 -How to enable and access Microsoft Fabric

7 -Fabric License and costing

7 -fabric pricing page.zip

7 -pricing calculator.zip

8 -Experiences in Microsoft Fabric

9 -Fabric Terminology

10 -OneLake in Fabric

11 -One copy for all Computes in Microsoft Fabric

4 - Lakehouse

1 -Section Introduction

2 -Understanding Fabric Workspaces

3 -Enable Fabric Trail and Create workspace

4 -Purchasing Fabric Capacity from Azure

5 -Workspace roles in Microsoft Fabric

6 -Creating a Lakehouse

7 -What is inside lakehouse

8 -Emp1.csv

8 -Emp2.csv

8 -Uploading data to Lakehouse

9 -Emp1.csv

9 -Emp2.csv

9 -Emp3.csv

9 -Uploading Folder into Lakehouse

10 -SQL analytics endpoint in Lakehouse

11 -Access SQL analytics endpoint using SSMS

12 -Visual Query in SQL endpoint

13 -Default Semantic Model

14 -OneLake File Explorer

5 - Data Factory

1 -Section Introduction

2 -Fabric Data Factory UI

3 -Ways to load data into Lakehouse

4 -Fabric Data Factory vs Azure Data Factory Scenario

5 -Gateway types in Microsoft Fabric

6 -Installing On-prem data gateway

7 -Create Connection to SQL Server

8 -Pipeline to ingest OnPrem SQL data to Lakehouse

9 -Scenario completed using Fabric data factory

10 -Dataflow Gen2 - Intro

11 -Creating DataFlow Gen2

11 -M-Query Code.txt

11 -Unemployment data for project.csv

12 -DataFlow Gen2 in Fabric vs Dataflows in ADF

6 - OneLake

1 -Section Introduction

2 -Loading data status

3 -Shortcuts in Fabric - Intro

4 -Prerequisites to Create a shortcut

5 -Creating a shortcut in Files of Lakehouse

5 -Emp1.csv

5 -Emp2.csv

5 -Emp3.csv

6 -Criteria to create shortcuts in table section

7 -Uploading required files and access for synapse

7 -unemployment.zip

8 -Right way to create a shortcut in tables section

9 -Creating delta file

9 -writing as deltaformat.zip

10 -Creating shortcut in Tables section

11 -Scenario - Creating shortcut with delta in a subfolder

12 -Scenario - Creating shortcut with only parquet format

13 -Requirements to create shortcuts in Table and files section

14 -Updation Scenario 1 - Lakehouse to Datalake

15 -Notebooks.zip

15 -Updation Scenario 2 - Datalake to Lakehouse

16 -Shortcut deletion scenarios intro

16 -deletion in fabric.zip

16 -deletion in synapse.zip

17 -Deletion Scenario 1 - Delete in Lakehouse files

18 -Deletion Scenario 2 - Delete in ADLS

19 -Deletion Scenario 3 - Delete table data in Lakehouse

20 -Deletion Scenario 4 - Delete table data in ADLS

21 -Deletion Scenario 5 - Deleting entire shortcut

22 -Shortcut deleting scenario summary

7 - Synapse Data Engineering

1 -Section Introduction

2 -Ingestion to Lakehouse status

3 -Spark in Microsoft Fabric

4 -Spark pools in Microsoft Fabric

5 -Spark pool node size

6 -Customizing Starter pools

7 -Creating a custom pool in Workspace

8 -Standard vs High Concurrency Sessions

9 -Changing Spark Settings to StarterPool

10 -Understanding Notebooks UI

11 -Fabric Notebook basics

11 -notebook basics.zip

12 -MSSparkUtils - Intro

13 -MSSparkUtils - FS- Mount

13 -fs - mounts.zip

14 -MSSparkUtils - FS - Other utils

14 -fs - other utils.zip

15 -MSSparkUtils - FS - FastCp

15 -fs- fastcp.zip

16 -Creating Folders in Microsoft Fabric

17 -MSSparkUtils - Notebook Utils - Run exit

17 -notebook uitls - parent.zip

17 -notebook utils- child.zip

17 -notebook utils- child parameter.zip

18 -MSSparkUtils - Notebook - RunMultiple

18 -notebook utils - runmultiple.zip

19 -Access ADLS data to Lakehouse - Intro

20 -Access ADLS using Entra ID

20 -adls ingest - entra id.zip

21 -Access ADLS using Service principal

21 -adls access - sp.zip

22 -Access ADLS using SP with keyvault

22 -adls access - sp with kv.zip

23 -Call Fabric notebook from Fabric pipeline

24 -Managed vs External table - Intro

25 -Create a Managed Table

25 -managed table.zip

26 -Create an External Table

26 -external table.zip

27 -Shortcut Table is an external or managed table

28 -Data Wrangler in Fabric Notebook

29 -Environments in Microsoft Fabric

30 -Understanding V-order optimization

30 -v-order.zip

31 -Spark Job Definition

31 -notebook vs spark job definition.zip

31 -sparkjob.zip

32 -What is a data mesh

33 -Creating domains in Fabric

8 - Synapse Migration to Microsoft Fabric

1 -Section Introduction

2 -Manual import from Synapse to Fabric

3 -Automated way to import and export notebooks - Intro

3 -migration documentation.zip

4 -Migrate all notebooks from Synapse to fabric

4 -migrate fabric.zip

4 -migrate synapse notebooks to fabric.zip

5 -Possibility of Migration of Pipelines to Fabric pipelines

5 -azure data factory pipeline migration.zip

5 -future releases.zip

5 -guide to dataflows.zip

6 -Ways to migrate ADLS data to Fabric OneLake

6 -az-copy.zip

6 -copy activity in pipeline.zip

6 -performant file copy (fastcp).zip

6 -storage explorer.zip

7 -Migrate ADLS data to Onelake using Storage Explorer

7 -storage explorer.zip

9 - Capacity Metrics App

1 -Section Introduction

2 -Install Capacity Metrics App

2 -capacity metrics app.zip

3 -Understanding UI of Capacity Metrics App

4 -Capacity Units consumption

5 -Throttling vs Smoothing

6 -Throttling stage- Overage Protection Policy

7 -Other throttling stages

8 -Throttling stages Summary

9 -Overages in Fabric

10 -System Events in Fabric

11 -Matrix Visual

11 -matrix visual.zip

10 - Synapse Data Warehouse

1 -Section Introduction

2 -Creating a Warehouse in Fabric

3 -Warehouse vs SQL Analytics Endpoint

4 -01.txt

4 -Creating a table and Limitations

4 -t-sql limitations.zip

5 -Ways to Load Data into Warehouse

6 -02.txt

6 -Loading Data using COPY INTO Command

6 -unemployed.zip

7 -Loading Data using Pipeline to Warehouse

8 -Loading Data using DataFlow Gen2

9 -Data Sharing - Lakehouse & Warehouse

10 -Cross Database Ingestion in Warehouse

10 -Cross database WH.txt

11 -Lakehouse vs Warehouse when to choose what

12 -Different Medallion Architectural patterns

13 -Update Lakehouse data from WH and vice versa

14 -SQL query as session in Fabric

14 -Temporary tables.txt

14 -sql query editor limitation.zip

15 -Zero Copy clone table.txt

15 -Zero Copy clone within and across Schema

16 -Time Travel in Warehouse

16 -Time Travel in Warehouse.txt

17 -Benefits & Limitations of Zero Copy clones

18 -Cloning single or multiple tables using UI

19 -Query Insights in Warehouse

19 -Query insights.txt

11 - Access Control and permissions

1 -Section Introduction

2 -Microsoft Fabric Structure

3 -Tenant Level permissions

4 -Capacity Level Permissions

5 -Creating new user in Entra ID

6 -Workspace roles- Workspace Administration

7 -Workspace roles - Data pipeline permissions

8 -Workspace Roles - Notebook, Spark jobs, etc

9 -Data Warehouse permissions - Intro

10 -Workspace Roles - Accessing shortcuts internal to fabric - Theory

10 -onelake documentation.zip

11 -Workspace Roles - Accessing Shortcuts Internal to Fabric - Practical

12 -Workspace Roles - Accessing ADLS shortcuts - Theory

13 -Workspace Roles - Accessing ADLS shortcuts - Practical

14 -Workspace Roles - Lakehouse permissions

15 -Item level permissions - Intro

16 -Warehouse Sharing - No additional permissions

17 -Warehouse Sharing - ReadData permissions

18 -Warehouse Sharing - ReadAll permissions

19 -Warehouse Sharing - Build permissions

20 -Extend Microsoft Fabric Trail

21 -Lakehouse Sharing - All permissions

22 -Notebook - Item Sharing

23 -Manage OneLake data access

24 -01.txt

24 -02.txt

24 -03.txt

24 -Row-Level Security in Warehouse and SQL endpoint

25 -Dynamic Data Masking in Warehouse and SQL endpoint

25 -Dynamic data masking - Alice.txt

26 -Column level security - Alice.txt

26 -Column & Object level security in Warehouse and SQL endpoint

12 - Power BI in Fabric

1 -Section Introduction

2 -Default Semantic Model - Intro

3 -Manage default Semantic Model

4 -Accessing Lakehouse or Warehouse using Power BI Desktop

5 -Automatically update semantic model in Lakehouse or warehouse

6 -Creating new Semantic Model

7 -Lineage view and Impact Analysis

8 -Connect using XMLA endpoint and readwrite using Tabular Editor

9 -What is a Direct Lake

10 -Direct Lake - Practical

11 -DirectLake vs Direct Query vs Import modes

12 -Refresh a Semantic Model - Manual

13 -Refresh Semantic model from Notebook

13 -refresh semantic model.zip

14 -Refresh Semantic Model from XMLA Endpoint

15 -Refresh Semantic Model from Data Pipeline

16 -Fallback to Direct Query Scenarios

16 -direct lake fallback.zip

17 -Handling Fallback behavior of Semantic Models

18 -Copy Multiple measures from One Model to another in Fabric

19 -PBI RLS Script.txt

19 -Row-level security in Power BI

20 -Row-level security without Viewer Role

21 -Build permission to user with RLS

22 -Dynamic RLS.txt

22 -Dynamic Row-level Security

23 -Object level Security with viewer role

24 -Object level security without Viewer role

25 -Column level security

13 - End to End project

1 -Section Introduction

2 -Different Medallion architectures in Fabric

3 -Understanding domain and dataset information

4 -Project Architecture

5 -Creating workspace for project and review dataset

5 -LMSData.zip

6 -Get data from Raw to landing - theory

7 -01.zip

7 -Raw to landing zone

8 -Different incremental loading patterns

9 -Incrementally ingest from Raw to landing zone

10 -Automate ingest from Raw to Landing using pipeline

11 -Ingest data from Landing to Bronze layer - Theory

12 -Understanding UPSERT logic for Landing to Bronze ingestion

13 -02.zip

13 -Landing to Bronze layer - practical

14 -Reading landing to bronze from next partition

15 -UPSERT scenario practical - Landing to bronze

16 -Bronze layer to Silver layer - Theory

17 -Understanding data transformations and UPSERT logic for Silver table

18 -03.zip

18 -Silver table - Data cleaning

19 -03.zip

19 -Silver Layer - data transformations

20 -Gold Layer - Facts and dimensions table - Theory

21 -04.zip

21 -Gold Layer - Facts and dimension tables - Practical

22 -Data modelling and creating a report

22 -lms report.zip

23 -Orchestrate end to end pipeline and execute it

14 - Git Integration

1 -Section Introduction

2 -Creating data sources for PROD

3 -01.zip

3 -02.zip

3 -03.zip

3 -04.zip

3 -Changes made to support Git integration

3 -lms import.zip

4 -Executing to check if changes were working

5 -Sign up with Azure DevOps account

6 -Connect Fabric workspace to Azure DevOps

7 -Git integration permissions and Limitations

7 -considerations and limitations.zip

7 -fabric permissions.zip

8 -Locking main branch with branch policy

9 -Understanding Continuous Integration (CI) in Fabric

10 -Continuous Integration in Fabric Workspace

11 -Status of workspace created for feature branch

12 -Understanding Continuous Deployment in Fabric

13 -Deploying Fabric items from Dev to Prod

14 -Deployment rules to Change data sources of Prod workspace

15 -End to End execution in PROD

16 -Git integration for Power BI developers

17 -Summary of version control for Power BI

15 - Conclusion

1 -Course Completion

2 - My other Data Engineering Courses.html

189,000 تومان

افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: Udemy