وب سایت تخصصی شرکت فرین
دسته بندی دوره ها

Azure Data Factory +Synapse Analytics End to End ETL project

سرفصل های دوره

Complete end to end Project on OTT platform using Azure Data Factory and Azure Synapse Analytics from Scratch with Labs


1 - Introduction
  • 1 - Welcome to the course
  • 2 - Main Focus and Prerequisites
  • 3 - Services used in this project
  • 4 - Project Overview
  • 5 - Project Architecture
  • 6 - Additional section on CICD setup for Azure Data Factory
  • 7 - Course Structure
  • 8 - Understanding OTT dataset
  • 9 - Project-Files.zip
  • 9 - Resources.html

  • 2 - Environment Setup
  • 10 - Environment setup Intro
  • 11 - Creating a budget for our Project
  • 12 - Creating a resource group
  • 13 - Creating an Azure Data Factory
  • 14 - Creating an Azure Datalake Storage Gen2
  • 15 - Creating an Azure Synapse Analytics Workspace
  • 16 - Suggestion on Saving costs for Azure SQL Database
  • 17 - Creating an Azure SQL Database
  • 18 - Installing Power BI Desktop

  • 3 - Data Ingestion
  • 19 - Data Ingestion Intro
  • 20 - Data Ingestion Integration Runtimes
  • 21 - Data Ingestion What is Self Hosted Integration Runtime
  • 22 - Overview of Onpremise data source and Datalake
  • 23 - Downloading and installing Self Hosted IR in Onpremise Environment
  • 24 - Creating and adding Secrets to Azure Key vault
  • 25 - Creating Linked Service for Azure Key vault Demo
  • 26 - Creating Linked Service and Dataset for Onpremise File Storage
  • 27 - Creating Linked Service and Dataset for Azure Datalake
  • 28 - Creating Copy Activity to copy all files from Onpremise to Azure Datalake
  • 29 - Incremental data loading using Last Modified Date of File
  • 30 - Incremental Load based on File Name Demo
  • 31 - Incremental Data loading based on Filename Practical

  • 4 - Transformation
  • 32 - Transformation Intro
  • 33 - Azure Synapse Analytics Introduction
  • 34 - Assigning Role for Synapse in Azure Datalake Demo
  • 35 - Assigning role and creating linked service in Azure Synapse Analytics Practical
  • 36 - Reading CSV files from ADLS from Synapse Notebook Practical
  • 36 - microsoft official documentation link for code.zip
  • 37 - Stop spark session manually to save cost
  • 38 - Identify and delete duplicate rows Demo
  • 39 - Identify and remove duplicate rows Practical
  • 40 - Identify and Remove or Replace NULL values Demo
  • 41 - Identify and Remove or Replace NULL values Practical
  • 42 - New column based on IMDB Rating Demo
  • 43 - New column based on IMDB Rating Practical
  • 44 - New column based on Runtime in Hours Demo
  • 45 - New column based on Runtime in Hours Practical
  • 46 - Practise Activity for creating a new column.html
  • 47 - Solution PySpark code for Practise Activity.html
  • 48 - Changing data types from String to Date Type Demo
  • 49 - Changing String to Date Data Type Practical
  • 50 - Writing transformed data to ADLS Demo
  • 51 - Writing transformed data to Datalake Practical
  • 52 - End of Writing Transformation Code
  • 53 - Calling Synapse Notebook Activity from Azure Data Factory Demo
  • 54 - Calling Synapse notebook from Azure Data Factory Practical
  • 55 - Transformation Conclusion

  • 5 - Data Loading
  • 56 - Data Loading Section Intro
  • 57 - Installing and Accessing Azure SQL Database from SSMS
  • 58 - Loading Data to SQL Database Demo
  • 59 - Copying data to SQL Database Practical
  • 60 - Fix error in Linked service while creating for SQL Database
  • 61 - Conclusion

  • 6 - Enchancements
  • 62 - Enhancements Section Intro
  • 63 - Enhancement for Copy data from Onpremise to ADLS Demo
  • 64 - Enhancement For Copy data from Onpremise Practical
  • 65 - Enhancement for synapse notebook Demo
  • 66 - Enhancement for synapse notebook to transform only todays file

  • 7 - Orchestration
  • 67 - Orchestration Section Intro
  • 68 - Orchestrating the pipelines Demo
  • 69 - Orchestrating all the pipelines and make it an automated pipeline Practical
  • 70 - Send an automatic alert email notification when pipeline failed in ADF Demo
  • 71 - Send an alert email notification when pipeline is failed Practical
  • 72 - Executing all pipelines for loading data into SQL

  • 8 - Reporting
  • 73 - Reporting Section Intro
  • 74 - Reporting Data in Power BI Practical

  • 9 - Additional Section Configuring Continuous Integration Continuous deployment
  • 75 - CICD Introduction
  • 76 - What is Continuous Integration
  • 77 - What is Continuous Deployement
  • 78 - CICD Part 1
  • 79 - CICD Part 2
  • 80 - CICD Part 3
  • 81 - CICD Part 4

  • 10 - Conclusion
  • 82 - Conclusion for the course
  • 139,000 تومان
    بیش از یک محصول به صورت دانلودی میخواهید؟ محصول را به سبد خرید اضافه کنید.
    خرید دانلودی فوری

    در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

    ایمیل شما:
    تولید کننده:
    شناسه: 10567
    حجم: 1788 مگابایت
    مدت زمان: 262 دقیقه
    تاریخ انتشار: ۸ اردیبهشت ۱۴۰۲
    طراحی سایت و خدمات سئو

    139,000 تومان
    افزودن به سبد خرید