وب سایت تخصصی شرکت فرین
دسته بندی دوره ها
1

Azure Data Factory +Synapse Analytics End to End ETL project

سرفصل های دوره

Complete end to end Project on OTT platform using Azure Data Factory and Azure Synapse Analytics from Scratch with Labs


1 - Introduction
  • 1 - Welcome to the course
  • 2 - Main Focus and Prerequisites
  • 3 - Services used in this project
  • 4 - Project Overview
  • 5 - Project Architecture
  • 6 - Additional section on CICD setup for Azure Data Factory
  • 7 - Course Structure
  • 8 - Understanding OTT dataset
  • 9 - Project-Files.zip
  • 9 - Resources.html

  • 2 - Environment Setup
  • 10 - Environment setup Intro
  • 11 - Creating a budget for our Project
  • 12 - Creating a resource group
  • 13 - Creating an Azure Data Factory
  • 14 - Creating an Azure Datalake Storage Gen2
  • 15 - Creating an Azure Synapse Analytics Workspace
  • 16 - Suggestion on Saving costs for Azure SQL Database
  • 17 - Creating an Azure SQL Database
  • 18 - Installing Power BI Desktop

  • 3 - Data Ingestion
  • 19 - Data Ingestion Intro
  • 20 - Data Ingestion Integration Runtimes
  • 21 - Data Ingestion What is Self Hosted Integration Runtime
  • 22 - Overview of Onpremise data source and Datalake
  • 23 - Downloading and installing Self Hosted IR in Onpremise Environment
  • 24 - Creating and adding Secrets to Azure Key vault
  • 25 - Creating Linked Service for Azure Key vault Demo
  • 26 - Creating Linked Service and Dataset for Onpremise File Storage
  • 27 - Creating Linked Service and Dataset for Azure Datalake
  • 28 - Creating Copy Activity to copy all files from Onpremise to Azure Datalake
  • 29 - Incremental data loading using Last Modified Date of File
  • 30 - Incremental Load based on File Name Demo
  • 31 - Incremental Data loading based on Filename Practical

  • 4 - Transformation
  • 32 - Transformation Intro
  • 33 - Azure Synapse Analytics Introduction
  • 34 - Assigning Role for Synapse in Azure Datalake Demo
  • 35 - Assigning role and creating linked service in Azure Synapse Analytics Practical
  • 36 - Reading CSV files from ADLS from Synapse Notebook Practical
  • 36 - microsoft official documentation link for code.zip
  • 37 - Stop spark session manually to save cost
  • 38 - Identify and delete duplicate rows Demo
  • 39 - Identify and remove duplicate rows Practical
  • 40 - Identify and Remove or Replace NULL values Demo
  • 41 - Identify and Remove or Replace NULL values Practical
  • 42 - New column based on IMDB Rating Demo
  • 43 - New column based on IMDB Rating Practical
  • 44 - New column based on Runtime in Hours Demo
  • 45 - New column based on Runtime in Hours Practical
  • 46 - Practise Activity for creating a new column.html
  • 47 - Solution PySpark code for Practise Activity.html
  • 48 - Changing data types from String to Date Type Demo
  • 49 - Changing String to Date Data Type Practical
  • 50 - Writing transformed data to ADLS Demo
  • 51 - Writing transformed data to Datalake Practical
  • 52 - End of Writing Transformation Code
  • 53 - Calling Synapse Notebook Activity from Azure Data Factory Demo
  • 54 - Calling Synapse notebook from Azure Data Factory Practical
  • 55 - Transformation Conclusion

  • 5 - Data Loading
  • 56 - Data Loading Section Intro
  • 57 - Installing and Accessing Azure SQL Database from SSMS
  • 58 - Loading Data to SQL Database Demo
  • 59 - Copying data to SQL Database Practical
  • 60 - Fix error in Linked service while creating for SQL Database
  • 61 - Conclusion

  • 6 - Enchancements
  • 62 - Enhancements Section Intro
  • 63 - Enhancement for Copy data from Onpremise to ADLS Demo
  • 64 - Enhancement For Copy data from Onpremise Practical
  • 65 - Enhancement for synapse notebook Demo
  • 66 - Enhancement for synapse notebook to transform only todays file

  • 7 - Orchestration
  • 67 - Orchestration Section Intro
  • 68 - Orchestrating the pipelines Demo
  • 69 - Orchestrating all the pipelines and make it an automated pipeline Practical
  • 70 - Send an automatic alert email notification when pipeline failed in ADF Demo
  • 71 - Send an alert email notification when pipeline is failed Practical
  • 72 - Executing all pipelines for loading data into SQL

  • 8 - Reporting
  • 73 - Reporting Section Intro
  • 74 - Reporting Data in Power BI Practical

  • 9 - Additional Section Configuring Continuous Integration Continuous deployment
  • 75 - CICD Introduction
  • 76 - What is Continuous Integration
  • 77 - What is Continuous Deployement
  • 78 - CICD Part 1
  • 79 - CICD Part 2
  • 80 - CICD Part 3
  • 81 - CICD Part 4

  • 10 - Conclusion
  • 82 - Conclusion for the course
  • 189,000 تومان
    بیش از یک محصول به صورت دانلودی میخواهید؟ محصول را به سبد خرید اضافه کنید.
    افزودن به سبد خرید
    خرید دانلودی فوری

    در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

    ایمیل شما:
    تولید کننده:
    شناسه: 10567
    حجم: 1788 مگابایت
    مدت زمان: 262 دقیقه
    تاریخ انتشار: ۸ اردیبهشت ۱۴۰۲
    طراحی سایت و خدمات سئو

    189,000 تومان
    افزودن به سبد خرید