وب سایت تخصصی شرکت فرین
دسته بندی دوره ها

End-to-End Data Engineering Project

سرفصل های دوره

The world of data engineering is ever-changing, with new tools and technologies emerging on a regular basis. Building an effective analytics platform can be a daunting task, especially if you’re not familiar with all the tools available. How do you turn scattered, complex data into a model that drives insights and decision-making? In this course, Thalia Barrera teaches data professionals how to implement an end-to-end data engineering project using open tools from the modern data stack. She touches on best practices such as data modeling, testing, documentation and version control and shows you how to efficiently extract, load, and transform data into a unified, analytics-ready format. Thalia shows you how to confidently select and use tools through practical examples—taking you through the construction of a robust data pipeline for a fictional ecommerce company—and how to implement best practices in data engineering.


01 - Introduction
  • 01 - Transform complex data into insights
  • 02 - What you should know

  • 02 - 1. Project Overview and Preparation
  • 01 - Project architecture overview
  • 02 - Project setup
  • 03 - Understanding the Big Star Collectibles database
  • 04 - Setting up your data warehouse

  • 03 - 2. Data Extraction and Loading
  • 01 - Getting started with ELT tools An introduction to Airbyte
  • 02 - Deploying Airbyte for data synchronization
  • 03 - Setting up sources and destinations in Airbyte
  • 04 - Establishing connections in Airbyte
  • 05 - Synchronizing and navigating through data

  • 04 - 3. Starting Data Transformation and Modeling
  • 01 - Introduction to data modeling with dbt
  • 02 - Understanding the structure of a dbt project
  • 03 - Initiating your dbt project
  • 04 - Configuring data sources in dbt
  • 05 - Challenge Add a freshness check
  • 06 - Solution Add a freshness check

  • 05 - 4. Data Transformation and Modeling
  • 01 - Creating and customizing your dbt models
  • 02 - Reviewing and executing dbt
  • 03 - Securing your data with dbt tests
  • 04 - Challenge Add tests to the Marts model
  • 05 - Solution Add tests to the Marts model
  • 06 - Automating documentation in dbt
  • 07 - Completing your dbt project A full development cycle

  • 06 - 5. Data Orchestration
  • 01 - Introduction to data orchestration with Dagster
  • 02 - Integrating dbt models with Dagster assets
  • 03 - Integrating Airbyte connections with Dagster assets
  • 04 - Materializing assets using Dagit
  • 05 - Challenge Add a schedule to your data pipeline
  • 06 - Solution Add a schedule to your data pipeline

  • 07 - Conclusion
  • 01 - An evolving field
  • 45,900 تومان
    بیش از یک محصول به صورت دانلودی میخواهید؟ محصول را به سبد خرید اضافه کنید.
    خرید دانلودی فوری

    در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

    ایمیل شما:
    تولید کننده:
    مدرس:
    شناسه: 29846
    حجم: 159 مگابایت
    مدت زمان: 76 دقیقه
    تاریخ انتشار: 2 اسفند 1402
    طراحی سایت و خدمات سئو

    45,900 تومان
    افزودن به سبد خرید