Transform Data into Insights with Dagster and Deepnote

سرفصل های دوره

Data Engineering for Empowered Business Decisions: ETL, Exploration & Visualization

1 - Introduction

1 - Welcome to the World of Data Engineering

2 - The Power of Clean Organized Data

3 - The Skills and Tools Needed to be a Successful Data Engineer

4 - An ETL pipeline for Small and MediumSized Businesses

2 - Exploring the Tools of the ETL pipeline Deepnote Dagster and Metabase

5 - DeepNote

6 - Dagster

7 - Metabase

8 - Other tools

3 - Designing the ETL Pipeline From Data Sources to Dashboards

9 - Building the Solution Architecture

4 - Setting Up Your Development Environment and Generating Dummy Data

10 - Creating a PostgreSQL Database on Google Cloud

11 - Generating Synthetic Data of a Hypothetical Client

11 - github repo to start with.zip

12 - Explanation of the data generation process optional

13 - Verifying the Generated Data

5 - Getting Started with Deepnote An Introduction to Python and SQL for Data Explor

14 - Extracting and Viewing Data in Deepnote

15 - Digging Deeper Identifying Data Issues

16 - Digging Deeper Coming Up with a Strategy

17 - Creating a Database Table for Storing Normalized Data

6 - Data Preprocessing in Deepnote Cleaning and Normalizing Data

18 - Preprocessing Relational Data POS Transactions

19 - Preprocessing Relation Data Crypto Transactions

20 - Preprocessing JSON Data

21 - Preprocessing Excel Sheets Loading Files from Google Drive

22 - Preprocessing Excel Sheets Market Transactions

23 - Refactoring Business Logic Challenge

24 - Refactoring Business Logic Solution

25 - Unit Testing

7 - Setting up the ETL pipeline with Dagster

26 - Overview of Dagster Concepts

27 - Set up Local Dagster Development

28 - Extracting Data

29 - Transforming and Loading Data

30 - Partitioned Processing

31 - Job Configuration

32 - Streamed Data Processing

33 - Processing Files

34 - Creating Dagster Schedules

35 - Creating Dagster Sensors

36 - Deploying to Dagster Cloud

8 - Visualizing Data in Metabase

37 - Creating Visualizations from the Processed Data

9 - Bonus Content

38 - Bonus Lecture.html

139,000 تومان

افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: Udemy-Training