Azure Databricks and Spark SQL (Python)

سرفصل های دوره

Hands-on course focusing on data engineering and analysis on Azure Databricks using Spark SQL

1. Course Overview Introduction to Spark and Databricks

1. Course Introduction

2. Big Data

3. Hadoop, Spark and Databricks

4. Apache Spark Architecture

5. Spark vs Databricks Comparison

6. Resource Comparing Apache Spark vs Databricks.html

2. Azure and Databricks Set Up

1. Azure Account Set Up

2. Azure UI Overview

3. Resource Azure Resources.html

4. Creating your Databricks Service

5. Databricks UI Overview

6. Clusters

7. Resource Pricing, Cluster Pools and Runtime Versions.html

8. How to use Databricks Notebooks

9. Mix Languages and add Markdown text in your Notebook

10. Databricks Utilities Module and FileStore Utilities

11. Resource How to use Notebooks.html

12.1 databricks course notebooks and resources.zip

12. IMPORTANT - Download Course Resource Notebooks

13. Cost Management and Cancelling your Subscription

14. Resource Cancelling your Azure Subscription.html

3. Reading and Writing Data

1.1 Countries.zip

1. Dataset Download

2. Databricks FileStore

3. Resource File Types.html

4. Reading Data

5. Writing Data

6. Parquet Files

7. Deleting Files and Folders

4. Data Analysis and Transformation with SparkSQL

1. Selecting and Renaming Columns

2. Adding New Columns

3. Changing Data Types

4. Math Functions and Simple Arithmetic

5. Sort Functions

6. String Functions

7. Datetime Functions

8. Filtering DataFrames

9. Conditional Statements

10. Using SQL Expressions with expr()

11. Dropping Columns

12. Grouping your DataFrame

13. Pivot your DataFrame

14. Joining DataFrames

15. Union

16. Unpivot your DataFrame

17. Pandas

5. Utilising the Medallion Architecture in Databricks

1. Medallion Architecture

2. Resource Medallion Architecture.html

6. Challenge Section Customer Orders

1.1 Customer Orders.zip

1. Dataset Download and DBFS Upload - to animate

2. Assignment 1 Bronze to Silver

3. Assignment 1 Solutions Walkthrough

4. Assignment 2 Silver to Gold

5. Assignment 2 Solutions Walkthrough

7. Visualizations and Dashboards

1. Visualizations and Dashboards

8. Accessing Data from Azure Data Lake Storage (ADLS) with Databricks

1. Creating an ADLS Gen2 Account

2. (Optional) Storage Explorer

3. Accessing via Access Keys

4. Accessing via SAS Token

5. Mounting ADLS to DBFS Overview

6. Mounting ADLS to DBFS Demo

7. Secret Scopes

8. End to End Walkthrough Example

9. Hive Metastore, Databases, Tables and Views

1. Running SQL on DataFrames

2. Hive Metastore and Creating Databases

3. Managed Tables

4. Specifying a Location for your Underlying Managed Table Data

5. Unmanaged (External) Tables

6. Permanent Views

10. Challenge Section Employees

1.1 Employees.zip

1. Dataset Download and ADLS Upload

2. Assignment Employees

3. Assignment Solutions Walkthrough

11. Databricks Data Lakehouse Delta Lake

1. Databricks Data Lakehouse Delta Lake Overview

2. Delta Lake Data Files

3. Deleting and Updating Records

4. Merge Into

5. Table Utility Commands

12. Modularize Code and Link Notebooks

1. Running a Notebook from another Notebook

2. Text Widgets

45,900 تومان

خرید اشتراک افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: Udemy-Training