Mastering Databricks SQL Warehouse and Spark SQL

سرفصل های دوره

A Comprehensive Course on Databricks SQL Warehouse and Spark SQL for Data Engineers, Data Analysts, BI Developers, etc

1. Introduction to Mastering Databricks SQL Warehouse and Spark SQL

1. Introduction.html

2. Setup Course Material and Environment for Databricks SQL

1. Install Databricks CLI using Python 3 Pip Command

2. Configure Databricks CLI using Token and Profile

3. Setup Git Repository for Material and Data Sets related to Databricks SQL Course

3. Getting Started with Databricks SQL

1. Overview of Databricks SQL Platform - Introduction

2. Run First Query using SQL Editor of Databricks SQL

3. Overview of Dashboards using Databricks SQL

4. Overview of Databricks SQL Data Explorer to review Metastore Database and Tables

5. Use Databricks SQL Editor to develop scripts or queries

6. Review Metadata of Tables using Databricks SQL Platform

7. Overview of loading data into retail db tables

8. Configure Databricks CLI to push data into Databricks Platform

9. Copy JSON Data into DBFS using Databricks CLI

10. Analyze JSON Data using Spark APIs

11. Analyze Delta Table Schemas using Spark APIs

12. Load Data from Spark Data Frames into Delta Tables

13. Run Adhoc Queries using Databricks SQL Editor to validate data

14. Overview of External Tables using Databricks SQL

15. Using COPY Command to Copy Data into Delta Tables

16. Manage Databricks SQL Endpoints

4. Managing Databases using Databricks SQL Warehouse

1. Review Databases using Databricks SQL Data Explorer

2. Create Database or Schema using Databricks SQL

3. Using IF NOT EXISTS while Creating Databases using Databricks SQL

4. Listing or Showing Databases and Getting Metadata of Databases using Databricks

5. Understand Default Location of Databricks SQL Database or Schema

6. Create Database or Schema using Location in Databricks SQL Warehouse

7. Drop Databases in Databricks SQL Warehouse

8. Alter Database in Databricks SQL Warehouse

9. Comments on Databases in Databricks SQL Warehouse

5. Manage Delta Tables in Databricks SQL Warehouse

1. List Databases and Save Databricks SQL Script

2. Create Table using Delta Format in Databricks SQL Warehouse

3. Understand Location and Using Clause to specify File Format for Databricks

4. Create External Table using Delta Format in Databricks SQL Warehouse

5. Drop External Table and Delete Folder in Databricks SQL Warehouse

6. Overview of DML or CRUD Operations using Databricks SQL

7. Insert Records into Databricks SQL Warehouse table

8. Insert Multiple Records into Databricks SQL Warehouse table

9. Update Existing Records in Databricks SQL Warehouse table

10. Update Existing Records in Databricks SQL Warehouse table based on Null Values

11. Delete Existing Records in Databricks SQL Warehouse table

12. Cleanup Users Tables from Databricks SQL Warehouse Database or Schema

6. Setup Data Set for Databricks SQL Views and Copy Commands

1. Getting Started with Databricks fs Commands using Databricks CLI

2. Create Folder in DBFS using Databricks CLI Commands

3. Copy Files from Local File System into DBFS using Databricks CLI Commands

4. Overwrite Files while Copying into DBFS using Databricks CLI Command

5. Understand Course Catalog Data in the files uploaded to DBFS

6. Options to Analyze Data using Databricks SQL Queries

7. Run Select Queries using DBFS Path in From Cluase

8. Run Queries using Temporary Views in Databricks SQL

9. Run Queries using External Tables in Databricks SQL

7. Queries to Process Values in JSON String Columns

1. Queries to Process Values in JSON String Columns

2. Get Distinct and Count based on Key using Course Catalog Data

3. Filter Data using Basic Databricks SQL Queries using Course Catalog Data

4. Exploring Functions using Databricks SQL

5. Understand Record Column Values in Course Catalog Table

6. Processing JSON String Values using Databricks SQL Queries

7. Process Instructors JSON Records using Databricks SQL Queries

8. Create View for Instructors using Databricks SQL Queries

8. Copy Data into Delta Tables in Databricks SQL Warehouse

1. Create Delta Table for Course Catalog Data Set

2. Get File Names along with Data using Databricks SQL Queries

3. Overview of Databricks SQL COPY Command

4. Copy Data from single file into Delta Tables using Files

5. Copy Data from multiple files into Delta Tables using Files

6. Copy Data from multiple files into Delta Tables using Pattern

7. Create Course Catalog Table in Databricks SQL Warehouse with additional Column

8. Copy Data from Files using Queries into Delta Tables

9. Validate Course Catalog Table in Bronze Layer

9. Insert or Merge Query Results or View into Delta Tables using Databricks SQL

1. Introduction to Insert or Merge Query Results or View into Delta Tables using D

2. Create Course Catalog and Instructors Tables using Databricks SQL

3. Copy Data into Course Catalog Table from JSON Files using Databricks SQL

4. Insert Query Results into Delta Table using Databricks SQL

5. Exercise to Create Courses Table and Insert Data

6. Copy Instructors Data into Course Catalog Table from new file

7. Understand the Concept of Merge or Upsert in DML or CRUD Operations

8. Develop Query to Get the latest Instructors Records from Course Catalog Table

9. Overview of Merge Statement Syntax using Databricks SQL

10. Merge Data into Instructors Table from Course Catalog using Databricks SQL

11. Exercise to merge Courses Data from Course Catalog into Courses Table

10. Merge Query Results and Data from Delta Table with Delete into Delta Tables u

1. Introduction to Merge Query Results and Data from Delta Table with Delete in

2. Overview of Merge with Delete Real Life Scenario

3. Create Users Table using Delta format for Merge with Delete

4. Merge First Set of Records into Users Table.cmproj

5. Perform DML Operations on Users Table in Bronze Layer

6. Merge Updated Data into Users Table in Silver Layer

7. Scenarios for Merge into Databricks SQL Delta Tables

8. Reset Users Table to Merge Data Incrementally into the target table

9. Merge Into Databricks Table using Conditions on Updated Timestamp

10. Perform Operations to Insert and Update records in Bronze Users Table

11. Merge Incremental Data with Delete into Silver Users Table with Condition on

12. Exercise to Develop Merge Statement with Condition avoiding Column Names

11. Getting Started with Basic SQL Queries using Databricks SQL

1. Introduction to Getting Started with Basic SQL Queries using Databricks SQL

2. Exploring Databricks Data Sets

3. Create Database and Temporary Table to Preview the Data

4. Understand Characteristics of Online Retail Dataset

5. Create External Table with Columns and Datatypes

6. Get Count of Not Null Values of all Columns using Databricks SQL

7. Overview of Stack or Unpivot or Transpose of Data

8. Transpose Data using Stack in Databricks SQL

9. Transpose Not Null Counts into Multiple Rows using Databricks SQL

10. Overview of Unique or Distinct in Databricks SQL

11. Overview of Distinct to get unique records using Databricks SQL

12. Exercise - Get Distinct Count of Every Column

13. Create View using Query for Unique Records

14. Structure of SQL Query and Overview of Clauses

15. Overview of Comments in Databricks SQL Queries

45,900 تومان

خرید اشتراک افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: Udemy-Training