Learn Data Engineering with Databricks on AWS Cloud

سرفصل های دوره

Build Data Engineering Pipelines on AWS using Databricks core features such as Spark and Delta Lake

1 - Getting Startted with Databricks on AWS

1 - Introduction to Getting Started with Databricks on AWS

2 - Signing up for aws free account

3 - Logging in into AWS Management Console

4 - Setting up Databricks workspace on AWS using Quickstart

5 - Logging in into Databricks Workspace on AWS

6 - Cleaning up the workspace and resources

7 - Quick Walkthrough of Databricks UI on AWS

8 - Creating SingleNode Databricks cluster on AWS

9 - Upload Data using AWS Databricks UI

10 - Develop spark Application using AWS Databricks Notebook

11 - Writing dataframe to DBFS

12 - Export and Import AWS Databricks Notebooks

2 - AWS Storage Solutions

13 - Getting Started with AWS S3

14 - Overview of AWS S3 Glacier

15 - Creating S3 Bucket and adding Objects

16 - Version Control in AWS S3

17 - AWS S3 CrossRegion Replication for Fault Tolerance

18 - Setup and configure AWS S3 CLI using IAM user credentials

19 - Managing Objects in AWS S3 using CLI

3 - AWS S3 and IAM Role

20 - Overview of IAM for Databricks on AWS

21 - Creating AWS IAM User

22 - Logging into AWS Management Console using IAM User

23 - Validate Programmatic Access to AWS IAM User3

24 - AWS IAM Identitybased policies

25 - AWS IAM User Groups

26 - AWS IAM Custom Policies

4 - Integration S3 and Glue Catalog

27 - Introduction to Integrating AWS s3 and Glue Catalog with Databricks

28 - Create AWS IAM Group for Databricks Developers

29 - Creating AWS IAM Users and adding to group

30 - Creating AWS s3 Bucket for Databricks Developers

31 - Grant Permissions on AWS S3 Bucket to the users in group

32 - Attach AWS IAM Policy to grant access to Glue

33 - Upload JSON Dataset to s3 to crawl using AWS Glue Crawler

34 - Create AWS IAM Custom Service Role for Glue Crawlers

35 - Create and Run Glue Crawler to Create Multiple Glue Catalog Tables

36 - Overview of Integration of Databricks Clusters and AWS EC2 Instances

37 - Create AWS IAM Role or Instance Profile

38 - Registering AWS IAM Instance Profile with Databricks Account

39 - Attach AWS IAM Instance Profile to Databricks Cluster

40 - Grant Permissions on S3 to Databricks Clusters

41 - Integrate Databricks Cluster with Glue Catalog via Instance Profile

5 - Setup local development environment for databricks

42 - Setup single node databricks cluster

43 - Install Databricks Connect

44 - Configure Databricks Connect

6 - Using Databricks CLI

45 - Install and configure databricks CLI

46 - Interacting with File System using Databricks CLI

47 - Getting Cluster details using Databricks CLI

7 - Spark Jobs Deployment using Notebooks

48 - Modularizing Notebooks

49 - Running Job using Notebook

50 - Refactor application as Databricks Notebooks

51 - Run Notebooks using Development Cluster

45,900 تومان

خرید اشتراک افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: Udemy