Build Real World Big Data Projects 2023

سرفصل های دوره

Work with Big Data Tools, SQL Databases, AWS, ETL, Data Integration Tools & more to master real-world Big Data Projects

1. Build ETL Data Pipeline on AWS EMR Cluster

1. Exploration of the dataset

2. Creating EMR Cluster

3. Login into EMR part 1

4. Login into EMR part 2

5. Upload Data into Amazon S3

6. using HIve as ETL Tool

7. Hive Data Insertion

8. Install Tableau Desktop

9. Install Driver

10. Connect Tableau to Amazon EMR Hive

11. Add data schema and Table

12. plot charts in Tableau part 1

13. plot charts in Tableau part 2

14. plot charts in Tableau part 3

15. plot charts in Tableau part 4

16. plot charts in Tableau part 5

17. Building Dashboard and story

2. Build Modern ETL Data Pipeline using IICS

1. Tour to Architecture diagram

2. Exploration of the dataset

3. Upload data to AWS S3

4. Create Postgresql in aws

5. Download Pgadmin

6. set up postgres sql and create schemas

7. Create schemas and order table in your postgres instance

8. set up infromatica cloud account

9. Add S3 Connection part 1

10. Add S3 Connection part 2

11. Add postgres Connection

12. Create customer Destination in Datawarehouse

13. EL for aws s3 to data warehouse

14. Create order Destination in Datawarehouse

15. EL for app database to data warehouse

16. Create DBT account

17. dbt part 1

18. dbt part 2

19. dbt part 3

20. dbt part 4

21. dbt part 5

22. dbt part 6

23. dbt part 7

24. dbt part 8

25. Tableau and postgres set up

26. How to Build charts in Tableau

3. Create A Data Pipeline based on Messaging Using PySpark and Airflow

1. Tour to Architecture diagram

2. Create EC2 Instance

3. SSH into EC2 Instance

4. Envirnoment setup with docker

5. Copy Important folder from local to ec2 and give required permissions

6. To connect to different services locally after port forwarding

7. To get into bash shell of different containers

8. Insert Nifi Template

9. Data Extraction with Nifi

10. Data encryption parsing

11. Data sources hdfs kafka part 1

12. Data sources hdfs kafka part 2

13. Data sources hdfs kafka part 3

14. streaming data from kafka to pyspark

15. pyspark streaming output kafka nifi hdfs part 1

16. pyspark streaming output kafka nifi hdfs part 2

17. Move Data HDFS to hive Table part 1

18. Move Data HDFS to hive Table part 2

19. Dataflow Orchestration with Airflow part 1

20. Dataflow Orchestration with Airflow part 2

21. Connecting with Data Visualization Tool

22. Plot charts

139,000 تومان

خرید اشتراک افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: Udemy-Training