Spark Scala coding framework, testing, Structured streaming

سرفصل های دوره

Spark Scala Framework, Hive, IntelliJ, Maven, Logging, Exception Handling, log4j, ScalaTest, JUnit, Structured Streaming

1 - Introduction

1 - Introduction

1 - Udemy-Hadoop-Spark-Beginners-Course.txt

2 - What is Big Data Spark

3 - Big Data Hadoop concepts and handson labs for beginners.html

2 - Environment Setup & Spark Scala basics

4 - Installing JDK 11 on a Windows Machine

5 - FuturexSkillsHelloScala-winutils-hadoopdll.zip

5 - Installing IntelliJ and Winutils for Spark Scala Hive programming on Windows

6 - ScalaBasics.zip

6 - Scala Basics

7 - For Mac users Installing JDK and IntelliJ and Spark Scala Hive Hello World

7 - FutueXskillsMacHelloWorld.zip

7 - opening-project-in-mac-finder-and-spark-drive-host.zip

8 - Installing PostgreSQL

8 - postgres-course-catalog.zip

9 - Postgres-course-catalog-psql.zip

9 - psql command line interface for PostgreSQL

10 - Fetching PostgresSQL data to a Spark DataFrame

10 - FutureXSparkScalaProject-Postgres.zip

11 - Importing a project into IntelliJ

3 - Coding Best Practices

12 - FutureXSparkScalaProject-organize.zip

12 - Organizing code with Objects and Methods

13 - Implementing Log4j SLf4j Logging

13 - log4j.zip

14 - Exception Handling with try catch Option Some and None

4 - A Data Pipeline with Hive Spark and Postgres

15 - FutureXSparkScalaProject-readHivewritePG.zip

15 - Reading from Hive and Writing to Postgres

16 - FutureXSparkScalaProject-typesafe-config-parser.zip

16 - Reading Configuration from JSON using Typesafe

17 - FutureXSparkScalaProject-commandline.zip

17 - Reading commandline arguments and debugging in InjtelliJ

18 - FutureXSparkScalaProject-writeToHive.zip

18 - Writing data to a Hive Table

19 - FutureXSparkScalaProject.zip

19 - Managing input parameters using a Scala Case Class

20 - Intellij Maven troubleshooting tips.html

5 - Spark Scala Unit Testing using ScalaTest

21 - FutureXScalaUnitTesting.zip

21 - Scala Unit Testing using JUnit & ScalaTest

22 - FutureXSparkScalaProject-ScalaTest.zip

22 - Spark Transformation unit testing using ScalaTest

23 - SparkTransformerSpec.zip

23 - Unit testing to catch an Exception

24 - Catching Exception using assertThrows

25 - FutureXSparkScalaProject-assetThrowsIntercept.zip

25 - Throwing Custom Error and Intercepting Error Message

26 - SparkTransformerSpec.zip

26 - Testing with assertResult

27 - Testing with Matchers

27 - common.zip

28 - Failing tests intentionally

28 - failtests.txt

29 - Sharing fixtures

29 - SparkTransformerSpec.zip

6 - Running the application on Cloudera QuickStart VM on GCP

30 - Exporting the project to an uber jar

30 - pom.zip

31 - Signing up for GCP free trial

32 - Cloudera QuickStart VM Installation on GCP

32 - cloudera-gcp.txt

33 - Running Spark 2 with Hive on Cloudera QuickStart VM

33 - spark2-cloudera.txt

34 - FutureXSparkScalaProject-spark-submit.zip

34 - Uber Jar sparksubmit on Cloudera QuickStart VM

34 - spark-submit.txt

35 - Doing spark submit locally

7 - Spark Scala Structured Streaming

36 - Structured Streaming concepts

37 - FuturexMiscSparkScala.zip

37 - Streaming data from files

37 - files.zip

38 - Batch Vs Streaming code

39 - FuturexMiscSparkScala.zip

39 - Writing streaming data to a Hive table

39 - files.zip

40 - Streaming Aggregation

40 - StructuredStreamingAggregation.zip

40 - sale.zip

41 - Filtering Stream

41 - FuturexMiscSparkScala-Filter.zip

42 - Adding timestamp to streaming data

42 - StructuredStreamingDemoTimestamp.zip

43 - Aggregation in a time window

43 - StructuredStreamingWindowAggregation.zip

44 - FuturexMiscSparkScala.zip

44 - Tumbling window and Sliding window

45 - Thank you and PySpark coding framework course preview

45 - pyspark-couse-link-with-coupon.txt

8 - Appendix Big Data Hadoop Hive for beginners

46 - Big Data concepts

47 - Hadoop concepts

48 - Hadoop Distributed File System HDFS

49 - Understanding Google Cloud GCP Dataproc

50 - Signing up for a Google Cloud free trial

51 - Storing a file in HDFS

51 - futurexskill-github.txt

51 - hdfs-commands.txt

51 - retailstore.csv

52 - MapReduce and YARN

53 - Hive

54 - Querying HDFS data using Hive

54 - hiveql.txt

55 - Deleting the Cluster

56 - Analyzing a billion records with Hive

56 - hive-usecase.txt

45,900 تومان

خرید اشتراک افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: Udemy-Training