Install Apache Spark on Mac, Windows, Linux

My Name is Harjeet and I am very happy to share my knowledge with you. I want to learn and share with our community. Please feel free to drop a message if you feel I can improve in any way or I could help you in any way.
Let us learn Together.
In this video, we are going to learn
1. Write Your First Streaming Job
2. Read data from sockets
3. Write data in a streamed way
4. Different output modes in a Streaming Job
Other Videos in Structured StreamingSeries
1. Environment Setup: • Install Apache Spark o...
2. What is Streaming: • Streaming Introduction...
3. Write First Streaming Job: • Writing Your First Str...
4. Structured Streaming From file Source: • Stream Files to Struct...
Here are a few Links useful for you
Git Repo: github.com/har...
Docker Download: www.docker.com...
Idea Intellij: www.jetbrains....
If you are interested to join our community. Please join the following groups
Whatsapp: chat.whatsapp....
Telegram: t.me/bigdata_hkr
You can drop me an email for any queries at
[e-mail]
#spark #structuredstreaming #streaming #bigdata

[@hiteshtaneja]

Good to see you back on KZbin your earlier videos where of great help.Please do cover how to query database based on records received in streaming DF.

[@DataSavvy]

Thanks for your suggestion Hitesh... I will plan for this... And I am happy these videos are useful for you :)

[@anudipray4492]

Docker is working fine in Windows home edition sir.

[@jayantmeshram7370]

I am trying to run your code in ubuntu system but not able to .. could you please make a video how to run your code in ubuntu/linux .. thanks

[@bhargavhr8834]

Welcome🎉 back harjeet

[@DataSavvy]

Thanks Bhargav... Please share your feedback and suggestions :)

[@bhargavhr8834]

@@DataSavvy sure, will follow and provide you feedback and suggestions

[@DataSavvy]

Thanks

[@haradica5]

When I run the SparkBuildTest .... I am getting an error. scala: Error: Error compiling the sbt component 'compiler-bridge-2.12.1-65.0' sbt.internal.inc.CompileFailed: Error compiling the sbt component 'compiler-bridge-2.12.1-65.0' I even d/l Java 8 and pointed the JRE Path for sbt to C:\Program Files (x86)\Java\jre-1.8 and the scala version to 2.12.1. sbt build is running fine without error. Docker is running spark_st ..however when I run the sparkBuildTest ... running into this error.Any help would be appreciated

[@DataSavvy]

Can you share more details

[@gonzalosurribassayago4116]

Hi from Spain I like it very good

[@ravikirantuduru1061]

Can you do practical videos on how to handle data skewness and how to do salting techniques

[@DataSavvy]

Ok Ravi... I will plan for that

[@rohitkamra1628]

Nice... Keep it up bro👍

[@DataSavvy]

Thanks Bro :)

[@rahulpandit9082]

Hope this series ll rock.... Keep it up Sir... improve video quality a little bit as I feel... Even in 480p, some texts are not clearly seen..

[@DataSavvy]

Thanks Rahul... Please share your suggestion and feedback

[@DataSavvy]

Sure... I will look into that aspect of video quality :)

[@manishsahani4867]

@@DataSavvy please make more videos on. databricks

[@prateekshukla8879]

Sir pls make one video on Spark-Kafka integration in Hive including hands on experience with byte offset consumption through Kafka.

[@DataSavvy]

I have created spark Kafka integration video as part of this video... Can you elaborate on your ask... How do you plan to use hive... As output store?

[@avinashmishra4995]

Long time no see!!! 😊

[@DataSavvy]

Hi... Was having some health issues... I am back with god's grace... Will try to continue as much as possible :)

[@avinashmishra4995]

@@DataSavvy take care Harjeet sir. Wish everything is fine.

[@DataSavvy]

Thanks Avinash