What is Spark, RDD, DataFrames, Spark Vs Hadoop? Spark Architecture, Lifecycle with simple Example

[@martynaskir7852]

Most useful video about spark I have seen so far, very informative. In short time covers all main idea of it. Much appreciated.

[@TechPrimers]

+Martynas Kir Thanks martynas

[@kevinzhang8974]

very clear and simple explained .... thanks!

[@TechPrimers]

my pleasure kevin. Glad that was useful

[@dhivyaraj85]

Thank you. Great explanation. Appreciate the effort.

[@aashishpundir3019]

Content explaination and presentation is very nice.... Easy to get it..

[@ted2101977854]

Very nice! More videos plz.

[@paramitamukherjee2162]

Very nice

[@cs.beauty.debasis]

@5:06 graphX, it's graphical(visualization) or graph related algorithms (storing, querying etc.)

[@emanmoussa673]

Thank you very much! This is very helpful

[@TechPrimers]

+Eman Moussa Thank you Eman. Glad it helped you

[@kiraneranki5295]

Hello bro, Your explanation is flawless and amazing. Even though i knew spark, your video was well edited and crisp to the point. Will look forward for more videos from you. Thanks.

[@TechPrimers]

+kiran eranki thanks Kiran. Glad you liked it..

[@harjeetkumar9087]

Here are some more videos kzbin.info/www/bejne/kJrVk3xnaJpoeJo

[@rishisharma3910]

Very nice explanation

[@ajaysamdyan]

very well explain spark please explain mlib and pyspark as well

[@RohitLad]

Really Nice ... Thanks ...

[@ddhanigond]

Simple and good

[@TechPrimers]

+Deepak Dhanigond thanks Deepak. Glad you liked it

[@randeepjohar5585]

Great video,wonderful presentation and to the point ,that's what everyone needs.Thanks a lot

[@TechPrimers]

Thanks Randeep. Glad that was helpful

[@MultiRamboss]

Best for a beginner like me

[@harjeetkumar9087]

Hi, here are some spark interview questions . kzbin.info/www/bejne/kJrVk3xnaJpoeJo

[@rishabh1671]

Hi Sir, thank u for your good explanation. I want to know what all things i need to know before i start Spark because I am working as java developer with 1 year exp. and I have done work on front end like Angular , Bootstrap , J query , XSLT < HTML etc and web services like REST web services , Servlet , Spring MVC etc . So please provide guideline how to start learning spark because I want to learn this technology.

[@TrackMyPhones]

Unix and Scala is enough to start with Spark.

[@atmiksoni5859]

Pease create series of apache spark

[@rajeshhize]

How can Spark replace Hadoop man? Did Spark have its own File System? . I think you are wrong about it. Spark always added advantage to Hadoop, its not a replacement.

[@shakthivelcr7]

youre right

[@shakthivelcr7]

I think he meant -> instead of using mapreduce on data present in hdfs, we use spark context and RDDs

[@sachinarora6111]

thanks a lot, waiting for loading with java part.

[@hitenraheja4972]

Thanks alot!!!

[@TechPrimers]

Thanks Hiten. Glad that was useful

[@anjaiahseggam8703]

hi friend your explanation is super ...

[@TechPrimers]

+Anjaiah Seggam thank you Anjaiah

[@harjeetkumar9087]

Here are some spark interview questions, if you are intrested kzbin.info/www/bejne/kJrVk3xnaJpoeJo

[@cogoden]

you have saved me :)

[@SuperBhavanishankar]

Namasthe! 🙏🏼

[@professoruma]

Can I do some action on data as part of map function?? Something like reading data from s3 and training a model using that data. sparkcontext.parallelize([[file1, file2], [file3, file4]]).map(function) here fuction will take s3 file objects as input and it will use that data to train a model and save that model to s3.

[@ereshthekbr7659]

could you define what is a cluster computing and how it works in spark ??

[@TechPrimers]

Sure Eresh.

[@harjeetkumar9087]

Cluster computing is generic concept... spark is one implementation of this... hadoop is another etc... kzbin.info/www/bejne/kJrVk3xnaJpoeJo

[@prashanthr130482]

what s the difference between dataframes and dataset.. you didnt say pls

[@mutturajds2675]

Still the session could have been better, no explanation on dataframes even still the video title has.

[@aneksingh4496]

just like you created compilation of playlists for spring , do u have for spark ?

[@akshaynangude2601]

What is something like that.....

[@avinash7003]

why ppl tell scala is more powerful than python in streaming sense?

[@no_more_free_nicks]

DRR are depricated.

[@MisterKhash]

I don't undertand