What is AI and data science
14:01
28 күн бұрын
All about spark tuning
22:33
2 ай бұрын
Google Gemini vs ChatGPT
11:55
5 ай бұрын
What is generative AI
19:36
6 ай бұрын
Stream Processing Fundamentals
19:05
Spark low level API -  RDDs
12:11
10 ай бұрын
Spark structured API  - Dataframe
14:37
Spark Architecture in Depth Part2
15:15
Spark Architecture in Depth Part1
13:02
All About Continuous Integration
12:05
Understanding Spark Execution
15:33
Structured Streaming in spark
18:56
All about Debugging Spark
18:29
Жыл бұрын
What is Quantum Computing?
12:28
Жыл бұрын
All about Blockchains
16:54
Жыл бұрын
All about Data Vaults
21:15
Жыл бұрын
All you need to know about chatGPT
18:38
Top 8 Bigdata Trends
15:40
Жыл бұрын
How to build efficient Data lakes
23:13
All about stream processing
11:20
Жыл бұрын
All about partitions in spark
12:27
Пікірлер
@mohitupadhayay1439
@mohitupadhayay1439 8 күн бұрын
Please try to make a project where one can find all these challenges. These statements won't be printed in mind unless you do some Hands on.
@zub3rahmed76
@zub3rahmed76 9 күн бұрын
Nice mam
@KavyaPristha
@KavyaPristha 12 күн бұрын
This is what I was looking for. Crisp, To the point and rich in info. well done girl
@BigDataThoughts
@BigDataThoughts 12 күн бұрын
thanks
@isaackodera9441
@isaackodera9441 25 күн бұрын
Wonderful explanation
@Themotivationstationpower
@Themotivationstationpower 29 күн бұрын
Really appreciate your hard work. Thank you for the great explanation.
@BigDataThoughts
@BigDataThoughts 28 күн бұрын
thanks
@shubhamdaundkar8327
@shubhamdaundkar8327 Ай бұрын
Hello Shreya, Can you make a video of hand on Data ingestion in AWS S3?
@yashawanthraj8872
@yashawanthraj8872 Ай бұрын
Can Node/Thread have more partition than no of executors, if yes where the no of partition information will be stored.
@gvnreddy2244
@gvnreddy2244 Ай бұрын
Very good session mam if it was a practically show means it is very useful. thank you for your efforts
@BigDataThoughts
@BigDataThoughts Ай бұрын
Thanks
@nishchaysharma5904
@nishchaysharma5904 Ай бұрын
Thank you for this video.
@BigDataThoughts
@BigDataThoughts Ай бұрын
Thanks
@vaibhavjoshi6853
@vaibhavjoshi6853 Ай бұрын
Getting confidence in spark because of you only. Thanks so so much!
@BigDataThoughts
@BigDataThoughts Ай бұрын
Thanks
@ambar752
@ambar752 2 ай бұрын
To summarize, what the Datamarts are for a DataWarehouse, same are the DataMesh for a DataLake
@rovashri566
@rovashri566 2 ай бұрын
How did you make such a good visual explanation? Which tool you used to draw sketches ? Pls guide 🙏
@muralichiyan
@muralichiyan 2 ай бұрын
Data mesh and snowflake same..? Data mesh and microsoft fabric same?
@Learn2Share786
@Learn2Share786 2 ай бұрын
Thanks, appreciate it.. is there a plan to post practical videos around spark performance tuning?
@user-zb9hm5yh1m
@user-zb9hm5yh1m 2 ай бұрын
Thank you for sharing your thoughts.
@BishalKarki-pe8hs
@BishalKarki-pe8hs 2 ай бұрын
this is not excatly asnwer
@ranyasri1092
@ranyasri1092 2 ай бұрын
Please do videos with sample data sets so that it would help for hands on
@mindwithcuriosity5347
@mindwithcuriosity5347 2 ай бұрын
Seems it is PAAS as mentioned on Microsoft website
@sanketdhamane5941
@sanketdhamane5941 3 ай бұрын
Really Thanks to Good And Indepth Explantion
@BigDataThoughts
@BigDataThoughts 3 ай бұрын
Thanks
@sindhuchowdary572
@sindhuchowdary572 3 ай бұрын
lets say there is no change in records for the next day.. then.. does the data gets overwrite again?? with same records..??
@BigDataThoughts
@BigDataThoughts 3 ай бұрын
No we are only taking the new differential data when we do CDC
@sunnyd9878
@sunnyd9878 3 ай бұрын
This is excellent and valuable knowledge sharing... Easily one can make out these trainings are coming out of personal deep hands-on experience and not the mere theory ..Great work
@BigDataThoughts
@BigDataThoughts 3 ай бұрын
thanks
@Learn2Share786
@Learn2Share786 3 ай бұрын
Thank you, pls also post some practical videos around the same topic
@user-zb9hm5yh1m
@user-zb9hm5yh1m 3 ай бұрын
Thank you for sharing thoughts
@KiranKumar-cg3yg
@KiranKumar-cg3yg 3 ай бұрын
First one to monitor the notification from you
@shreyachakravarty1347
@shreyachakravarty1347 3 ай бұрын
Thanks
@ahmedaly6999
@ahmedaly6999 3 ай бұрын
how i join small table with big table but i want to fetch all the data in small table like the small table is 100k record and large table is 1 milion record df = smalldf.join(largedf, smalldf.id==largedf.id , how = 'left_outerjoin') it makes out of memory and i cant do broadcast the small df idont know why what is best case here pls help
@harigovindk
@harigovindk 4 ай бұрын
18/april/2024
@karthikeyanr1171
@karthikeyanr1171 4 ай бұрын
your videos on spark are hidden gems
@BigDataThoughts
@BigDataThoughts 4 ай бұрын
Thanks
@mdatasoft1525
@mdatasoft1525 4 ай бұрын
@mdatasoft1525
@mdatasoft1525 4 ай бұрын
@rupaghosh6251
@rupaghosh6251 4 ай бұрын
Nice explanation
@BigDataThoughts
@BigDataThoughts 4 ай бұрын
Thanks
@RameshKumar-ng3nf
@RameshKumar-ng3nf 4 ай бұрын
At the start of the video i was so happy seing all the diagrams.. Later got fully confused & felt complicated and i didnt understand well 😢
@nahomg.4191
@nahomg.4191 4 ай бұрын
I wish I could give 1000 likes. You’re an excellent teacher!
@BigDataThoughts
@BigDataThoughts 4 ай бұрын
Thanks
@user-eg9ed5nr8z
@user-eg9ed5nr8z 4 ай бұрын
Nice explaination
@BigDataThoughts
@BigDataThoughts 4 ай бұрын
Thanks
@amitgupta3
@amitgupta3 4 ай бұрын
found it helpful. You may go slower though. I had to stop and rewind few times.
@husnabanu4370
@husnabanu4370 4 ай бұрын
what a wonderfull explanation to the point... thank you
@BigDataThoughts
@BigDataThoughts 4 ай бұрын
Thanks
@sumonmal009
@sumonmal009 4 ай бұрын
Good playlist for Spark kzbin.info/aero/PL1RS9FR9qIPEAtSWX3rKLVcRWoaBDqVBV
@BigDataThoughts
@BigDataThoughts 4 ай бұрын
Thanks
@mohnishverma87
@mohnishverma87 5 ай бұрын
Just woow, very simple explanation of a complex cluster overview.. Thanks.
@BigDataThoughts
@BigDataThoughts 5 ай бұрын
Thanks
@masoom002
@masoom002 5 ай бұрын
best explanation ever i came across on KZbin. watching all the parts .... Thank you for explaining it so smoothly.
@user-zb9hm5yh1m
@user-zb9hm5yh1m 5 ай бұрын
Thank you for sharing thoughts!
@utsavchanda4190
@utsavchanda4190 5 ай бұрын
That was very well explained. Thank you for putting this together. One question though, do you really think data modelling should be done on the Gold layer? I don't think so because Gold datasets are just busineess level aggregates suited to particular business consumption needs. Whereas Silver layer is the warehouse in Lakehouse. That is where modelling should be done, if needed.
@shrabanti84
@shrabanti84 5 ай бұрын
Thank you so much.. all the vdos are very much clear and effective.
@BigDataThoughts
@BigDataThoughts 5 ай бұрын
Thanks
@user-zb9hm5yh1m
@user-zb9hm5yh1m 5 ай бұрын
Thank you for sharing your thoughts.
@BigDataThoughts
@BigDataThoughts 5 ай бұрын
Thanks
@deepalirathod4929
@deepalirathod4929 5 ай бұрын
Finally it got cleared to me after reading here and there . thank you .
@himanshupandey8576
@himanshupandey8576 5 ай бұрын
one of the helpful session !
@BigDataThoughts
@BigDataThoughts 5 ай бұрын
Thanks
@Learn2Share786
@Learn2Share786 5 ай бұрын
Nicely explained, thank you ..looking forward to learn more around this topic
@BigDataThoughts
@BigDataThoughts 5 ай бұрын
Thanks
@srinivas123j
@srinivas123j 5 ай бұрын
well explained!!!
@srinivas123j
@srinivas123j 5 ай бұрын
Well explained!!!
@srinivas123j
@srinivas123j 5 ай бұрын
well explained!!
@BigDataThoughts
@BigDataThoughts 5 ай бұрын
Thanks
@srinivas123j
@srinivas123j 5 ай бұрын
well explained
@BigDataThoughts
@BigDataThoughts 5 ай бұрын
Thanks
@user-zm2me1gc5z
@user-zm2me1gc5z 5 ай бұрын
Nicely explained and thanks. helping a lot