Please try to make a project where one can find all these challenges. These statements won't be printed in mind unless you do some Hands on.
@zub3rahmed769 күн бұрын
Nice mam
@KavyaPristha12 күн бұрын
This is what I was looking for. Crisp, To the point and rich in info. well done girl
@BigDataThoughts12 күн бұрын
thanks
@isaackodera944125 күн бұрын
Wonderful explanation
@Themotivationstationpower29 күн бұрын
Really appreciate your hard work. Thank you for the great explanation.
@BigDataThoughts28 күн бұрын
thanks
@shubhamdaundkar8327Ай бұрын
Hello Shreya, Can you make a video of hand on Data ingestion in AWS S3?
@yashawanthraj8872Ай бұрын
Can Node/Thread have more partition than no of executors, if yes where the no of partition information will be stored.
@gvnreddy2244Ай бұрын
Very good session mam if it was a practically show means it is very useful. thank you for your efforts
@BigDataThoughtsАй бұрын
Thanks
@nishchaysharma5904Ай бұрын
Thank you for this video.
@BigDataThoughtsАй бұрын
Thanks
@vaibhavjoshi6853Ай бұрын
Getting confidence in spark because of you only. Thanks so so much!
@BigDataThoughtsАй бұрын
Thanks
@ambar7522 ай бұрын
To summarize, what the Datamarts are for a DataWarehouse, same are the DataMesh for a DataLake
@rovashri5662 ай бұрын
How did you make such a good visual explanation? Which tool you used to draw sketches ? Pls guide 🙏
@muralichiyan2 ай бұрын
Data mesh and snowflake same..? Data mesh and microsoft fabric same?
@Learn2Share7862 ай бұрын
Thanks, appreciate it.. is there a plan to post practical videos around spark performance tuning?
@user-zb9hm5yh1m2 ай бұрын
Thank you for sharing your thoughts.
@BishalKarki-pe8hs2 ай бұрын
this is not excatly asnwer
@ranyasri10922 ай бұрын
Please do videos with sample data sets so that it would help for hands on
@mindwithcuriosity53472 ай бұрын
Seems it is PAAS as mentioned on Microsoft website
@sanketdhamane59413 ай бұрын
Really Thanks to Good And Indepth Explantion
@BigDataThoughts3 ай бұрын
Thanks
@sindhuchowdary5723 ай бұрын
lets say there is no change in records for the next day.. then.. does the data gets overwrite again?? with same records..??
@BigDataThoughts3 ай бұрын
No we are only taking the new differential data when we do CDC
@sunnyd98783 ай бұрын
This is excellent and valuable knowledge sharing... Easily one can make out these trainings are coming out of personal deep hands-on experience and not the mere theory ..Great work
@BigDataThoughts3 ай бұрын
thanks
@Learn2Share7863 ай бұрын
Thank you, pls also post some practical videos around the same topic
@user-zb9hm5yh1m3 ай бұрын
Thank you for sharing thoughts
@KiranKumar-cg3yg3 ай бұрын
First one to monitor the notification from you
@shreyachakravarty13473 ай бұрын
Thanks
@ahmedaly69993 ай бұрын
how i join small table with big table but i want to fetch all the data in small table like the small table is 100k record and large table is 1 milion record df = smalldf.join(largedf, smalldf.id==largedf.id , how = 'left_outerjoin') it makes out of memory and i cant do broadcast the small df idont know why what is best case here pls help
@harigovindk4 ай бұрын
18/april/2024
@karthikeyanr11714 ай бұрын
your videos on spark are hidden gems
@BigDataThoughts4 ай бұрын
Thanks
@mdatasoft15254 ай бұрын
❤
@mdatasoft15254 ай бұрын
❤
@rupaghosh62514 ай бұрын
Nice explanation
@BigDataThoughts4 ай бұрын
Thanks
@RameshKumar-ng3nf4 ай бұрын
At the start of the video i was so happy seing all the diagrams.. Later got fully confused & felt complicated and i didnt understand well 😢
@nahomg.41914 ай бұрын
I wish I could give 1000 likes. You’re an excellent teacher!
@BigDataThoughts4 ай бұрын
Thanks
@user-eg9ed5nr8z4 ай бұрын
Nice explaination
@BigDataThoughts4 ай бұрын
Thanks
@amitgupta34 ай бұрын
found it helpful. You may go slower though. I had to stop and rewind few times.
@husnabanu43704 ай бұрын
what a wonderfull explanation to the point... thank you
@BigDataThoughts4 ай бұрын
Thanks
@sumonmal0094 ай бұрын
Good playlist for Spark kzbin.info/aero/PL1RS9FR9qIPEAtSWX3rKLVcRWoaBDqVBV
@BigDataThoughts4 ай бұрын
Thanks
@mohnishverma875 ай бұрын
Just woow, very simple explanation of a complex cluster overview.. Thanks.
@BigDataThoughts5 ай бұрын
Thanks
@masoom0025 ай бұрын
best explanation ever i came across on KZbin. watching all the parts .... Thank you for explaining it so smoothly.
@user-zb9hm5yh1m5 ай бұрын
Thank you for sharing thoughts!
@utsavchanda41905 ай бұрын
That was very well explained. Thank you for putting this together. One question though, do you really think data modelling should be done on the Gold layer? I don't think so because Gold datasets are just busineess level aggregates suited to particular business consumption needs. Whereas Silver layer is the warehouse in Lakehouse. That is where modelling should be done, if needed.
@shrabanti845 ай бұрын
Thank you so much.. all the vdos are very much clear and effective.
@BigDataThoughts5 ай бұрын
Thanks
@user-zb9hm5yh1m5 ай бұрын
Thank you for sharing your thoughts.
@BigDataThoughts5 ай бұрын
Thanks
@deepalirathod49295 ай бұрын
Finally it got cleared to me after reading here and there . thank you .
@himanshupandey85765 ай бұрын
one of the helpful session !
@BigDataThoughts5 ай бұрын
Thanks
@Learn2Share7865 ай бұрын
Nicely explained, thank you ..looking forward to learn more around this topic