Olympic Data Analytics | Azure End-To-End Data Engineering Project

  Рет қаралды 385,492

Darshil Parmar

Darshil Parmar

Күн бұрын

Пікірлер: 644
@upper_cut5159
@upper_cut5159 8 ай бұрын
I had not idea what I was doing. But I followed your lead and completed the project. I'm sold on this journey. Thank you!
@DarshilParmar
@DarshilParmar Жыл бұрын
These many views but why LIKE counts are still less? Take one second to like and help this channel to grow :) please?
@Cussmem07
@Cussmem07 Жыл бұрын
Thank you for your effort, sir.
@viswanathtgr7966
@viswanathtgr7966 Жыл бұрын
Thank u
@GATE_Education
@GATE_Education Жыл бұрын
multiple copy activities can we use one for each activity instead of inside copy activities
@prabhatgupta6415
@prabhatgupta6415 Жыл бұрын
@@GATE_Education yes u can use just pass the parameter at run time. have a textfile with name of all the data then read it one by one then pass it as a parameter
@HHHMED2009
@HHHMED2009 Жыл бұрын
man, you are really amazing
@saroshfaisalkhan3531
@saroshfaisalkhan3531 3 ай бұрын
Hello, Darshil. Today, at 4:50 PM, I finished the first phase of Data Engineering adventure, and the sense of success is beyond description. The joy I feel is great, and I wanted to share it with you because you inspired me to begin this adventure. You will always hold a special place in my prayers. Thank you so much, Darshil, for contributing to this accomplishment. With deepest thanks.
@hannahabigail909
@hannahabigail909 11 ай бұрын
I've checked bunch of channels and series videos and it seems you know what you're doing and love what you're doing. Great great work! Subscribed. Keep up!
@pakhijoshi3822
@pakhijoshi3822 Жыл бұрын
Darshil, you are an amazing human being, giving such informative tutorials free of cost is quite rare these days so I really appreciate your efforts. Thank you so much for teaching with so much clarity and simplicity. You're the best!!❤
@DarshilParmar
@DarshilParmar Жыл бұрын
Thanks a ton
@syedjunaid123
@syedjunaid123 Жыл бұрын
I'm so glad I found this video before I started my Azure Data project. It saved me so much time and frustration. And I'm definitely subscribing to your channel and looking forward to more Data related tutorials.
@MadanMohanMedaramitla
@MadanMohanMedaramitla Жыл бұрын
Hey Darshil, I wanted to thank you for the informative and useful session. Your content is great and very helpful. I appreciate that you are one of the few KZbin channels that covers end-to-end data engineering projects.
@rameshbayanavenkata1305
@rameshbayanavenkata1305 Жыл бұрын
Thank you Darshil for providing such end-to-end data engineering projects for our viewers. The efforts you been putting on are so great. looking forward for more and more projects... thank you once again...
@DarshilParmar
@DarshilParmar Жыл бұрын
You are most welcome
@shrirambuchkul
@shrirambuchkul 10 ай бұрын
java.lang.NullPointerException how to solve it@@DarshilParmar
@sauru_6527
@sauru_6527 Жыл бұрын
I just completed the Python course today I got notification 🔔 of this project It's really great learning Thank you Darshil Please give me like ❤
@dineshwijesuriya4899
@dineshwijesuriya4899 5 ай бұрын
I'm a totally a beginner. Completed the part 1 successfully. Truely thankful to you. ❤
@yizmo5674
@yizmo5674 Жыл бұрын
This is my very first comment on KZbin normally I just watch but ever since I got the idea of transitioning into a data engineer, I've been watching a lot of videos and I am 100 percent sure this is the best! Thanks, Darshil!
@satyaprakashch6290
@satyaprakashch6290 10 ай бұрын
Great content Darshil, After completion of data engineering internship, Iam looking for real time open source projects, this is one of the best project i have found it covers all major Tools/Technologies that i have learned in the internship. Thank you.
@apawanstevemichael5239
@apawanstevemichael5239 Ай бұрын
This is the most detailed and straightforward tutorial so far. Thanks! Hopefully will become a Data Engineer by 2025 😁
@MutethiaKigea-s3o
@MutethiaKigea-s3o Ай бұрын
We have same aspiration brother. We can be learning buddies if you are interested.
@RAHULRAHUL-xb7xd
@RAHULRAHUL-xb7xd Жыл бұрын
amazing Drashil, as you said in the video many people take thousands of money for this but you still explained it very easy and free of cost for the viewers, appreciated brother..... thank you
@vaibhavkamble3325
@vaibhavkamble3325 Жыл бұрын
Hey Darshil, Your video was a game-changer for me! I've always been curious about the inner workings of the industry, and your content came at just the right time. Your teaching method is incredibly effective, breaking down complex concepts into easy-to-understand chunks. You've given me the direction I needed to kickstart my learning journey in this non-tech realm. Now, I not only understand how it all works but also know where to focus my efforts. Your comprehensive approach for beginners is exactly what I was searching for. Expect me to be a regular viewer, soaking in all the valuable insights you share. Thanks a ton for being the guiding light I needed!
@yadarthdhiman4904
@yadarthdhiman4904 5 ай бұрын
I am still working on this project alongside the video at 59:42 and couldn't resist thanking you enough, @DarshilParmar. Keep up the good work, champ.
@gtanation4729
@gtanation4729 10 ай бұрын
Just completed my first project, Thanks alott Keep upload azure data engineering videoss
@alanfung4516
@alanfung4516 Жыл бұрын
I have watched many data engineering videos on youtube, this is by far the best one I ever watched, thanks alot
@anti-materielrifle
@anti-materielrifle 2 ай бұрын
Hi i started to learn Data Engineering, there's not too much info on youtube and internet at all, but this video by far has answered a lot of questions i had for a long time, thank you so much!
@happyheart9431
@happyheart9431 Жыл бұрын
I just want to say a million, thanks.. I just finish my Azure Synapse Analytics certification, and this video gave me so much confidence for my interview.
@preethamreddy787
@preethamreddy787 9 ай бұрын
Hey hi, I am thinking to start learning azure synapse. Could u pls guide me how can I start with and any suggestions for resources. Thanks in advance 😊
@kdiggity1
@kdiggity1 8 ай бұрын
Love the structure of this walkthrough, the level of detail is just right amount.
@nehashahpatel1741
@nehashahpatel1741 9 ай бұрын
Million thanks Darshil for sharing knowledge.. I just resume from my maternity leave and your videos give me so much confidence to upgrade my skills.. Many more success to you
@DarshilParmar
@DarshilParmar 9 ай бұрын
All the best
@ankitajain5770
@ankitajain5770 2 ай бұрын
Thanks darshil for this project. I have completed the remaining part of the project i.e powerbi dashborad.
@m.abdullahmansoor4925
@m.abdullahmansoor4925 5 ай бұрын
Thank u so much bro I copy pasted all of your video content and eventually got the best project in the class. ❤️
@darkpander-vk2jr
@darkpander-vk2jr Жыл бұрын
Thank you so much brother. Your motivation helped me get my DP-203. Now I’m currently doing a guided project from udemy. Once that is done, i will surely do this❤
@nihaaru8752
@nihaaru8752 Жыл бұрын
Can you please share the project name/details please ?
@timianalytics7150
@timianalytics7150 Жыл бұрын
Co-ask.. Please share the guided project details
@darkpander-vk2jr
@darkpander-vk2jr Жыл бұрын
@@nihaaru8752 Azure Data Factory For Data Engineers - Project on Covid19 on Udemy by Ramesh Retnasamy
@madhubanti123
@madhubanti123 Жыл бұрын
can you share the prep for DP-203 please
@SunilNagavelli
@SunilNagavelli Жыл бұрын
Your content is gold!. I hope you keep doing such exciting work. Glad to have come across your channel!
@ShahrukhHussain-rn7pg
@ShahrukhHussain-rn7pg Жыл бұрын
Amazing introductory course taught with adequate attention-to-detail, and well delivered too! Kudos man
@afzaalawan
@afzaalawan 7 ай бұрын
Young man, you deserver a kiss on your forehead for this fantastic piece of presentation in wonderful way -- May God Bless you
@RutujaDeshmukh-u5v
@RutujaDeshmukh-u5v 2 ай бұрын
This was such a great video! The way you explained the complex process made it really easy to understand, even for beginners. I especially appreciated the real-world examples and step-by-step demos. Looking forward to more content like this-thanks for helping me get started with this!
@dushyantsharma2024
@dushyantsharma2024 4 ай бұрын
Reached 1:00:22 and Taking a short break. It's really informative. Thank you Darshil!
@rajarshisikdar8800
@rajarshisikdar8800 Жыл бұрын
You are doing a very good service for the data engineering aspirants. Keep it up. Godspeed.
@abhijeetnayak9077
@abhijeetnayak9077 Жыл бұрын
Nice Explanation bro, experts generally cut of the thinking part and just show things in a mechanical way, but you tellin your though process while doing things makes learning very interesting and avoids distraction as we are not needed to serch for small small details at any other place.... Thanks man
@shubhamgupta1632
@shubhamgupta1632 Жыл бұрын
Whenever I watch your video, I gain new insights. Thank you; your efforts are truly appreciated.
@piyushlakheda
@piyushlakheda Жыл бұрын
Great video! Not a Data person but really understand the concepts from it! Moving to next part now! Thanks a Lot for this! :)
@OmolaraFash
@OmolaraFash 10 ай бұрын
I just completed the first part without any issues, welldone and thanks for this content, looking forward to more
@itsmeshivendra
@itsmeshivendra 3 ай бұрын
after personal learning, just created this project. Thank you so much for the video.
@randyvelasco5079
@randyvelasco5079 10 ай бұрын
Just finished this part without issues... easy to follow. Will do the second part a little later... Thanks Darshil.
@balive053
@balive053 Жыл бұрын
Great video! very clear explanation without going into too much detail. Thanks for making it!
@bittencourt1869
@bittencourt1869 6 ай бұрын
Congrats perfect explanation comparing to other channels now I can cleaar understand all the steps ingestion, transformation and storage
@lazycool3611
@lazycool3611 2 ай бұрын
Thanks for this beginners guide Darshil, helped to understand the fundamental functioning.. hope to see such playlists more!
@ermoonskyangel7503
@ermoonskyangel7503 4 ай бұрын
I like the way you describe! I am very greatful that you included all tools even some features overlapping
@AjithMurugesan-h4t
@AjithMurugesan-h4t Жыл бұрын
completed on 20-nov-23 , i was not consistent took many gaps but glad i completed thanks
@OmolaraFash
@OmolaraFash 10 ай бұрын
Thank you again for this video, I just concluded my version, and I am excited to make on research on what have learnt and keep practising
@imehmood4839
@imehmood4839 8 ай бұрын
Just finished this part!! Thank you for creating this valuable content.
@vaijayantigulve4883
@vaijayantigulve4883 Жыл бұрын
I liked the UI of Azure Synapse Analytics better than the others. Thank you so much for all the knowledge.
@anonymousgal100
@anonymousgal100 Жыл бұрын
Hey Darshil, I have completed first part, following along. A big thanks to you for putting so much efforts. The idea of explanation of services along with ongoing project is awesome. Keep doing such great work.
@sayan1231000
@sayan1231000 Жыл бұрын
just one word: WONDERFUL
@dhwanimehta7719
@dhwanimehta7719 7 ай бұрын
Thank you Darshil I have reached 1:00:03 / 1:35:59 • Complete Project Execution
@Iceiam
@Iceiam 2 ай бұрын
How long did it take you to complete End to End and did you do any courses before hand? :)
@analyticsWithJay
@analyticsWithJay Жыл бұрын
This is amazing, bro! Thank you for the detailed hands-on session. It's easy to understand.
@muhammadmuzzamilnagda1438
@muhammadmuzzamilnagda1438 2 ай бұрын
It was a great tutorial. I followed each and everything which I feel help me building the portforlio to apply for data engineering. Thank you so much. From now on you are my data guru. :)
@amanahmed6057
@amanahmed6057 Ай бұрын
hello bro , i am not able to download raw dataset , as soon as i click on raw , file is automatically downloading
@borrarao1525
@borrarao1525 Ай бұрын
@@amanahmed6057 same for me, waiting for solution on this
@mohitsharma-vd2oi
@mohitsharma-vd2oi 3 ай бұрын
Completed the ADF part, thanks for structuring this so well Darshil :)
@UmutEmre-wb3do
@UmutEmre-wb3do 4 ай бұрын
4ra ke events bohot entertaining hote hain, bhai ki recommendation bilkul sahi thi
@tusharhatwar
@tusharhatwar Жыл бұрын
More Support to you brother ❤ All your videos are helpful And your Channel is DEFINITELY a GOLDMINE 😊
@DarshilParmar
@DarshilParmar Жыл бұрын
Thanks a ton
@DATA_MACHINE22
@DATA_MACHINE22 Жыл бұрын
thanks Darshil for uploading free content, appreciate your efforts
@abhisheksivalingala6420
@abhisheksivalingala6420 Жыл бұрын
Great ....you are just giving the valuable content for free....god bless❤️🙏
@Chan-ln3bv
@Chan-ln3bv 7 ай бұрын
Thank you so much.part1 was done successfully .. NXT -> moving to part 2
@mohamedmeqlad8064
@mohamedmeqlad8064 Жыл бұрын
this the kind of projects I have been waiting for. I really want to thank you for your great content
@DarshilParmar
@DarshilParmar Жыл бұрын
My pleasure!
@priyalverma234
@priyalverma234 8 ай бұрын
Hi Darshil, This video helped me a lot in kickstarting my understanding of Azure Databricks. I am glad to have come across your channel. Thanks a ton for this and I hope your channel grows beyond expectations :)
@priyankadp5777
@priyankadp5777 Жыл бұрын
This was awesome Darshil.. had a great time implementing this alongside you.. great explanation.
@vinothganapathi5571
@vinothganapathi5571 2 ай бұрын
Interesting bro, Thanks for sharing Azure End-To-End Data Engineering journey.. part 2 is loading.
@ravinithwin189
@ravinithwin189 4 ай бұрын
Just want to say Thank you for teaching in such an easy wayy
@SirichandanaGodavarthi
@SirichandanaGodavarthi 10 ай бұрын
Thank you for sharing your knowledge with us. Lots of support from everyone.
@mohammedshoaib1769
@mohammedshoaib1769 Жыл бұрын
Great content. Completed implementing the same. It was smooth.! Waiting for second part.
@DarshilParmar
@DarshilParmar Жыл бұрын
It’s already there, check description
@heljava
@heljava 9 ай бұрын
Thank you. It is a very good project to connect different Azure products and learn more about the Data engineering tasks, even if it is in a smaller scale. I will definitely try to implement something similar in the future, but using APIs and from there I can do the transformations either in Azure DF (like mapping Data Types) or Azure DBricks.
@DarshilParmar
@DarshilParmar 9 ай бұрын
Glad it was helpful!
@HemantKumar-su1qt
@HemantKumar-su1qt 7 ай бұрын
Hi sir I personally thank you very much for the AWS Data Engineering Project series and we are learning a lot from them. We all are really grateful for this level of your generosity. Our humble request you to create an Azure Data Engineering Project using SQL & SSMS as there is only one project of Azure Data Engineer. We want to learn more about the Azure Data Engineering Project as there is no Azure Data Engineer project using Bronze, Silver & Gold layer transformation in PySpark DataBricks and SSMS respectively. I hope our request will soon be accepted from your end. Thank you so much for your valuable guidance & support.
@ranjitprakash1986
@ranjitprakash1986 Жыл бұрын
Exactly what i was looking for in cloud computing using azure, thanks so much!
@aryamathew2273
@aryamathew2273 11 ай бұрын
Thanks Darshil! I was able to complete the project, and I learned so much along the way!
@gowreeManohar
@gowreeManohar Жыл бұрын
a quick overview to understand the similarities between each of them! great video bro
@Mustafabatman611
@Mustafabatman611 Жыл бұрын
Thanks a lot, Mr. Darshil please Keep posting like these videos about data engineer projects again thank you a lot your videos help me a lot
@alexanderpotts8425
@alexanderpotts8425 Жыл бұрын
"Have some water, stay hydrated". love it
@Likhitharaju-j1w
@Likhitharaju-j1w Жыл бұрын
With this kind of amazing tutorial and explanation gives interest to learn more
@akhildeshneni9922
@akhildeshneni9922 2 күн бұрын
thanks for creating this project, helps to understand the etl process
@terimaakichuth69
@terimaakichuth69 Жыл бұрын
Thank you for the detailed project. I'm going to learn and replicate it in my free time and on the weekend
@Heatflakes
@Heatflakes Жыл бұрын
Thank you darshil for making data engineering look so easy.
@NITESHKUMARJAIN-t7j
@NITESHKUMARJAIN-t7j Жыл бұрын
bro help me
@NITESHKUMARJAIN-t7j
@NITESHKUMARJAIN-t7j Жыл бұрын
ava.lang.NullPointerException i found this error while running this
@DarshilParmar
@DarshilParmar Жыл бұрын
issue is with keys, check again
@janmenjaydesai8340
@janmenjaydesai8340 2 ай бұрын
Hats off to you!!! Very Good to understand and follow for beginner's😊😊
@ramireddyvarun26
@ramireddyvarun26 8 ай бұрын
Thanks so much Darshil! Wonderful - it really helps with the jitters of understanding so many different tech stacks! :)
@akshaydeshmukh8602
@akshaydeshmukh8602 10 ай бұрын
You are doing grate work, thank you so much for providing such content which is full of knowlegde. 💙
@funsoiyaju614
@funsoiyaju614 Жыл бұрын
Thank you Darshil for sharing this content. May God continue to bless you
@iiiprjwliii1218
@iiiprjwliii1218 8 ай бұрын
A good way to start into Data engineering
@ahmetalperenyildirim6184
@ahmetalperenyildirim6184 Жыл бұрын
Awesome project, I'll do to add my portfolio!! Thank you for sharing!
@pampagrimaldi8584
@pampagrimaldi8584 2 ай бұрын
Incredible tutorial, and a great intro to Azure!
@ajayigeorge1356
@ajayigeorge1356 Жыл бұрын
Well done Darshil very intuitive video, appreciate the work. Can you do a video on how to schedule a python script on azure to run on a schedule, the python script could be extracting data from an API or something and then loading it to blob storage. Just giving ideas.
@bukunmiadebanjo9684
@bukunmiadebanjo9684 Жыл бұрын
Great content Darshil. Just concluded the first part of this project.
@ritwik99
@ritwik99 6 ай бұрын
This video is just awesome to learn so many things and understand. Thank you so much for creating such helpful content and making things simple and clear. You are doing a great work, keep going, you just got a new subscriber :)
@abhimanyuwadhwa6335
@abhimanyuwadhwa6335 Жыл бұрын
Thanks for such amazing content Darshil! Trying out Azure for the first time. :)
@DarshilParmar
@DarshilParmar Жыл бұрын
Best of luck!
@play__vibes704
@play__vibes704 Жыл бұрын
Ya definately most wanted channel 🎉 your every video is most appreciated. Please continue this series and upload part2 of this project
@DarshilParmar
@DarshilParmar Жыл бұрын
Part 2 is already available, please check description
@uchiha_sasuke_48
@uchiha_sasuke_48 Жыл бұрын
By watching until the architecture part, you grabbed me as your subscriber. Looking forward to complete all the project playlists. 🎉🎉🎉
@dhruva24_
@dhruva24_ 6 ай бұрын
Found the project helpful! Thanks a lot Darshil!
@luisosorio4456
@luisosorio4456 Жыл бұрын
Thank you so much! Best Data Engineering Platform!
@DarshilParmar
@DarshilParmar Жыл бұрын
You're very welcome!
@ptgirija
@ptgirija 7 ай бұрын
Thanks Dharshil.. this is really good.. i am new to Azure but i am able to follow . Great explanation.
@chanal4858
@chanal4858 2 ай бұрын
You r a god.... because this video..hope you make more videos
@jaggyjut
@jaggyjut 10 ай бұрын
Thank you. Please keep creating similar projects. Something I’m struggling find is end to end machine learning project with front end web application to interact with the ml model.
@ChandrakanthBoga
@ChandrakanthBoga 5 ай бұрын
Great work Darshil.. Thanks for sharing all your knowledge..
@andimuhammadalifalfajra4243
@andimuhammadalifalfajra4243 26 күн бұрын
This is such a great tutorial, Thanks a lot man!
@gauravmaheshwari1807
@gauravmaheshwari1807 Жыл бұрын
Hey Darshil, Thanks a ton for such a valuable crisp amd concise knowledge transfer video! Really Appreciate your work!
@mackshonayi943
@mackshonayi943 Жыл бұрын
Thanks, Darshil I completed part 1. I faced challenges because the account I was using is a student ACC and don't have access to Azure Active Directory to create app, but I was able to create using CLI and completed everything without an error
@DarshilParmar
@DarshilParmar Жыл бұрын
Congratulations man
@vasavihegde5186
@vasavihegde5186 Жыл бұрын
I'm facing the same issue! What is CLI?
@mackshonayi943
@mackshonayi943 Жыл бұрын
@@vasavihegde5186 CLI stands for Command Line Interface. Similar to windows command prompt
@eugene2653
@eugene2653 Жыл бұрын
This is pure gold!
@BabaiChakraborty-ss8pt
@BabaiChakraborty-ss8pt Жыл бұрын
Absolutely fantastic Tutorial. Please continue to post such in future.
@data_with_michalis
@data_with_michalis Жыл бұрын
Bravo for your effort! Video quality has been improved a lot. Keep going!
@balarajkakumanu9882
@balarajkakumanu9882 8 ай бұрын
Thanks,Very nice simple start for beginners to apply basics and understand larger picture. very helpful.
@DarshilParmar
@DarshilParmar 8 ай бұрын
You are welcome!
Noodles Eating Challenge, So Magical! So Much Fun#Funnyfamily #Partygames #Funny
00:33
Complete Azure Data Engineering Project by Sumit Sir
3:07:18
Sumit Mittal
Рет қаралды 20 М.
Fundamentals Of Data Engineering Masterclass
3:02:26
Darshil Parmar
Рет қаралды 129 М.
AWS in English - Database Part 3 - Amazon RDS Part 2
50:50
AWS WITH STAN
Рет қаралды 28
Azure Data Engineer Mock Interview - Project Special
26:28
Azurelib Academy
Рет қаралды 22 М.
How He Got $600,000 Data Engineer Job
19:08
Sundas Khalid
Рет қаралды 168 М.
Azure Data Factory Beginner to Pro Tutorial [Full Course]
2:50:26
Pragmatic Works
Рет қаралды 349 М.
Data Engineering Certifications To Get Ahead Of 99% People
10:53
Darshil Parmar
Рет қаралды 54 М.
Top 5 FREE Resources to 10X Your Data Engineering Skills
11:49
Jash Radia
Рет қаралды 70 М.
AWS UG Giza  Event
3:48:27
Advizors
Рет қаралды 1,3 М.
Noodles Eating Challenge, So Magical! So Much Fun#Funnyfamily #Partygames #Funny
00:33