These Data Engineering Projects Give You An Unfair Advantage

  Рет қаралды 66,232

Darshil Parmar

Darshil Parmar

Күн бұрын

Пікірлер: 104
@DarshilParmar
@DarshilParmar 11 ай бұрын
Going To Upload End-To-End Project soon once I reach 100k📈 Don't forget to Hit that LIKE button and Subscribe if you are here!!!
@ashutoshrastogi5381
@ashutoshrastogi5381 11 ай бұрын
Thanks for guiding us, with the simplest approach possible.... 🤩
@AkashBiswas-r2l
@AkashBiswas-r2l 10 ай бұрын
101k subscriber, congrats, expecting a new project video
@prasanthbugga8381
@prasanthbugga8381 11 ай бұрын
Bought the combo of python and SQL for DE, excited to learn and implement the projects, pls bring one Google Cloud End to End Data Engineering project (ingestion, transformation, loading).
@PrathameshMawlankar
@PrathameshMawlankar 11 ай бұрын
Thank you for the video. It was essential during these hard times in the tech industry. Have learnt Data Engineering/ETL & Analytics process from your Uber Data GCP video! Can’t thank you enough for making such awesome content for Data domain knowledge.
@DarshilParmar
@DarshilParmar 11 ай бұрын
Glad you found my content helpful Prathamesh
@hritikapal683
@hritikapal683 11 ай бұрын
Once again you're here with quality content, loved the way you structured the content this was helpful, waiting for more end to end projects!💫
@DarshilParmar
@DarshilParmar 11 ай бұрын
Thank you Hritika, more to come!
@xx-pn7it
@xx-pn7it 10 ай бұрын
Bhaiya data engineering ka internship ka roadmap bnao taki internship le sake Or use agee Or sekh sake
@Aditya..............
@Aditya.............. 11 ай бұрын
Hello Sir, Sir these Cloud Services requires credit card. I tried with paytm debit card but was not able to make it... is there any other alternatives for the cloud services??
@DarshilParmar
@DarshilParmar 11 ай бұрын
You can use your local pc and install the same things there
@prathittijare2825
@prathittijare2825 11 ай бұрын
Please share Data Analytics Project for Data Analyst Job(( for Beginners) ( using SQL, Power BI, Excel)
@DarshilParmar
@DarshilParmar 11 ай бұрын
Check the link in the description, you'll find many
@JustBigdata
@JustBigdata 10 ай бұрын
These are conceptual projects. I don’t see how creating the most general ETL pipeline gives me “unfair advantage “ . These projects may help a fresher but not anyone who have had some experience in industry
@sajidhaabdulla5486
@sajidhaabdulla5486 11 ай бұрын
Thankyou so much. This video is just perfect for my situation. I am in my final year and applying to companies. Clearly there are more jobs for freshers for the data analysts and data scientists roles compared to data engineering. I really wish to get a data engineering role itself. Any advices? Btw your videos are really guiding me from long. Please keep going. Thankuu
@DarshilParmar
@DarshilParmar 11 ай бұрын
Try to do cloud certifications and build projects, that's the best way!
@WonderGurl
@WonderGurl 5 ай бұрын
Make video on data analytics project
@anchalsinha5952
@anchalsinha5952 11 ай бұрын
Currently struggling for a job in DE field but such video motivates me alot to work on more n more project. Thanks for all such insightful contents
@DarshilParmar
@DarshilParmar 11 ай бұрын
All the best
@MOHDAKRAM21543
@MOHDAKRAM21543 11 ай бұрын
Best KZbin channel to learn python for data engineering?
@DarshilParmar
@DarshilParmar 11 ай бұрын
Check out my course, it’s one of the best designed for data engineering
@vinayakjaiswal9976
@vinayakjaiswal9976 11 ай бұрын
Can you please also make a video on behaviour questions they ask in the interview?
@raghuls1030
@raghuls1030 5 ай бұрын
The projects that u mentioned are from free tier right or is it to be paid for the services while building following projects
@DarshilParmar
@DarshilParmar 5 ай бұрын
It's free
@victors9585
@victors9585 11 ай бұрын
You rock, bro!!! 🔥👍🔥👍🔥👍🔥👍🔥 Please don't stop!!! 🙏🙏🙏 Thank you so much for your brilliant content!!! 🙏🙏👍💪🚀🌟
@DarshilParmar
@DarshilParmar 11 ай бұрын
More to come!
@vinayakjaiswal9976
@vinayakjaiswal9976 11 ай бұрын
Hey darshil , are questions of linked list , stack , queue , array and string along with some approaches like dynamic programming, greedy enough to clear coding round?
@DarshilParmar
@DarshilParmar 11 ай бұрын
I have a video on this, please check here - kzbin.info/www/bejne/nXLOaqCVmZdqr80
@AMI_1111
@AMI_1111 10 ай бұрын
Hiii...I am from a Nontech background and I want to become a data engineer, ik that for non tech ppl data analyst is the first step, there are so many resources for SQL, python n all...I am literally confused that where should I learn as I will always feel like whether I am in the right direction or no ..or whether I am referring good resources? These are the doubts that come to my mind, so can you please help Nontech ppl to switch in tech and which resources to refer
@cOnfidentialcOrp
@cOnfidentialcOrp 10 ай бұрын
The title feels a little misleading since the video is technically about how "Data Engineering works in depth" vs "data engineering projects" Regardless , its still a good video
@sumitagrawal0501
@sumitagrawal0501 8 ай бұрын
Hi Darshil, hope you are doing well.May I know, what skills are crucial for azure data engineer role and how long does it take to learn them, roadmap to follow? Another question, as a data engineer, do I need to learn data modelling, designing fact and dimension table,snowflake etc.
@niranjankashyap5452
@niranjankashyap5452 7 ай бұрын
Bro make a video on how to set up Python for pyspark in Pycharm IDE on mac and windows.
@471gohil3
@471gohil3 11 ай бұрын
Are you from gujarati Medium i m also from gujarati medium. How do you learn from efficiently. We are from same school
@tokyochannel5684
@tokyochannel5684 11 ай бұрын
@dhanasekarank1743
@dhanasekarank1743 11 ай бұрын
Hai Bro, Please help me with the below requirement. To read data from S3, perform transformations using the Medallion architecture, and load the transformed data into Amazon Redshift using dbt.
@mobinansarivlog9126
@mobinansarivlog9126 8 ай бұрын
You never disappoint. Great work 👏
@adityakalwar267
@adityakalwar267 11 ай бұрын
Hi Darshil , I am working in different domain need to transit in data engineering but i don't have prior experience in data engineering currently working as consultant and have done my MCA from NIT raipur 2023 will i get interview call if i do some of the projects after doing your projects? I mean will it be difficult or usually people get transit into data engineerin
@Thinurihewakoon
@Thinurihewakoon 5 ай бұрын
Thankuuu ❤
@urvpatel2003
@urvpatel2003 10 ай бұрын
Is there any College degree required to earn money from upwork and fiverr?
@nikhil1303
@nikhil1303 6 ай бұрын
I really appreciate the content in this video, especially as someone who's starting in data engineering.
@sanketkumar01
@sanketkumar01 10 ай бұрын
Mere Pass 3 CSv file thi maine python ki help se mysql me ek database create kr diya.. kya ye data model process bss itni hi thi ??
@prateekdaniels
@prateekdaniels 11 ай бұрын
Thanks for supporting the community. Keep up the good work.
@DarshilParmar
@DarshilParmar 11 ай бұрын
Thank you too
@adityaraghavendrap
@adityaraghavendrap 11 ай бұрын
You are providing tremendous amount of knowledge, keep up the great work. May we all grow together!
@aalamaram7680
@aalamaram7680 11 ай бұрын
Thanks for this video .❤🤝💯
@DarshilParmar
@DarshilParmar 11 ай бұрын
You are welcome
@mojito1216
@mojito1216 11 ай бұрын
One of the best video 💯❤️
@fbravoc9748
@fbravoc9748 6 ай бұрын
In which course do you think this ? The sql or the python ?
@shinghinlee7401
@shinghinlee7401 11 ай бұрын
@DarshilParmar Thank you for the video! Just want to have some advises from you. As I come from a computer engineering background, is it necessary to have a master degree to become a data engineer?
@adityalakkad8795
@adityalakkad8795 11 ай бұрын
Hey Darshil, First of all fantastic video, So many of these projects use cloud tools, we can use that once but can not keep it active as it will cost money and we are students :) , so my question is how we should present this projects in our portfolio.
@DarshilParmar
@DarshilParmar 11 ай бұрын
Put it on GitHub with script, architecture and other things that needed for project and add link in resume
@wiss1998
@wiss1998 10 ай бұрын
waiting for more GCP and DBT end to end projects! 💫
@TechyBuild
@TechyBuild 10 ай бұрын
this channel is a blessing to me. thanks you Darshil!
@avinash7003
@avinash7003 10 ай бұрын
Airflow is important ? can you explain more about it?
@gunjankothari7471
@gunjankothari7471 11 ай бұрын
U just set level high for content of data engineering field to others. Very gud step step by guide to build projects. 👍👍👍
@DarshilParmar
@DarshilParmar 11 ай бұрын
Glad you found my content helpful
@teamxipratikop9247
@teamxipratikop9247 5 ай бұрын
Really very good content.loved it.only knowledgeable talks no timepass at all in video thanks
@sharathreddy6423
@sharathreddy6423 11 ай бұрын
teaching is extremely Superb ... can u please share the Pdf or ppt for reference
@akshaymuktiramrodge3233
@akshaymuktiramrodge3233 10 ай бұрын
Hi Darshil thank you for this quality content really appreciate your work .... Can you please mention aws services required for data engineering??
@padmalochan1103
@padmalochan1103 11 ай бұрын
Thanks brother for this amazing video❤🎉
@DarshilParmar
@DarshilParmar 11 ай бұрын
You are welcome
@padmalochan1103
@padmalochan1103 11 ай бұрын
Please make a video on clearing the coding round,and how to prepair for that🙏
@DarshilParmar
@DarshilParmar 11 ай бұрын
I have a video on this, please check here - kzbin.info/www/bejne/nXLOaqCVmZdqr80
@sohamshah4666
@sohamshah4666 10 ай бұрын
This 28 mins of video are worth it and helpful ❤🙌🏻🤝🏻
@deb1995
@deb1995 10 ай бұрын
Hi darshil pls make a full series on online data base to data engineering project.
@Bhavanikotta-s7h
@Bhavanikotta-s7h 11 ай бұрын
I have paid 1299 for data engineer with python but you didn't give access to course
@DarshilParmar
@DarshilParmar 11 ай бұрын
Hi, Please email me at info@datawithdarshil.com
@priyankkumar89
@priyankkumar89 10 ай бұрын
Hi Darshil, amazing guidance, amazing work and amazing contribution to the society. Bless you. You come up as a person, who's like DK Goel or T S Grewal for accountancy students, whosoever starts his/her journey with accountancy, cannot simply go without these 2 authors (accountancy students will relate with me). Anyone stepping-in in DE domain, cannot simply go without doing your projects. Please let me know, whatever projects we make, how can we show them to the recruiters during interview. Like, when I used to give interviews for Power BI role, I used to show them the dashboards, either published on my portfolio website or any other way. So what about DE work. Also, same question for any SQL or python/pandas project. Thanks.
@zouhair8161
@zouhair8161 11 ай бұрын
Thanks you
@DarshilParmar
@DarshilParmar 11 ай бұрын
You are welcome
@the_gamer2416
@the_gamer2416 3 ай бұрын
Bhai tujhe hindi m bolne m koi prblm h ..
@DarshilParmar
@DarshilParmar 3 ай бұрын
nahi par mera audiance 60% international hai toh english me bolta hu aur mera hindi Mumbai wala tapori jaisa hai Aur data engineering me ho toh English aana important hai kyu ki sari cheeze english me he hai
@the_gamer2416
@the_gamer2416 3 ай бұрын
@@DarshilParmar bhai ek humble request h.. Hindi m bhi video bna loo.. Mujhe english m starting m samjhne m problem hota h.. Aur tapori type lang chalega koi dikkat nhi h.. M bhi delhi se hu.. Yaha pr sab chalta h
@stefantodorovikj6165
@stefantodorovikj6165 11 ай бұрын
You are insane mate , props to you
@DarshilParmar
@DarshilParmar 11 ай бұрын
Thanks man! Appreciate it
@amankhandelwal8293
@amankhandelwal8293 8 ай бұрын
Hi Darshil, Can I tell this in my 4 years experience data engineer interview?
@DarshilParmar
@DarshilParmar 8 ай бұрын
Yes
@iktrn794
@iktrn794 10 ай бұрын
thank you mr. Darshil for this amazing video! just one question though, in the last section which is building ETL project using AWS, what's the point of using Amazon S3 here? let's say we loaded the data already and is available on the RDS, can we just use that data as our source for Glue tasks without having to load them onto S3 first? thanks!
@DarshilParmar
@DarshilParmar 10 ай бұрын
Yes you can as this is single source but in real world you’ll mostly have multiple sources so S3 can act as a centralised source (datalake)
@iktrn794
@iktrn794 10 ай бұрын
@@DarshilParmarah I see that makes sense. thanks a lot! appreciate it
@darshilarsey1937
@darshilarsey1937 10 ай бұрын
Hi Bhai maira naam bhi darshil hai
@kratos_gow610
@kratos_gow610 9 ай бұрын
Isn't dimension modeling about determining the fields which are to be part of the ETL/ELT pipeline? Do correct me if I am wrong.
@DarshilParmar
@DarshilParmar 9 ай бұрын
Yes, it is, more of an iterative approach, it keeps changing but this is a portfolio project so might be one time thing here
@kratos_gow610
@kratos_gow610 9 ай бұрын
@@DarshilParmar thanks
@TechyBuild
@TechyBuild 10 ай бұрын
i noticed that, you didnt design a data model on the Uber data anallytics end - to - end. you only designed a dimensional model.
@DarshilParmar
@DarshilParmar 10 ай бұрын
Yes, I mentioned that in video also
@aryamathew2273
@aryamathew2273 9 ай бұрын
Thanks for the amazing content!
@Bhavanikotta-s7h
@Bhavanikotta-s7h 11 ай бұрын
I have dropped email as well you didn't rply
@DarshilParmar
@DarshilParmar 11 ай бұрын
Gave you reply, please check
@orlandocastellanos9263
@orlandocastellanos9263 10 ай бұрын
Gcp?
@rohitkharat2610
@rohitkharat2610 11 ай бұрын
Thank you Darshil bhai!
@wardaraees4887
@wardaraees4887 10 ай бұрын
Where are your courses you mentioned in the video?
@DarshilParmar
@DarshilParmar 10 ай бұрын
Check description
@shivarajhalageri2513
@shivarajhalageri2513 11 ай бұрын
Loved it ❤
@DarshilParmar
@DarshilParmar 11 ай бұрын
Thank you
@shivarajhalageri2513
@shivarajhalageri2513 11 ай бұрын
@@DarshilParmar Wanted to ask can we represent our experience in other domain as data engineering experience in resume while transitioning into data engineering?
@DarshilParmar
@DarshilParmar 11 ай бұрын
Yes, you can!
@shivarajhalageri2513
@shivarajhalageri2513 11 ай бұрын
@@DarshilParmar Thanks!
@TomasMorales-d7r
@TomasMorales-d7r 7 ай бұрын
love you bro thanks a lot!!!
@DarshilParmar
@DarshilParmar 7 ай бұрын
You're welcome!
@naveenperumallakumar5277
@naveenperumallakumar5277 10 ай бұрын
I actually thought you were gonna create a project and explain it through a practical example. Disappointed here
@DarshilParmar
@DarshilParmar 10 ай бұрын
Check description and you’ll find 8 of them
@elkinhuertas2137
@elkinhuertas2137 8 ай бұрын
Ungrateful fck.
Data Engineering Was Hard Until I Learned These 5 Secrets!
7:43
Darshil Parmar
Рет қаралды 46 М.
How I Would Learn Data Engineering 2024 (If I could start over)
13:46
Darshil Parmar
Рет қаралды 213 М.
Worst flight ever
00:55
Adam W
Рет қаралды 29 МЛН
Amazing Parenting Hacks! 👶✨ #ParentingTips #LifeHacks
00:18
Snack Chat
Рет қаралды 23 МЛН
ДЕНЬ УЧИТЕЛЯ В ШКОЛЕ
01:00
SIDELNIKOVVV
Рет қаралды 2,5 МЛН
The Harsh Reality of Being a Data Engineer
14:21
Jash Radia
Рет қаралды 239 М.
God Tier Data Engineering Roadmap 2024 with End-To-End Projects
20:16
Darshil Parmar
Рет қаралды 157 М.
Airflow for Beginners: Build Amazon books ETL Job in 10 mins
13:13
Sunjana in Data
Рет қаралды 6 М.
Top 5 FREE Resources to 10X Your Data Engineering Skills
11:49
Jash Radia
Рет қаралды 63 М.
How to Check if a User Exists Among Billions! - 4 MUST Know Strategies
12:44
Data Engineering Certifications To Get Ahead Of 99% People
10:53
Darshil Parmar
Рет қаралды 50 М.
Worst flight ever
00:55
Adam W
Рет қаралды 29 МЛН