Getting into Data Engineering - Courses, Projects, and The Reality

[@DarshilParmar]

Sorry there was some editing issue in video, did not realise it but content is good

[@shubhamlahoti8152]

Thanks for this guideance

[@aayushrijal9077]

Hey darshil would you recommend MacBook for data engineer?

[@Programmer_cum_Designer]

Bro0, u can make ur videos in mixed languages coz majority of learners are from non - eng background!... otherwise ur content is gud👍👍👍

[@rajeshparanjpe7823]

Nice info

[@mcraven281]

Bro what is full stack In data engineering

[@laurentruong]

This was very humbling. I’m learning by myself right now and this clarified a lot b/c I was getting a bit overwhelmed by all of the roadmaps I saw on how to become a DE. Thank you. (:

[@Adi300594]

I relate so much with you when you mentioned about certification loop. However I am struggling in that as well

[@DarshilParmar]

I have detailed video on this topic too, you can check my channel for more

[@shailaambekar1061]

I'm starting my journey in data science. I've completed my B.E. petroleum and now looking to get in DS. I'm starting with python.Hope this channel helps people like me.

[@DarshilParmar]

All the best, I will do my best here

[@abhishektrivedi9622]

Best strategy to learn programming - Learn fundamentals Start a project Learn things that you need in the project

[@DarshilParmar]

Correct

[@varuns4472]

Tats true..... I have around 13 years of experience in etl projects ...specialist in informatica... currently am trying hard to learn machine learning. Started with python I learnt all concepts implemented but wanna do project In python can anybody help it.

[@geethavadde]

​@@varuns4472hii

[@nikhilmunj108]

You've put it up Fantastically, Darshil bro!

[@yash141512]

Great work Darshil. Keep going. Kudos to you

[@giridharan3678]

Great video...Same experience... Need to implement projects

[@jeromesimms]

This is a really inspiring story. I have subscribed to learn more about data science and data engineering

[@DarshilParmar]

Thank you

[@amitlondhe3651]

I am currently working on data migration with plsql development. From last month in my organization I have aspired for big data engineer role, for that there is lot of learning they assigned to me. And I found your videos really helpful and motivated for the same aspiration. Thank you.

[@DarshilParmar]

All the best Amit

[@arjunbhasin8302]

Being a Data Engineer who started off as Data Scientist due to hype ... can relate very much

[@DarshilParmar]

✅

[@patrickbateman7665]

@@DarshilParmar Same here 😂 Started with Data Science and trying to move into Data Engineering. But what if Data Engineering also gets Saturated like Data Science? 🤔💭

[@YOUTHCAREERHUB]

@@patrickbateman7665 sir what about data analyst ? Is data analyst good career option ?

[@patrickbateman7665]

@@YOUTHCAREERHUB Yes

[@arjunbhasin8302]

@@patrickbateman7665 It will. But skills and expectations are very high from DE.

[@aliffnabil5542]

This is very relatable! I found out that we do not learn by taking all the courses offered out there but we really learn by actual doing our own projects!

[@santiagobardelli5675]

I agree, most people learn by doing... Not everyone become an expert just going to the University...

[@vivekjoshi3769]

Problem is how you know which projects will actually work for you, which projects could show your best skills. Since every data related project has a different context and background, it's really hard to find the best one which can help you give 100%.

[@chandrahasminajigi7160]

Totally relate to you.Applied for Data scientist role and got Data Engineer role

[@sanower01]

Same here

[@umakanta7]

Great..nice content ..good work and keep it up

[@DarshilParmar]

Thank you, I will

[@ashishdukare1313]

100% relatabe. Thanks a lot for making this video :)

[@razzakahmad8731]

I was technically very good in machine learning as good as I have published one research paper in ieee. I gave 6-7 interviews and in all of them I was rejected mainly due to my speaking skills which can be improved but what if it is in my genes i.e I am an extreme case of introvert like I have all the technical knowledge of the subject but It is too hard for me to express that to group of people. Hence I had to let go of that dream.

[@DarshilParmar]

You have to work on it, I am an introvert too, it took me lot of courage and trail to start this and many other things. Go out, talk and get uncomfortable. That's the only way to go forward

[@salmaanabdul1305]

Don't let it go bro. Keep learning and practice soon u will see different

[@swatikarot8272]

Exactly my story. Right now i am in the certification loop. Hope I can follow your path.

[@DarshilParmar]

All the best

[@YOUTHCAREERHUB]

Sir what about data analyst ? Is data analyst a good career option in india or all over the world ?

[@santiagobardelli5675]

Thank you for the information on your path. I am starting with Python, but I was not sure it was the right starting. I found you advise very valuable... Thanks for sharing...

[@DarshilParmar]

Hey Santiago, You are most welcome and you can also check out my Data Engineering roadmap

[@overlord7096]

I am a data engineer. We rarely do coding with python or with any other language. We use all time SQL. although you need coding understanding. But it's Not required. All this bootcampers are misleading you.

[@ruchitadarandale8498]

Please make a video on how to get started from the beginning. As my story is same as yours i do some of the courses but i cannot solve some problems. So please make a video related to it

[@DarshilParmar]

Please check my channel and you will find everything

[@shivakundan8126]

I'm subscribing from this video because i find this video informative

[@DarshilParmar]

Thank you

[@youraverageguide]

Great video Darshil. It has provided me a lot of clarity. Looking forward to more such amazing videos.

[@DarshilParmar]

Thank you

[@aquibriazahmed1212]

Thanks Man! I can really relate to whatever you're saying since I am just starting my career as a DS. I reckon, it's about patience and engaging more and more with hands on project. Keep up the good work buddy!

[@DarshilParmar]

Thanks man

[@govardhan9418]

I have two years of experience as a MySQL DBA. Am I eligible to land in data engineering and get internship ??

[@rameshwarsingh5859]

FIRST OF ALL

[@prasadwarkhandkararts5358]

I have done my engineering, someone should have told me this before, now I am just applying for jobs

[@DarshilParmar]

It's never too late, you can still get everything

[@gymgazm]

Hi Darshil, I am from Commerce background and planning to learn data science, I am completely newbie and want to start from scratch. Would you suggest something and do you think I should give it a try? Thanks

[@DarshilParmar]

Yes, you can do it but you will have to work really hard. It's not just about learning programming language and tools you will also need to understand computer science fundamentals

[@aek12]

@@DarshilParmar Thanks.

[@bhaskar9781]

Same bro , started with data science now I'm a data engineer ,I took like ⁵ courses, I can mirror myself in you.

[@dharmendragurjar5386]

Hey Darshil, Brother i am an experienced professional working with ETL(so i have good understanding on SQL and RDBMS) since 8 years, I have learned myself python & Tableau and also i have done 5-6 projects on Data-Analysis but i am still not very sure if i should look to switch my career to Data-Analyst or to an Data Engineer. After watching your video now i feel that i can more relate with Data Engineer than a Data Analyst according to my skill-set. Any suggestions Brother ?

[@davebatista8636]

Sir meri bhi help kar dijiye please... Life barbaad ho rhi h.... Please sir guide me

[@aek12]

can a guy passed out in 2018 from eee become the data engineer? Do they care about degrees in interview or the projects? or both?

[@vineethchinna3951]

Need a suggestion bro, right now I am into etl informatica i want to go for data engineer roles what all additional skills i require please answer the question if you have idea

[@DarshilParmar]

I have roadmap, that will help you. Please check that on my channel

[@shashankemani1609]

Superb!

[@DarshilParmar]

Thanks a lot!

[@mohitshrivastava4677]

I'm having 2 year of experience in software engineering but looking for change in big data. Find difficult to enter as fresher in big data. Can anyone suggest me what should i do

[@DarshilParmar]

I have a roadmap of this, just see that and fill your skill gaps

[@vivekjoshi3769]

Hello! I have been preparing to make a career switch to analytics from a Non-Stem background. I did Google Data Analytics Certificate but it taught me R. I am now stuck in R vs Python hell. I talked people and almost every person who is in Indian region tells me to Focus on Python libraries instead of R. After completing the course I tried to learn R from various sources(book & online articles) because the R covered in the course wasn't good enough. Again, I am getting stuck and in dilemma whether to get deeper into R and continue making projects in R or dive into python numpy, pandas etc. & gain skills to use on the projects. I am not able to find the way. Please throw your. 2 cents on me.

[@DarshilParmar]

Learn python it has much broader scope and community support

[@akankshasoni3479]

Yes please learn python

[@AvinashKumar-ym2zq]

I am on the same path, currently working with 2nd internship and it is paid (25k). Your video suddenly pop-up in my KZbin recommendation. I can see my future here. 😀

[@DarshilParmar]

Welcome brother

[@pratikshakhalane9484]

Avinash Kumar What is your education qualification? Where did you start your journey?

[@AvinashKumar-ym2zq]

@@pratikshakhalane9484final year B.E

[@pratikshakhalane9484]

@@AvinashKumar-ym2zq from where did you learn it? Were you self taught?

[@AvinashKumar-ym2zq]

@@pratikshakhalane9484 Yes, most of the things are self tough as @Darshil have mentioned all the ways.

[@shivatrivedi6964]

thnku brother ❤

[@abidvu2472]

Agree. Finishing the course about a technology or even earning a cert about it would not guarantee that you're capable of actually implementing it, not mentioning in the production environment. BUT...before start a project, at least you need to know the basics about it. Follow step by step tutorials to build a project wouldn't help much either. Besides, really? 6 months - a year for a decent internship? That sounds scary!

[@mohamedfwzy5701]

I want to practice on projects for ETL, web scraping, and a use case to solve it and draw an ERD diagram to improve my skills as a junior Data Engineer. any advice on where could I find these things.

[@manideep6814]

This is great content. I am going to mad over this decision over time. I see being a Data Engineer makes more sense in the long term.

[@DarshilParmar]

All the best

[@dataisfun4964]

Project is very important.

[@SnowflakeSavvy]

Great video. Thanks for sharing your journey. Hope you don't mind me sharing the following 2 points about this video. Please loose the sound effect when you show a slide in your video. It does not help the watching experience. The other point is about your delivery. It would be so much better if you spoke a bit slow, so that we connect with the technical details you are talking about. On the whole, excellent work bro, and please keep it up.

[@DarshilParmar]

Hello, Thank you for watching this video and taking your time to comment, I will keep in mind these points and I already started working on it! Thank you for valuable feedback

[@aakritichoudhary2211]

Hi Darshil, how can i apply for internships?

[@mirirshad8133]

How you complete this project without knowing anything still confused . delete pics which we dont need

[@desparadoking8209]

Thanks Darshil for the informative video, I am working as data Engineer in Azure Cloud, I want to work in AWS as Data Engineer, can you guide me how can i find the internships on internet, or linkedin or xing or any other platform to achieve it so that i can learn aws while working in project??

[@DarshilParmar]

You can do certification AWS SAA and get started easily

[@desparadoking8209]

@@DarshilParmar hello darshil, can contact you on your mail and discuss on this in details, if possible ??

[@sankarreddy2627]

Hi , actually am working as java developer..exp is 2 years . I want to move in data engineer. Is it good way?

[@lifelongexplorers]

Great Video ! Can you please share some thoughts on other technologies as well, how to choose between DS/Salesforce/Blockchain. Thanks

[@DarshilParmar]

All these 3 things are different, it depends on your goal

[@partabparmar5537]

this is some thing which i am looking for.....thank you so much..😇😇

[@DarshilParmar]

Most welcome 😊

[@priyankadubey2528]

Hi. Do you take classes for data engineer?

[@lonebadatel]

Thanks, buddy, for sharing your useful learnings

[@DarshilParmar]

You are welcome

[@veeresh5239]

Where do you get data engineer internships??

[@samiksharathore3186]

I never felt so related to any video this much.❤ this is purely my journey till first half.

[@sufyanzaheeri2263]

Your content is really good glad to subscribe.

[@tapanpatel6702]

Hey, I would love to know more about your photo deleting model to see how it actually perform. Do you have any video or anything of that model?

[@DarshilParmar]

I don't have video but it is on my Github - github.com/darshilparmar/Exam_Notes_Detection

[@tapanpatel6702]

@@DarshilParmar perfect thanks 🙏🏻

[@aniketnaik7580]

Loved your journey.Keep sharing !!your content is really awesome.

[@DarshilParmar]

Thank you Aniket

[@MDARUN-ph1dw]

Thanks man you are doing great 😊👍

[@DarshilParmar]

Thank you

[@ashwinipatil1231]

Python, sql, link please.. Tutorial

[@neerajmehra8222]

Please tell us about your work that you get on freelancing. And also how much you get paid

[@DarshilParmar]

I already have a video on this, please check it

[@satyajitpatel8372]

Is it possible to do intensive while working in MNC

[@ashwinipatil1231]

Hii i am also interested on data science.. Can you help me

[@madmaagic]

Some Links to practice , tutorial to learn?

[@rinadebnath9791]

I completed B. Tech . Now I am a lead generation specialist. But I want to become data Engineer. , Your content is really best for that

[@DarshilParmar]

Thank you

[@Velben]

I know how to do all the projects on your channel, understand data structures, ETL pipelines and its still hard to get a job because they want you to have experience

[@DarshilParmar]

Try internship first and then go about jobs Also if you know how to do then build some projects and showcase that. Projects=Experience too

[@chuongle7456]

Very nice Vid! Can I have some project ideas while learning Apache Spark? Thank you!

[@DarshilParmar]

Check my project ideas to understand more

[@jeevanchavan143]

We have same journey 😀

[@jujijiju6929]

Lmao, you're a data engineer like I'm a rocket engineer which I'm not.

[@DarshilParmar]

Okay!

[@ashwinipatil1231]

What are the tools needed to bcme data engineer

[@fashiuddin7911]

Almost the same story: I started with Bg data engineering but didn't how and where to start didn't even know what is data engineering at that time, then learned Data Scinece did a few internship on it where I learned about data engineering. then moved to backend with Python. from there to learned a bit of DevOps. then learned all the technologies including Pytohn, SQL, Flask, Docker PySpark, Hadoop, Hive Kafka, AirFlow, PowerBi, and data warehousing. Its been 4 years but I am really grateful of what I am now.

[@tusharmore7801]

you applied for internship even after if you have web development experience ? is it possible to get job directly without internship if u have prior eperience example web development?

[@DarshilParmar]

I didn't directly apply to a new internship directly, I spent around 1 year learning about Data Science/ML and then applied for that. Getting a job without experience or internship is difficult but possible if you have skills and projects to back the same

[@TamizhanTrend]

@Darshil Parmar suggest me good laptop for data engineering and Machine learning projects

[@rayyanamir8560]

Suggest some great tensorflow resources before starting off with projects, please....

[@DarshilParmar]

Why tensorflow?

[@soojn0072]

Thank you Darshil😭😭😭🙌

[@inferno-nq4vm]

This video has a potential to change my life..... Thank you very much... ❤❤ Keep going ..

[@DarshilParmar]

Thanks you :)

[@samrs07]

Indeed true...Agree with your viewpoints 101%!!! Accidently stumbled upon your series and was amazed at the way you have explained Spark in a crisp, concise manner with real-time examples/illustrations & found it helpful...!!! Thanks a lot Darshil!!! Regarding your Data Science journey---a piece of advice to you---kindly focus on Statistics for data interpretation which would help you from the business perspective in the long run!!! Tutorials regarding Computer Vision and other Data Science topics would be welcome!!! Cheerz once again for sharing your valuable Gyaan.....indeed helpful!!!

[@rennisdodman8739]

is it possible to do some bigquery, google cloud projects? since this seems like a growing demand with the google cloud certificate being highly rewarded.💪

[@SarkarS-vn1ke]

I belong to tier-3 college but somehow landed to MNC as data security engineer..Hos do I get projects and become a data Engineer please give a roadmap .

[@DarshilParmar]

Hey, I have a detailed Roadmap on my channel plus project series

[@SarkarS-vn1ke]

@@DarshilParmar Arigatō.. But I'm experienced by 3.5 yrs now I dnno what should I do afraid of this

[@sandhyapanwar9772]

Hello can you help with AWS beginners projects !!! Please

[@shaikusman536]

Amazing insights Darshil...Thanks a ton brother...erspect from Banga;lore...

[@ronyuniverse]

Data engineer and data scientist ars same?

[@khushigupta575]

Thank you so much sir!!! 🙏🏻

[@DarshilParmar]

Most welcome!

[@prashantrajawat2829]

is i5 10th gen a good laptop configuration for using all sutffs to become a data engineer? or should i go for with Ryzen 5 series?

[@shashikaudara8278]

Could you share your duplication images deletion projects link?

[@riazhasan2191]

Could not understand Darshil Parmar - talking too fast Sorry.

[@DarshilParmar]

Hi Riaz, This video was very old but try turning on subtitles?

[@sandipansarkar9211]

finished watching

[@urvashipatel3476]

Inspiring Video.

[@mohitrangari4848]

Working as network engineer but wanted to grow my career in data engineer what should I do? Where will I get online classes so that I can get good command....

[@xoroanime6531]

Why did you left web development. Was money not enough?

[@DarshilParmar]

I got bored, same happened with ML things

[@akka9335]

Thanks for the informative video. I am in a worse loop than this where I go to a site, buy a course and never return to it. Even if I do, I hardly complete it. I am a data engineer but need to upgrade to get into MAANG. Which type of projects should I target?

[@CrafitaPerfume]

Hello Darshil, I m not techincal person with 15 yrs of Finance Background, i hv taken brake & Power BI n Mysql... do u think it wud b feasable for me to b Data Analyst..

[@dipanjandas9463]

I know nothing about Data Engineering. If I want to learn Data Engineering and do freelancing, Is it possible for me? I want your advice.

[@DarshilParmar]

Yes, you can do that! I have created 6 months plan for Data Engineering, check on my channel

[@VaibhavShewale]

i don't know but i am still confused from where to start, should i start python or R or anything else first?

[@MohammadAli-yc8yi]

Start with Python, if you don't have knowledge of any other programming language yet, else it's upto you

[@rayyanamir8560]

Python, because it has a better user community

[@DarshilParmar]

Yes go with python, don't think much

[@shanusingh1660]

bro its really helpfull to me i'm too confuse to decide what can i do

[@kneelakanta7476]

I want to start my career as data analyst and how can I transform to data engineer

[@princesstamina21]

Me, a lawyer, wondering if I am even eligible and if its too late for me to learn😭

[@VikasSingh-vu1cy]

What is Your college name for btech?

[@rushipankade1882]

Wow such an informative video!

[@DarshilParmar]

Glad you liked it

[@vishweshvarvenkat5617]

Excellent video, more practical and less opinionated. Thanks bro...!! This is enlightening

[@DarshilParmar]

Glad you liked it!

[@nbsp8902]

Thank you so much. I needed this so badly

[@DarshilParmar]

You are welcome

[@ananyaagarwal7108]

A Very honest and Informative Video !

[@SuperShaneHD]

There is a course from Sumit Mittal which covers everything ffs

[@abhinav_2127]

I am from non tech background. And now I want to switch into DS. Is there any issue regarding my non tech background?

[@DarshilParmar]

No, you can

[@rashi3502]

Very precise Thanks bro

[@DarshilParmar]

Thank you