How I'd Become A Data Engineer (If I had to start over as a data analyst in 2023)

[@SeattleDataGuy]

If you guys want to learn more about data engineering, then sign up for my newsletter here seattledataguy.substack.com/ or join the discord here discord.gg/2yRJq7Eg3k

[@BLK_O]

I've just done the same thing. I've spent years being a solution designer / data analyst and I've just switched into data engineering as a senior technical specialist with no experience in actual hands on data engineering but I've got experience in designing data warehouses and ETL solutions.

[@SeattleDataGuy]

Nice! how is it going!

[@devdawg22]

If this isnt proof that my phone is always listening. Last night my husband was telling me how he (manager of data analytics) is being moved under the programming department and being made data engineer. This popped up in my suggested today lol

[@sotumodo4317]

Happens all the time. I could talk about something with a friend over a phone call and the next day an ad about it pops up. Lol

[@user-gq1ij]

Let's normalize this now. Let's show no surprise to these things. It has been long time now 😂

[@RichardRietdijk]

It isn't necessarily proof. It's likely just the Baader-Meinhof phenomenon/frequency illusion.

[@aenima1_]

Already onboarding to DE work at Amazon :) thanks for the inspiration!

[@SeattleDataGuy]

Congrats!

[@andreinitescu1768]

I transition from a cook to a Integration Developer 2 years ago and now I am taking a Master in Computer Science while working, hoping that 3 years from now to get into Data Engineering,

[@vivekjoshi3769]

How did you become integration developer from cook/chef? 🤔 Please elaborate your path. I come from hospitality background & looking for inspiration.

[@andreinitescu1768]

@vivekjoshi3769 I have studied for about 6 months to get AWS - Solutions architect certification and SQL. That was enough to get my first IT job

[@Albidon]

@@andreinitescu1768what is the title of the job you applied for ?

[@joaodionisio2341]

I just got hired as a Cx (Customer Experience) Quality Analyst as my first job. With this video, you helped me a lot on how to start my path toward a Data Engineer role, thanks.

[@SeattleDataGuy]

Good luck!!!

[@SeattleDataGuy]

you're welcome! how has it been going?

[@joaodionisio2341]

Hi, im not there yet, but i recently got promoted to a Sr. Continuous Improvement Analyst position. Im very happy on where i am, but im still pushing myself to my goal.

[@gavinkalaher7314]

I've pivoted to a full-stack developer route which can also easily translate into a data engineer role at the 3-5 year career point.

[@SeattleDataGuy]

Yeah 100% any easy switch

[@abhisekgupta5381]

Can you please help me in understanding how full stack and data engineering is related?

[@tonyduran5845]

@@abhisekgupta5381 A full-stack developer knows how to get the code to interact with the database and it's data. They know how to write the SQL queries needed to get the data the applications need. And if it's a new application, in many instances they also help design and build most of the database objects as well. Basically, by being "full stack" it implies detailed knowledge of the database tier of the system.

[@Immortalus98]

So lucky to have found you. Doing my masters in data science after being a data analyst for about a year. Didn’t even start the vid I can tell this guy has real wisdom

[@SeattleDataGuy]

you're too kind!

[@abiygirma1925]

where are you doing the masters? i.e. which program? I'm thinking about it too

[@Immortalus98]

@@abiygirma1925 Rutgers University! New Jerseys very own!

[@theinquisitor18]

I'm taking the IBM Data Engineering certificate. I'm blowing through the intro courses because I already have those skills down. It's the warehousing, Spark, and so on that I'm taking that course for.

[@panic_seller]

Me too, I took it specifically for Kafka and Spark

[@theinquisitor18]

@@panic_seller, I couldn't find any Kafka or Spark tutorials on KZbin that worked for me, which is why I decided to enroll in the course. 😊

[@boredsithlord9235]

@@theinquisitor18 im interested now !

[@qahoushh]

Hey! I think to take a course in Data engineering . Do you recommend it IBM? What do you think about it ?

[@AJGthree]

​@Hamza Qahoush I'm also taking this certification since it's free through my university. So far I have only taken the first few classes on Python, SQL, and relational databases. The material is not very thorough or in-depth. It introduces a topic, guides you through a few simple exercises, and moves on to another topic. Unless you can get it for free, I would recommend skipping it and looking for free resources, then building your own projects.

[@ekaterinakorolkoviene5824]

on my journey from DA to DE. Taking any opportunity to do ETL's, models, automatizations that I can find. Unfortunately, in my department our tech stack is so poor, that I realized that I'm never going to transit to DE internally and the DE work I'm doing not valued as much as of good DA or BA.

[@Cadet1249]

Amazing video. I’m still in my undergrad majoring in CS but I on following this exact path. It’s my dream job to be a freelance data engineer/analyst for small businesses.

[@andrewhting]

No dude, go away. You have a CS degree. Go be a developer so us lesser MIS-er’s can have a chance 😂

[@mcattaneo2195]

What an awesome explanation! Very usefull, thanks!!

[@SeattleDataGuy]

You're very welcome!

[@sitrakaforler8696]

Great video man !

[@SeattleDataGuy]

Appreciate it!

[@paulnyagah181]

Trying to head there at the moment

[@SeattleDataGuy]

Good luck!!!

[@mehdio]

Camera upgrade ? :D Finally ;-)

[@SeattleDataGuy]

I bought a new phone hahahah

[@Chris-m7s1x]

Hi Ben, You mentioned in the video that you linked the interview test prep? I don't think I see it in the drop down. Would be very interested in taking a look at it - if available? thanks!

[@lordgrim3415]

found it in the description of his other vid - title: "The Last Data Science/Data Engineer Interview Prep Video You Will Ever Need To Watch"

[@Abayflo]

So great 👍🏿

[@SeattleDataGuy]

Glad you liked it!

[@christopherlucas1475]

Love this video! Could you make one for SE -> DE?

[@SeattleDataGuy]

Oh! thats a great idea!

[@nzgokiwi]

Cool idea. I am a SE and currently working toward DE. I would like to see a video that you suggested, too.

[@MrDubzein]

You should considered seriously to launch an online course related to the Modern Data Stack: Fivetran, DBT and Snowflake.

[@SeattleDataGuy]

maybe! for now i have launched a course on consulting because it felt like thats what people were asking for on linkedin

[@MrDubzein]

@@SeattleDataGuy really? could you share the link pls?

[@SeattleDataGuy]

@@MrDubzein sure!, you can find it here - courses.technicalfreelanceracademy.com/courses/starting-6-7-figure-consulting

[@malcorub]

3:10 Hi Ben, where can I find the diagram you displayed here? I really like it! I tried the links in the description but couldn't find.

[@SeattleDataGuy]

The image is here res.cloudinary.com/practicaldev/image/fetch/s--cnXIakxd--/c_limit%2Cf_auto%2Cfl_progressive%2Cq_auto%2Cw_880/github.com/datastacktv/data-engineer-roadmap/raw/master/img/roadmap.png

[@malcorub]

@@SeattleDataGuy Thx sir! You da man!

[@DanielleAvery-s7j]

Thank you for taking such a positive, imposter-syndrome-fighting stance on becoming a data engineer. Sometimes the bar to land a tech role feels so high!!

[@LukeBarousse]

Why would one want to stop being a data analyst... 🥺 😜jk

[@SeattleDataGuy]

....💸💸💸

[@nguyenthianhphuong]

Amazing thank you Ben! How much time would it require to complete the switch in your opinion?

[@Moonbat112]

Have you checked out the data engineering zoomcamp and if so, is it worth the time? Seems pretty popular and results in a personal project with decent resources to pull from. Currently in a hybrid ETL and Support role where I am trying to work in the DW/DE and hoping I can get some more hands on experience.

[@Ram-ku7me]

Hey, I have gained some data engineering skills and have done end-to-end ELT. I am looking for some open-source projects to contribute to but to my shock I can't find any, could you suggest some maybe even well funded startups.

[@jemiranhunter]

Great video. I'm currently in the process of becoming a data analyst but my end goal is to become a data engineer. Do you recommend any certifications to have that will help gain knowledge and experience I was looking at some of the Microsoft certifications for data engineers.

[@JonathanBiemond]

Thanks for the very helpful video! Do you have an online community for your channel on Discord or something, or any other Data Engineering community you would recommend? Also the Data Modelling link in the description is broken for me, any other data modelling resources?

[@adriancritchley2485]

Nice to see that it's not just my cat that sees my work chair as its arch nemesis.

[@SeattleDataGuy]

Yeah, that chair is gone now hahah...

[@hasanreza3437]

Hi. when you say baseline skills what do you mean by it? Specifically for data scientist.

[@adolfohc78]

Some of the links don't work. Where can I find the Data Modeling resource? Thanks!

[@nicholascarlile6934]

Would you recommend taking a similar path, starting in Data analytics then transition to engineering?

[@SeattleDataGuy]

A lot of people have done it! so it works great

[@OmkarGurme]

I have learned about SQL, Python, Spark and Azure Databricks , should I start applying for Data Engineering jobs right away ?

[@rohithnallam-fg4vz]

@seattledataguy Thanks for videos. Trying to find where I can get Sr Data Engineer prep courses which Includes system design and other important things

[@PandaVlademirBerlin]

This guy is knowledgeable not to mention his handsome face

[@haidshah3516]

Hey Ben. Just pass my az900 dp900 and dp203(data engineer). There are many job's however no luck for me so far. What advice you would give to get my first job? Thanks

[@ibexy]

Will it be considered a downgrade if one move from Data Engineering to Data Analytics?

[@SeattleDataGuy]

I don't think so. A great data analyst drives a ton of value

[@Yenz-7]

Hey I'm in the same shoe. So many videos/topics on DA to DE but I don't see any DA to DE.

[@Aurumn]

0:45 what is my cat doing there

[@calvindsouza1151]

where can i find the interview guide broski

[@SeattleDataGuy]

Here is the Data Engineering Study Guide! docs.google.com/spreadsheets/d/1GOO4s1NcxCR8a44F0XnsErz5rYDxNbHAHznu4pJMRkw/edit#gid=0

[@claudiu9110]

Can you share please the learning path diagram from minute 3:05 ?

[@ak6877]

Can you please share link to interview prep?

[@urielgilespinoza7376]

My English is not good because im learning bbut im gonna explain my situation 😅 I was hesitant to choose Data analytics or a front-end developer because before coming to the USA I worked as an accounting assistant and when I got here I dedicated working in a restaurant cooking. Three months ago I was just learning html and css on my own, it's giving a bit of difficulty js. I heard other people that i would have chosen data analytics because it would be a good combination with my accounting degree that I did in my native country.. So now I am lost.. 😅 Any advice please 🙏

[@chikabenie2593]

You couldn't switch to data analyst or financial analysts instead of front end dev. It entirely far from account packages compared with data Analyst

[@adamsaraya5727]

if you would completely start from 0 will you choose data again

[@Ahmadalege]

does his mean one has to start in another role before pivoting into data egineering?

[@SeattleDataGuy]

You don't have to, but it does make it easier

[@castangordon8023]

What would you recommend for someone with no experience in Data Analytics

[@SeattleDataGuy]

In terms of breaking into DE? You can do it, it can be harder. But you should attempt to get some projects under your belt and perhaps if you already have a corporate job, see if you can move into a DA or DE position at your current role

[@HarryManback0]

Step 1 - Get a B.S. in computer science.

[@calidata]

All good, but I am pretty bummed about how everyone exaggerates their pays or skills, I guess it is a part of marketing culture here.

[@SeattleDataGuy]

Who is exaggerating pay? Skills, I always try to be honest where I am and always trying to improve myself! The DE world never lets you rest in terms of learning

[@ailton.duarte]

Data engineer vs Data Scientist??

[@SeattleDataGuy]

Hello! Thanks for your comment. What are you aiming for salary? work life balance? problems?

[@nchou646]

Hi where can I find the interview prep link?

[@zorouzh]

Yeah wanted to try out those SQL problems

[@Not_Clark_Kent]

How about mathematics? how much math should you know?

[@SeattleDataGuy]

not too much, more solutions thinking and logic

[@zorouzh]

Hey can you link the interview prep that contains SQL problems and videos

[@griffinolson-allen8570]

^^

[@durkamagik1589]

I’m 16 but I want to learn how to use python and other programming, I want yo be trained if anyone is free I need someone to explain everything

[@ashraf7172]

I am having more skills & confidence in being a data engineer While as a data analyst i am not confident enough What should i do then?

[@vignesh004]

I'm a data engineer but why people are doing brain wash to switch to DevOps!!!

[@griffinolson-allen8570]

Can you link the interview prep sheet?

[@lordgrim3415]

found it in the description of his other vid - title: "The Last Data Science/Data Engineer Interview Prep Video You Will Ever Need To Watch"

[@Mohamed-Hassanin]

Which best for data engineering , Mac or Windows?

[@sanjikun206]

Bro what’s that tumbnail? 😂

[@SeattleDataGuy]

Whats wrong with it hahahaha

[@e.d.4069]

Does this even wortth it now in the pace of AI developing?

[@SeattleDataGuy]

I think so :) we have a while until ai really catches up