Machine Learning vs Data Engineering - What's the difference?

  Рет қаралды 16,198

Karolina Sowinska

Karolina Sowinska

Күн бұрын

My FREE guide on how to become a data engineer:
karolinasowins...
This video answers a question that I was getting a lot: "What's the difference between Machine Learning and Data Engineering?
To make a good comparison between Machine Learning vs Data Engineering, we first need to clarify what we mean by these two areas.
Machine Learning can be actually split into two separate "camps":
-scientists (data scientists, machine learning researchers, machine learning scientists)
-engineers (machne learning engineers).
And data engineers are always engineers :)
So in this video I compare scientists, machine learning engineers and data engineers :) I hope this will help you to decide on a career path!
As always, any questions, let me know in the comments.
Find me on instagram:
@karo_sowinska
You can warm my heart with a cup of coffee as a thanks!... :)
ko-fi.com/karo...

Пікірлер: 90
@karolinasowinska
@karolinasowinska 3 жыл бұрын
I've done some research, and I recommend these courses for data engineering: 1. Learn Python I recommend following the Python for Everybody specialization course on Coursera, which is one of the most popular courses there: click.linksynergy.com/link?id=kOQH55A53NA&offerid=759505.1560499266&type=2&murl=https%3A%2F%2Fwww.coursera.org%2Fspecializations%2Fpython 2. Learn SQL SQL is still the lingua franca of data. I recommend going with Learn SQL Basics for Data Science course, because it contains some chapters which are very releavant to data engineering in partcular, e.g. distributed computing with Spark click.linksynergy.com/link?id=kOQH55A53NA&offerid=759505.15198708466&type=2&murl=https%3A%2F%2Fwww.coursera.org%2Fspecializations%2Flearn-sql-basics-data-science 3. Learn Bash scripting/Linux I wouldn't take a full course on it, but at least read a good article. if you do prefer to take a course/guided project, I think this one is short and good: www.coursera.org/projects/command-line-linux 4. Learn how to develop on the cloud, e.g. on AWS There are a few good courses around there, but I think the Coursera one is the most comprehensive click.linksynergy.com/link?id=kOQH55A53NA&offerid=759505.18533796022&type=2&murl=https%3A%2F%2Fwww.coursera.org%2Fspecializations%2Faws-fundamentals Disclosure: They may contain affiliate links
@gauravlotey4263
@gauravlotey4263 3 жыл бұрын
Hey Karolina! I recently came across your channel. Data Science community is already cramped up with so many people coming up with their own channels and vlogs. There are few people like you who aren't running the rat race of making good vlogs! People like you truly deserve to talk, thankyou so much, your videos have given me some good insights of what a data engineer is and what are the skills required. I am about to start my internship as a data engineer soon !
@karolinasowinska
@karolinasowinska 3 жыл бұрын
Oh thank you so much, I'm really happy that my videos are useful to you! :) Good luck with the internship!
@gauravlotey4263
@gauravlotey4263 3 жыл бұрын
@@karolinasowinska Thank-you !
@tusharbhatia1299
@tusharbhatia1299 4 жыл бұрын
You and your videos are such a blessing! Whenever I’m having a doubt , the very next day you post a video about it!😂❣️ Thanks!🌸
@karolinasowinska
@karolinasowinska 4 жыл бұрын
I'm so glad to be able to somehow read your mind!! ;)
@thealchemistbaknitours9018
@thealchemistbaknitours9018 3 жыл бұрын
Same here 😅
@AlbenTumanggor
@AlbenTumanggor 4 жыл бұрын
I really like the way you deliver your contents! I am about to switch role from data scientist to data engineer soon. Both roles are great, but I want to see the data from lower layers. So it would be great if you create more contents related to data engineering😆. Looking forward for future contents, keep up the good work!
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Oh, that cool stuff! I actually did the same - started off in data science, and slowly moved down the "data layers" :) Thanks and enjoy!
@jawwadsiddique1729
@jawwadsiddique1729 3 жыл бұрын
Thousand views and subscribers on your way! Brilliant brilliant content. Keep it up and share more!
@karolinasowinska
@karolinasowinska 3 жыл бұрын
Thank you! Will do! :)
@Dr0IT0iraq
@Dr0IT0iraq 4 жыл бұрын
U r absolutely awesome, thanks for brief us. The worst part is when u work with a small company which they told you "u r ur boss" and ur department is only u, in that particular situation u will should act like every single thing that u mentioned in this video and the result it will be a resignation letter after few months😅
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Haha I completely feel the situation that you've described!
@technologicalminds4426
@technologicalminds4426 3 жыл бұрын
This is an incredibly insightful video, thank you very much for doing it.
@karolinasowinska
@karolinasowinska 3 жыл бұрын
Thanks, I'm glad you found it useful :)
@nohaadel5820
@nohaadel5820 4 жыл бұрын
Thank you❤️ Can you please make a more detailed video about the skills or responsibilities required for both of them?!
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Noted, might do soon! :) In the meantime, I already have a video where I talk purely about data engineering :)
@nlarralde
@nlarralde 4 жыл бұрын
This is dynamite information :0) thank you so much. Data/Machine Learning. Engineering positions are the ones for me! And having these actual job titles to search makes a world of difference. I can't thank you enough
@karolinasowinska
@karolinasowinska 4 жыл бұрын
My pleasure! And always feel free to shout if you need more info ;)
@nlarralde
@nlarralde 4 жыл бұрын
@@karolinasowinska definitley will! Thank you so much
@umair_kamil
@umair_kamil 2 жыл бұрын
I've watched several videos to understand the difference between Data Scientist and Machine Learning Engineer - this is by far the most practical video, because there is no better way to put it. Data Scientists build the model relying on scientific techniques, Machine Learning Engineers scale the model relying on core computer science/machine efficiency knowledge. Thank you so much for this. I think the title should be renamed to Machine Learning Engineer vs Data Scientist vs Data Engineer
@denismerigold486
@denismerigold486 4 жыл бұрын
Excellent explanation of terms for beginners.
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Glad you think so! ;)
@captainphysix
@captainphysix 3 жыл бұрын
Veery clear explanation again! Thanks a lot!
@ricardoislasruiz3186
@ricardoislasruiz3186 3 жыл бұрын
Beautiful explanation!
@ravenecho2410
@ravenecho2410 Жыл бұрын
architecture, engineering, science, operations, strategy, domain, product... it all kinda becomes just a yes, is fun because it's challenging, but is challenging none the less
@mwansa430
@mwansa430 3 жыл бұрын
Thanks it's very clear now
@thedevlife
@thedevlife 4 жыл бұрын
As the old saying goes... you learn something new every day. I am glad you clarified the differences. Too often we confuse one of these titles; I know I am guilty of that. Also, I think bright colors, do suit you.
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Definitely! I used to confuse them too! And thanks... I might get myself convinced that red is not the least flattering colour ever!
@AmineSAASAAI
@AmineSAASAAI 2 жыл бұрын
Hello Karolina, I hope you are doing well and everything :) I have just discovered your channel and it's awesome. My name is Amine and besides Music, I am an electromechanical engineer with more than 5 years of experience in the manufacturing industry as a Quality Engineer. However, I have always been drawn to theory and Mathematics, and I am at a point in my life where I am thinking of switching my career completely to Machine learning. My question is: do I need to get a different Master degree in AI/Machine learning in order to apply for jobs? or do I need just to learn the required skills (Via a certification course online and work by myself) and then apply directly, and maybe my current master of engineering is enough. Thank you so much for your content Karolina it is very helpful + you are beautiful ^.^ Cheers from a fan :)
@AlessandroPuzielli
@AlessandroPuzielli Жыл бұрын
MA is not necessary, it's necessary to know the maths and stats under the roof. I'm deciding to leave the ML career because I'm conscious to have to study too much to be familiar with the statistics under the neural networks and other ML algorithms. In my opinion, your background in Quality Control gives you a big advantages in ML
@assylzhanizbassar1628
@assylzhanizbassar1628 4 жыл бұрын
Hello, Karolina! Thank you for the video, it is very helpful to understand the difference between ML and DE! I have a question, how many months have you learned the python and sql after economic background, and is it hard to find a job for this specialization, I mean is it hard to get interview, and something like that?
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Hey, that's a great question, I think I will make a separate video with an elaborate answer! But roughly, if you focus only on learning and nothing else, then I think you can make yourself ready for interviews in something like 3-6 months. I did it slightly differently, but I'll tell the whole story in the video!
@assylzhanizbassar1628
@assylzhanizbassar1628 4 жыл бұрын
@@karolinasowinska Okay, waiting for the next video!
@hypebeastuchiha9229
@hypebeastuchiha9229 3 жыл бұрын
When you say quantitive background do you include computer science? What area would a computer science degree be best suited for? Thanks in advance I’m so confused about what to do in my life aaaaaaaa 😖😖😖
@jamesdials13
@jamesdials13 2 жыл бұрын
Lol same so many different titles
@boasa
@boasa 4 жыл бұрын
I've just been offered a Data Engineering position after applying for a software engineering position. Do you think skills learned in Data engineering transfer to Software Engineering and if so should I accept it if I'm sure I want to be a software engineer after graduating?
@karolinasowinska
@karolinasowinska 4 жыл бұрын
I would even say that data engineering is a type of software engineering. Definitely lots of transferable tech skills to learn (OO programming, databases, bash scripting, networking...). I'd say - go for it ;) Besides, it's very "hot" at the moment, and it will only be getting "hotter"!
@viacheslavspitsyn2995
@viacheslavspitsyn2995 4 жыл бұрын
@@karolinasowinska Btw, why are DE so 'hot' and well paid? It seems like just a kind of a software engineering role that does require any outstanding skillset and does not have high entry barrier.
@user-pi9qd7ig8s
@user-pi9qd7ig8s 3 жыл бұрын
Hello Karolina, I've got an MSc in engineering and am thinking of becoming a machine learning professional. Zero background in it. My question is do one needs to be a data analyst and take a data analytics training to be able to ladder to machine learning engineering? Thanks, Behnam
@karolinasowinska
@karolinasowinska 3 жыл бұрын
No, you can go straight for ML :)
@DenisTrebushnikov
@DenisTrebushnikov 3 жыл бұрын
1:24 as a former gamedev technical artist I should say the red color isn't trouble in post-processing, it can be changed to anykind you want: hsla and some cryptomatte magic!
@karolinasowinska
@karolinasowinska 3 жыл бұрын
Hahha there we go, and all I did was coming up with a lazy apology! :D
@perfumeworld2329
@perfumeworld2329 3 жыл бұрын
Karolina Whenever I watch you're Episode I wish my Major was Data Engineering. So,thanks.
@karolinasowinska
@karolinasowinska 3 жыл бұрын
Luckily you don't need a major in data engineering to become a data engineer! ;) Good luck!
@arjunp5397
@arjunp5397 3 жыл бұрын
Machine learning and data science are same , If Artificial intelligence is a circle,ML is a sub circle deep learning is a sub circle in ML, Ds is a circle combined all of these NB: Deep learning is not related with python
@tahaabdullah8833
@tahaabdullah8833 3 жыл бұрын
Hi very nice explanation. But is it a good time to switch now to machine learning or am I too late?
@karolinasowinska
@karolinasowinska 3 жыл бұрын
Good question - personally I don't think it's too late. But be prepared that you'll have to constantly learn new things! :)
@logu6645
@logu6645 4 жыл бұрын
I am a Sophomore ( Computer Science ) studying in India .I know how to build ETL Pipelines ,AWS,Machine Learning Algo's Implementation in TensorFlow and Keras,A Solid Knowledge in SQL(Post,Maria,Oracle,MySQL),Scripting (bash,PHP,Python) ,React & some backend development using NodeJs,PHP. But I am confused what to choose ML engineer or a Data Engineer.And Is it possible to get a direct Job in UK after my bachelor's in DE or ML Engineer ?(It would be a Great Help)
@karolinasowinska
@karolinasowinska 4 жыл бұрын
I think you have a lot of very releavnt skills/knowledge for both of these roles! Pick which one you prefer :) Both are in high demand in the UK, and I do think it is possible to get a job there after graduation. I can't advise on the visa process, because I've never gone through that. All the best! ;)
@logu6645
@logu6645 4 жыл бұрын
@@karolinasowinska Thanks A Lot!!!
@hellohowsitgoing2236
@hellohowsitgoing2236 4 жыл бұрын
Hi, I will take course on data science in the uk next year : )
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Best of luck! :)
@ahmedraza-wg5qw
@ahmedraza-wg5qw 4 жыл бұрын
I am From Pakistan ,Here it is extremely difficult to find internship especially when you are not completed bachelors , i am currently doing A levels ,I know python ,sql , python libaries , please guide me how could i got intership in datascience . i am learning datascience and terminologies for last 1.5 years when i was in O levels but havenot get any value out of it , so dissapointed i am that i am seriously considering to switch to webdeveliopmnt tasks as thwere are grets op[portunites especially for fresher or inecperience younsters like me , do you think it would b e a good chioce
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Don't get discouraged by the initial setbacks! Keep looking for those opportunities. Perhaps if not in your country, then abroad? Unfortunately I don't know the Pakistani job market, so I can't really advise you on that :(
@igorszemela1610
@igorszemela1610 3 жыл бұрын
brilliant!
@meninjohnjohn2835
@meninjohnjohn2835 2 жыл бұрын
Sister, which one has more scope in future AI and ML or AI and datascience ,past few days I am in extreme dilemma kindly help me please ..
@SudharsanaViswanathan
@SudharsanaViswanathan 4 жыл бұрын
Hi 👋 I'm currently working as database developer in which I work on data modelling ,creating stored procs as well as batch jobs which sends everyday data to data warehouse for analytics on batch fashion but I don't clearly understand how the streaming architecture of data lake works. Can you do a video on this topic
@karolinasowinska
@karolinasowinska 3 жыл бұрын
Hello! I'll put it on my backlog, thanks for the suggestion! :)
@wilsondelgado5174
@wilsondelgado5174 4 жыл бұрын
thank you for the information!!! If a person is introducing to this fascinating world of data Would you recommend focusing on one aspect? or learn general topics of data and then in a job look for what position is right for the person?
@karolinasowinska
@karolinasowinska 4 жыл бұрын
I would suggest first deciding whether you'd like to go down the scientist or engineer route by exploring various areas. Then if you decide broadly which one's more for you, e.g. engineering, you might learn some general skills that will be useful for whatever engineering job you get, e.g. object oriented language, CS fundamentals like databases, networking etc :) I think as you go, it will become clearer what you like most, and what you want to focus on :)
@sumittamang3548
@sumittamang3548 2 жыл бұрын
Should I go to University for a data engineering degree??
@pradhyumansinghmandloi8240
@pradhyumansinghmandloi8240 2 жыл бұрын
Please make a Vedio on data engineer salaries and demand in 10 years as you mentioned in one of your Vedio lots of people moving into it then so increase in average salary decreases from 2019 2021
@shresthaditya2950
@shresthaditya2950 2 жыл бұрын
3:35- 4:42- 6:10-
@bangnl
@bangnl 4 жыл бұрын
Thanks for an useful video. Can you put the subtitle choice on the video because I'm not really good at English. :)
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Hey! I think KZbin removed the auto-generated English subtitles :( I will need to write my own ones - I'll try to do that soon! :)
@biswaMastAadmi
@biswaMastAadmi 3 жыл бұрын
ML on new m1 chip ? Are you planning any video on it ?
@karolinasowinska
@karolinasowinska 3 жыл бұрын
I'm not planning to do it. My 16inch is good enough for me!
@code5829
@code5829 3 жыл бұрын
Data engineer vs backend engineer???? Thanks.
@blessos
@blessos 3 жыл бұрын
It does suit you 😉
@karolinasowinska
@karolinasowinska 3 жыл бұрын
Wow, I've missed your comment for a long time haha! Thanks :)
@srujithsunny6022
@srujithsunny6022 4 жыл бұрын
Do you go for data science job in future ?
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Who knows where the future will take me!
@nickseferovic6472
@nickseferovic6472 4 жыл бұрын
Hi karo👋🏻
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Hello there! ;)
@Robi2009
@Robi2009 4 жыл бұрын
@0:01You look good no matter what side to the camera ;)
@karolinasowinska
@karolinasowinska 4 жыл бұрын
The 2020 award for the bestest and nicest cousin goes to...Robi! ;D
@Robi2009
@Robi2009 4 жыл бұрын
@@karolinasowinska Awwwww
@candyfloss184
@candyfloss184 4 жыл бұрын
The beautiful girl is back. Let us welcome her.
@karolinasowinska
@karolinasowinska 4 жыл бұрын
How nice of you! :)
@kalvincelcius7624
@kalvincelcius7624 4 жыл бұрын
Thank you for welcoming me. Lolol Jk I’m a guy
@candyfloss184
@candyfloss184 4 жыл бұрын
@@karolinasowinska 😍
@andytheindividual3862
@andytheindividual3862 4 жыл бұрын
I hope im as smart as you one day :)
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Oh, knowing some programming languages doesn't make a person ultra smart! Btw, I'm super happy to see you in the creator's hat, I'm going to check out your video in a sec! ;)
@andytheindividual3862
@andytheindividual3862 4 жыл бұрын
@@karolinasowinska thanks for subbing :) I didn't even know I had comments off.. its tough for an infp out here.. 😂 you sure are sweet. Thank you.
@jingyitay6179
@jingyitay6179 3 жыл бұрын
Engineering seems less masochistic than scientists. Too much math IMO
@karolinasowinska
@karolinasowinska 3 жыл бұрын
True, the math struggle is real in science
@SensatioNEO
@SensatioNEO 4 жыл бұрын
Beep boop
@karolinasowinska
@karolinasowinska 4 жыл бұрын
Beep boop!
@sarahmedouni8844
@sarahmedouni8844 3 жыл бұрын
thank you, cs gigi hadid
Are you a (data) scientist or engineer? 3 questions to figure this out
13:09
Cool Parenting Gadget Against Mosquitos! 🦟👶
00:21
TheSoul Music Family
Рет қаралды 22 МЛН
小路飞嫁祸姐姐搞破坏 #路飞#海贼王
00:45
路飞与唐舞桐
Рет қаралды 29 МЛН
What's in the clown's bag? #clown #angel #bunnypolice
00:19
超人夫妇
Рет қаралды 9 МЛН
规则,在门里生存,出来~死亡
00:33
落魄的王子
Рет қаралды 32 МЛН
I Studied Data Job Trends for 24 Hours to Save Your Career! (ft Datalore)
13:07
Thu Vu data analytics
Рет қаралды 250 М.
Why NOT to become a Data Engineer
13:45
Karolina Sowinska
Рет қаралды 60 М.
Что такое big data? 10 вопросов data-инженеру
9:06
Группа IT-компаний Lad
Рет қаралды 13 М.
What do DATA ENGINEERS do? Is data engineering a good career choice in 2020?
13:21
Andrew Ng Machine Learning Career Advice
10:02
Jared Beckwith, R. EEG T.
Рет қаралды 106 М.
Advice From a Top 1% Machine Learning Engineer
14:04
Exaltitude
Рет қаралды 146 М.
DO NOT go to MEDICAL SCHOOL (If This is You)
8:00
Med School Insiders
Рет қаралды 6 МЛН
🚨 YOU'RE VISUALIZING YOUR DATA WRONG. And Here's Why...
17:11
Adam Finer - Learn BI Online
Рет қаралды 202 М.
Cool Parenting Gadget Against Mosquitos! 🦟👶
00:21
TheSoul Music Family
Рет қаралды 22 МЛН