Why do Data Engineers Exist?

  Рет қаралды 5,774

Shashank Kalanithi

Shashank Kalanithi

Күн бұрын

Пікірлер: 16
@nibycolisp974
@nibycolisp974 2 жыл бұрын
What great timing! I've been doing heaps of research and learning regarding data analysts and their roles/workloads, but recently started looking at data engineering. Cheers for another great video Shashank 😄
@nayeem3905
@nayeem3905 2 жыл бұрын
Data Engineer was known as ETL developers in the past and I'm sure they had other names too as Joe mentioned.
@ilaydelrey3122
@ilaydelrey3122 2 жыл бұрын
Dear Shashank, thank you for putting such a valuable content here on KZbin. I watched a few videos and I would be happy if you could use a good microphone in the future for better or convenient / comfortable audio quality :)
@dhruvdr4
@dhruvdr4 2 жыл бұрын
Great insight. Thanks Shashank.
@ricardogarcia8715
@ricardogarcia8715 2 жыл бұрын
Great video bro! Thank you so much.
@SeattleDataGuy
@SeattleDataGuy 2 жыл бұрын
Great video! Welcome to the dark side of data
@Neetaku7
@Neetaku7 2 жыл бұрын
whats the best way to get some practice in for SQL when you are getting ready for job applications. Not just for syntax in SQL or python, but analytical skills required for the job. I always got my practice in through leetcode, but I feel like there are more effective ways to grind and practice SQL/Data Analysis skill.
@spockrates7980
@spockrates7980 2 жыл бұрын
Hey. I'm not Shashank, but I was hired as a data analyst about eight months ago. I learned everything I know (including SQL) via Coursera and projects. Leetcode is a great way to get isolated technical practice, but you're right - developing that end-to-end analytics skillset takes a different approach. What I did was find a dataset I found interesting, installed a SQL Express server instance (free) and loaded the data into it. I then wrote queries to answer questions I thought were important, or thought a stakeholder interested in this data might appreciate. I then turned my findings into a quick Tableau dashboard. This approach lets you go from raw data, to cleaning it up, exploring it, then finding where the interesting nuggets are and the story you can tell with them. If you want to turn this into a deliverable to help you get a job, you can pretty much throw the queries, the data and maybe a JPG/ code of your dashboard into a GitHub repo, which gives you something tangible to point at if employers want an example of your SQL skills. I was a self-taught amateur when I was applying for jobs last year, so having something, anything, to talk about in the way of a SQL-based project made it much easier to demonstrate my skills. Just let your curiosity guide you, be enthusiastic about it, and you'll be more likely to produce a compelling end-product, having completed what is essentially a complete data analyst workflow you could find in a real workplace. Hope that helps!
@Neetaku7
@Neetaku7 2 жыл бұрын
@@spockrates7980 ty for your help!! I really find that method super effective, and will implement that method as soon as I can, and I have another question about the market of Data analyst, when you were hired, was it a entry-level or a mid level position, reason why I'm asking is because I feel like a lot of entry-level positions are saturated, hence I wonder If I should prepare and apply for mid-level position instead of entry
@spockrates7980
@spockrates7980 2 жыл бұрын
@@Neetaku7 it'll probably be more difficult landing a mid-level position, but don't let that discourage you. If you can demonstrate skills the company is looking for, you can give it a go. I ended up getting an entry level position, but I applied for pretty much anything that looked cool, even if the job listing said "3 years experience needed". I had a few years work experience in a different field, but I often lent on that as a selling point to get calls back.
@mad1337nes
@mad1337nes 2 жыл бұрын
strata-scratch, more involved/deep sql stuff over LC
@ntran04299
@ntran04299 Жыл бұрын
@@spockrates7980 where are some interesting and messy real world data did you find? I only know Kaggle but they have only clean data, which is not like in the real world…
@felixc.programs8209
@felixc.programs8209 2 жыл бұрын
Good stuff as always! I'm always inspired by your stuff to get better and work harder Keep doing what you do!
@JasonEyestone
@JasonEyestone 2 жыл бұрын
Nice video Shashank 📕 🧠 📈
@theravikk1755
@theravikk1755 2 жыл бұрын
AI will replace data analyst jobs in future?
@hamzahal-shaebi3537
@hamzahal-shaebi3537 2 жыл бұрын
Great insight. Thanks Shashank.
What's the difference in Data Professions?
17:05
Shashank Kalanithi
Рет қаралды 6 М.
How To Make The Most Out of Your 20s
21:16
Y Combinator
Рет қаралды 293 М.
Sigma Kid Mistake #funny #sigma
00:17
CRAZY GREAPA
Рет қаралды 30 МЛН
Правильный подход к детям
00:18
Beatrise
Рет қаралды 11 МЛН
Мен атып көрмегенмін ! | Qalam | 5 серия
25:41
How Data Science ACTUALLY Works
26:50
Shashank Kalanithi
Рет қаралды 91 М.
How Data Engineering Works
14:14
AltexSoft
Рет қаралды 469 М.
Is the Meta Data Engineering Certificate any good? (as a Data Engineer)
12:17
A Data Crash Course | 100+ Key Data Concepts
33:48
Shashank Kalanithi
Рет қаралды 11 М.
Evolution of software architecture with the co-creator of UML (Grady Booch)
1:30:43
The Pragmatic Engineer
Рет қаралды 45 М.
I Scraped the Entire Steam Catalog, Here’s the Data
11:29
Newbie Indie Game Dev
Рет қаралды 505 М.
The Rise of Analytics Engineering (and Why You Should Care)
14:53
Data Analyst MENTORSHIP -  Q&A (while I drink coffee)
34:45
Shashank Kalanithi
Рет қаралды 2,6 М.
Why Can't We Make Simple Software? - Peter van Hardenberg
41:34
Handmade Cities
Рет қаралды 160 М.
Data Engineering Career Tips By Airbnb Data Engineer | Part 1
31:05
Sigma Kid Mistake #funny #sigma
00:17
CRAZY GREAPA
Рет қаралды 30 МЛН