I analyzed 2,790,514 jobs to solve THIS

📲 The Data Nerd App 👉 datanerd.tech
Courses for Data Nerds
==================================
📜 Google Data Analytics Certificate (START HERE) 👉🏼 lukeb.co/Googl...
🐍 Python for Everybody 👉🏼 lukeb.co/Pytho...
💿 SQL for Data Science 👉🏼 lukeb.co/SQLda...
🧾 Excel Skills for Business 👉🏼 lukeb.co/Excel...
📊 Data Visualization with Tableau 👉🏼 lukeb.co/Table...
🏴‍☠️ Data Science: Foundations using R 👉🏼 lukeb.co/RforD...
➕ Coursera Plus Subscription (7-day free trial) 👉🏼 lukeb.co/Cours...
👨🏼‍🏫 All courses 👉🏼 kit.co/lukebar...
Books for Data Nerds
==================================
📚 Books I’ve read 👉🏼 kit.co/lukebar...
📗 Data Analyst Must Read 👉🏼 geni.us/Storyt...
Tech for Data Nerds
==================================
⚙️ Tech I use 👉🏼 kit.co/lukebar...
🪟Windows Virtual Machine for Mac (Parallels) 👉🏼 lukeb.co/Paral...
Social Media / Contact Me
======================
👾 r/DataNerd 👉🏼 / datanerd
🌄 Instagram: / lukebarousse
⏰ TikTok: / lukebarousse
📘 Facebook: / datavizbyluke
🙋🏼‍♂️Newsletter: www.lukebarous...
As an Amazon, Coursera, and Parallels Affiliate Programs member, I earn a commission from qualifying purchases on the links above. It costs you nothing but helps me with content creation.
#datanerd #dataanalyst #datascience

[@AdirFeijo]

The amount of work and effort that went into this project and this video just blows my mind. I love it. Thanks bro keep up the good work

[@LukeBarousse]

Thanks for noticing this, Adir! Appreciate you!

[@honestabe_9207]

Do this for every major job category, and you’ve got yourself a full blown company

[@MathTech83]

I agree with this comment so much. You have a very valuable and solid product here. You have connected skills to what employers are really looking for by data job category and country. You deserve good funding for this.

[@LukeBarousse]

Data Nerds! Loving the feedback on datanerd.tech 🙌🏼 I just added a country filter and am working on more features! 🤓 If you want to help contribute to this project, slide into my DMs on Instagram with your github handle. DONE: Country Filter Added (23Feb23) Cache Common Queries for faster loading(9Mar23) Job Title & Country Filter Clean-up (9Mar23) UPCOMING CHANGES: Industry/Company Filter Years Experience Filter

[@ericGTS]

Amazing project! Thanks !

[@thomasjaeger648]

I'd suggest you use redis to cache some of the more common queries i.e. UK and US and the three Data job roles. Just changing the filter for data analyst takes over 1.5 seconds for it to retrieve and re plot the horizontal bar graph.

[@karljm7024]

The site is no longer showing the skills and titles etc along the graph

[@MrJos597]

would be cool if we could enter any job posting titles

[@yogidrink2430]

Awesome work! I was wondering if you would like to open source this, so others can also perform the analysis with other job categories and help develop the filters and such.

[@samuelpezzetta7084]

Hi Luke, fellow Data Analyst here. You have my sincere gratitude and appreciation for this masterpiece. The amount of value you just provided to all aspiring Data enthusiasts and the enormous effort that you put into this video are just incredible - you have really outclassed yourself and everybody on youtube 🙏

[@matthiasblum6555]

I am a little bit baffled about the fixation on job titles to be honest. My position was called DB Developer, Controller, Solution Engineer, BI Engineer, BI Developer, and I am pretty much doing the same for 20 years. ETLs, Reports, DB Development, SW Development, working with different Tools like SSIS, SSRS, SSAS, Cognos, APEX, different DBs like SQL Server, DB2, Oracle. A Data Analyst in my book can be the same I did the last 20 years with a more technical emphasis, or he has a stronger focus on the industry sector he is working for, and is analyzing Data in that direction (Marketing, Controlling, Business Cases, etc.).

[@vernator]

This is brilliant Luke !!!! For all the students, this is how you structure a project! Take cues! Problem, plan, execute, visualize, insights and conclusion.

[@LukeBarousse]

Thank you!!

[@zacronk6945]

What a crazy lift you've done here. I always enjoy the content, but this one in particular really lifted the curtain into what so many of us do every day. You managed to document an application of all the skills necessary to be a great Data Nerd, but you did it in order to clarify what helps you become a great Data Nerd. Bravo!

[@LukeBarousse]

Thanks, Zac! Hope it gets put to good use!

[@TcRiverrat18]

As someone who is breaking into the data industry I just want to say thank you so much for your hard work and dedication on behalf of people like me. ❤

[@UnorthodoxChange]

Its actually crazy how much effort you put into this video even using tools you haven’t used before really showcasing the “keep learning” mantra of being a data analyst. Honestly, the best data analyst on KZbin. Thanks Luke.

[@LukeBarousse]

I appreciate that! 🙌🏼

[@lo_ebb]

Of all the videos I have seen come out of the data influencer space, this is far and away one of the most inspiring. I particularly appreciate that you started with a personal question, collected your own data, and gave back to the community. I hope viewers take note that this project has been, and continues to be, an iterative process for you: a great example of how perseverance yields cool things!

[@LukeBarousse]

Thanks for noticing this Eimantas! Appreciate it!

[@TinaHuang1]

This is such an amazing video - so appreciate the amount of work that must have went into this 💪💪 your videos deliver so much value!!

[@LukeBarousse]

🥹 Aw Tina, thank you so much! 🙌🏼

[@pedroavila1584]

as a data guy, I can't stress enough how thorough and insightful this is, definitely Luke is setting the standard, kudos!

[@LukeBarousse]

Thanks Pedro!

[@serpapi]

Luke, thank you for an explanation on how to build a data pipeline and then how to analyze the data!

[@LukeBarousse]

Heck yeah! Thanks for making this project possible by providing the search credits!! 🙌🏼

[@emonymph6911]

@@LukeBarousse Tell done both of you and special thanks to SerpApi for making it possible.

[@argiovannini]

Aptly timed! Thank you Luke, I just finished my data analysis bootcamp. If you read this, I was also a nuclear machinists mate on the USS La Jolla, SSN-701. While I don’t have a degree, I am glad to hear that this transition is possible. I hope to run into you in the future 🙏

[@LukeBarousse]

Thank you shipmate and congrats on finishing up the bootcamp!

[@bhumikachauhan3175]

Beautiful video.. really insightful. I was wondering why are you not posting anything and now I know why. The amount of hard work that has gone into producing a high quality content like this is quite evident. Highly appreciate. Big fan.

[@LukeBarousse]

NGL it's difficult not to post sometimes when you want to share... but sometimes the story just takes longer than you want; so thank you for noticing this!

[@Headlikeanorange84]

Your videos amaze me. The amount of time and effort you've put into this one is mind boggling. Also, your visualizations are hilarious!

[@balasubramanianp.g6970]

Every time I feel like we have hit a ceiling, you come through in clutch with another video explaining previously unknown use cases. You are a serious role model for inspiring analysts like myself. I would definitely like to see more of these videos.

[@LukeBarousse]

More on the way!

[@justbelit]

wow. the amount of work and information in just 15 minutes! thank you. this is beyond helpful

[@michaelkhanwald4522]

Chills literal chills❤ The way presenting the info you collected

[@wanharris6926]

Speechless! That’s how amazing and helpful it is for data nerds!!!

[@John-qs5hu]

Finally something good at distinguishing the difference between a data scientist, data analyist, and data engineer.

[@farafz3798]

Awesome video man, truly informative and useful. I’m still learning stuff through google data analytics certificate, have to learn more Python and SQL in-depth thanks to your video. Keep coming with those videos! 🍻

[@jaybestnz]

One thing, the ads are also often written by non technical HR hiring so the ad may not describe the actual skills.

[@alanhf]

I think I never saw a video/content/effort in that complexity. From now on, I will rate videos based on "Barousse Scale". Seriously, fantastic work.

[@alexanderthompson8433]

Hey Luke, I love the details and effort gone into this. As someone who is actively trying to get into a junior or entry level position for data analytics, I've done what I can to learn the essential skills to be marketable -- and then some. From getting degrees and certifications to gaining those essential skills and going beyond like learning graphic design to present reports and dashboards in a beautiful way, I still struggle to get my dream job. Job hunting itself is incredibly hard. Even if someone who has the skills, varied education, and a comprehensive portfolio, the other half is playing the game of reaching out to employers and hoping one day someone will give you a chance. I feel like this is a very underrated topic and curious what your thoughts are on this. Maybe it's bad luck and poor timing. Even the staffing agencies are having a hard time

[@thomasbrothaler4963]

It does not matter how long this video took. This was one of your greatest ones! You showed very accessible how a Data (Engineering + Analyst) Project may look like in the real world, while providing value to all of us with your great website/app. Great Job!

[@LukeBarousse]

I appreciate this 🙌🏼 felt bad for taking so long with this one, but knew it would be worth the wait

[@ashleygesty7671]

Wow your communication and data skills are on another level!

[@KajalDhimmar-c2h]

Hey Luke, I just had to tell you, this video is absolutely insane! I've watched it so many times, and every single time, it just blows my mind. I'm constantly amazed by it, and it's got me thinking-I really want to tackle a project like this someday. It's just that mind-blowing.

[@blackdeath7678]

We are sooo Lucky to have you luke 😊 Make it so easy for us now 🙏🏻

[@zakwhite5159]

I would not brag that a matplot bar chart took an hour to process with out showing the dataset info. It screams "idk wtf I'm doing".

[@discretetantrum]

Respect as to what you have pulled out of this, Luke!!

[@franhike]

Look man, I don't get just "data" from you, I crack up with your videos. Thank you a lot from an data analyst from Spain!

[@iRockTheBeat1]

This is crazy! Please build something similar for Software Engineers

[@octaviosubirana7145]

You're such a crack Luke! One advice for the website... Adding a filter for location or remote Jobs...

[@petatownsent]

You're the real OG Sir. We newbies and learners always grateful. Thanks a bunch.

[@Deya__]

You're fucking crazy bro! Salute for all the hard work actually put in this.

[@kiko83903]

Maan, you are such a data nerd and I love it! :D I've just secured my first data job as a BI developer and your videos helped me a lot.

[@LukeBarousse]

Congrats on the first data job Kris!

[@taaZtyr]

Great work! Would love to see this expanded to other ambugious professions like Mechatornics Engineers who also face similar issues with what skills are in demand due to integrated disciplines

[@michelemoneywell8765]

Well done Luke! Thanks for all your work. I'm glad SAS made the list for Data Analyst languages. With the many thousands of tech layoffs in the San Francisco Bay Area, I quit pursuing becoming a Data Analyst, figuring why would a company hire someone with little/no experience when thousands with experience are available. But your video got to me. I love Python and know SQL, Excel, SAS and an intro level of Tableau and Power Bi. I'm substitute teaching in a CA charter school now, but this summer will resume the Google Data Analyst Career Certificate, brush up on skills, and expand Python knowledge. Thank you so much! The future is looking so bright, I'll have to get shades.

[@jessegarris7037]

Great work. As a senior IS major this is very helpful! The video deserves more views given the work you've put in.

[@reitznerdomenik]

A lot of job postings have optional skills. It might be nice to highlight the percentage of a certain skill, where it is optional, or nice to have in a job posting

[@tc2241]

I could have misunderstood, but you may have a inaccurate data point regarding the degree requirements(if mentioned). Many companies, mine included, will forgo a degree for the equivalent amount of experience. So maybe create two filters?: - Degree: required, preferred, not required. - Experience: range of amount of yrs required and preferred For a more accurate model.

[@shreyadubey7905]

In the era of ATS where keywords matching the job role matters a lot ,thought about this idea few weeks back to build a project that displays the skills required for specific role based on present time requirements ,but cannot find the right path to proceed due to lack of guided roadmap .Thank you Luke sir for this video .

[@josho225]

this is ... simply stunning, great work!

[@TinkerTaverns]

This is both impressive and mighty interesting. Although I'm looking more for software engineering roles, it's really cool to see what data engineering is like through your process

[@amams_kaiser]

Wow… this is a great content Luke. A lot of work was put into this.

[@Lukiel666]

Darn it. Just studied Excel and start learning Access next week in my computer course.

[@TerriTerriHotSauce]

Swear I've been thinking about building the exact same thing, but for all programming languages. Even using the same techniques and stack. Watching this feels like deja vu it's crazy.

[@tadiwashangwa4931]

been waiting for this video man thanks luke

[@haoho78]

I enjoy watching you walked through your thinking. Kudo for you, curious mind. I wish your channel reach to many many people around the world

[@dadehd09]

Love what you did and appreciate the work you put in to visualize that data!🎉😊

[@percyjackson1662]

We could add a country filter as well as there's a huge variance among salaries for a data engineer working in India or UK or us for instance. This often will decrease accuracy.

[@parjus5043]

Incredible tool! Would there be a possibility to include Web analysts as well in the future? The field is relatively new and developing rapidly tools- and technology-wise lately, so it often needs to be clarified which skills are necessary to pick up to stay relevant.

[@laxml36]

As someone who is self-taught in workforce analytics, this is by far the most valuable video on the internet for analytics job info.

[@godsoloved24]

The problem I have is that I cannot find any junior data analyst roles. They are so few and far between and get hundreds of applicants.

[@x--.]

This was the greatest job application I've seen in a while. Good work.

[@louisoconnell8186]

Great video Luke. This will be such an amazing tool. I jut had one question: How did you deal with different currencies in the salaries?

[@LukeBarousse]

Based on the searches coming from the US (how I had it configured) it converted everything to USD automatically.

[@tobewanad]

Can you also break down the math required for jobs? Looking on forums yields wide ranging prerequisites for Data Analysis, from descriptive statistics to calculus! I can imagine location has an effect on the math requirements, as well as the job title not matching the job description. This project of yours has already been extremely helpful in narrowing the scope of my studies, please save me before I start binging 3blue1brown 😅

[@DEDE-ix9lg]

love these videos , where u show the process. a very fun way to learn , without the discomforts. VIDEO IS INSANE Luke being Top yet again

[@kinseywk]

You really went all-out on this one. Very helpful and comprehensive. Thank you!

[@luissousa3165]

This is absolutely amazing !!

[@georgiymatveev8627]

I was watching it on the job, and the teams call sound left me traumatized. Still a great vid, thank you!

[@TheRomantika11]

Thank you for the labor and time you have committed for this very useful video.

[@nicbajito]

Amazing job and solve 🔥 Hope people start to see those low numbers of help to internes, juniors because it seems like a non explored area for a win-win for some business and the nexts generations of data workers. Very good job Luke !! U always inspire me, greeting from Chile ❤️🔥

[@elrevesyelderecho]

Hi Luke...some suggestions for the website. 1) Can you add a filter by country to all sections? Nice to drill down on the Salary one, but it would be good to see on my area what skills are demanded for that role. Or did you find that no matter the country/location the skills are the same for the same type of role/job description? 2) Can you include more roles such as MI analyst - Management Information Analyst. 3) Can you add a date filter? - the output in the chart is based on all data available since website inception? Last week? Last month? It would be got to see the period of time for the data shown and/or have a date slicers. Thanks mate!

[@LukeBarousse]

I'm liking these suggestions; the country filter is a very popular one so i'm going to aim for this one first

[@LukeBarousse]

I added a country filter!

[@albertrosales2858]

It would be super if you list the jobs available !!!!!

[@TheEnderknight]

This would be cool for the Network/Service Technician career focus.

[@coisadealemao2565]

congrats on the awesome contend bringing so much value to the community

[@randall.chamberlain]

Fantastic job mate. As a data nerd I salivated throughout the entire video.

[@mindful_clip]

Automated Web Scraping: Use AI-powered web scraping tools to automatically extract job data from various websites, job boards, and platforms. These tools can handle anti-scraping measures and efficiently gather data on a large scale. Natural Language Processing (NLP) for Data Extraction: Apply NLP techniques to process the scraped data and extract relevant information such as job titles, skills, locations, and qualifications. NLP algorithms can help parse and structure the unstructured data collected from job postings. Entity Recognition and Data Standardization: Utilize AI algorithms, such as Named Entity Recognition (NER), to identify and extract specific entities like job titles, company names, and required skills from the scraped data. This helps standardize and organize the collected information. Data Cleaning and Deduplication: Apply AI techniques for data cleaning and deduplication to ensure the collected data is accurate and free from inconsistencies. AI algorithms can identify and remove duplicate job postings, correct errors, and normalize the data for further analysis. Intelligent Data Filtering and Categorization: Utilize AI models, such as text classification algorithms, to filter and categorize the collected job data based on specific criteria, such as job titles, industry sectors, or skill requirements. This enables efficient organization and retrieval of relevant data for analysis. Data Integration and Enrichment: Incorporate AI algorithms to enrich the collected job data by integrating additional relevant information from external sources. For example, AI models can gather salary data, company profiles, or industry insights to provide a more comprehensive dataset for analysis.

[@rhysallen2255]

Love the trusty 50 exclamation point debug assist.

[@rickhall517930]

I'd love to see the data on how many years experience various job postings require.

[@rauhan_sheikh]

My god you really are committed to helping people. I mean no one does that much work just for a video you really care about this stuff. Thanks man

[@LukeBarousse]

Thanks for noticing this, Rauhan! 🙌🏼

[@chrisikuenobe4159]

😂😂😂 to "🙄 Please" on Data Science being the sexiest job

[@LukeBarousse]

🤣 may have let my true feelings show on that one 🤣

[@amykostecki7789]

Wow, you are awesome!!! I got so much out of this video, every piece was helpful and educational.

[@rohitgopinath5960]

Really loved your app, great insights, is it possible to include other job titles like Product Manager and Technical Product Manager?

[@davidoconnell122]

This is a really good and comprehensive project. Gives a proper view into an ETL pipeline which can be murky and poorly defined. Super impressive

[@joesouthwell4080]

Amazing work! The only suggestion I would make is tracking time to see what tools are coming into fashion and which might be falling out.

[@caraziegel7652]

This is SO MUCH project - it seriously makes me feel like a major lazy imposter!

[@manpreetsohal11]

I am working on a project where I am doing quite similar kind of thing like retrieving the data from an API with Python and storing it in MySQL workbench. I am still trying to figure out how to automate that stuff. After seeing your work, you have really done an immaculate job.

[@tomshane1983]

You mention that you had looked into breaking out the degrees/certifications. I think that would be an interesting add to your app.

[@thirdstriker269]

the teams call at 4:12 got me lol

[@nhungluong3816]

Hi Luke, the website is amazing!!! I'm a cs grad and am looking for a project idea to do while waiting for a job. I really want to step into the data field and don't know which skills I should learn so this is exactly what I have been thinking of and want to do. Although my project scope may be smaller than yours due to my limited skills, I really like your work and find it inspiring! Subscribed!!

[@quangainguyen6209]

Hi Nhung, I'm glad to find you. I also had the same project idea waiting to put on my CV. I've been crafting the ideas for it but haven't started yet. Like for the extracting skills part in this video, I thought of using ChatGPT API but then again it would be too slow and costly. I'm looking to share some more ideas with you.

[@datawhipper]

Thanks for putting in the time and effort into this Luke. I got to know of more job websites which is really good at this time.

[@matthewardon2819]

Wow Luke, thank you! This satisfies my brain’s data itch on so many levels 🙌

[@Hdcqt751]

awesome work.. can not imagine the amount of errfort has been put in to it

[@robertramirez2167]

As a data professional, I watch a lot of these videos. Your editing always cracks me up.

[@nickcraft5552]

Awesome video Luke, I love how you describe your process here! I have enjoyed many of your other videos but this might be my favorite thing that you have done. I will share for sure!

[@SmashedHatProject]

Skill #1 for Data Science: Breathing

[@Geomaverick124]

It would be so cool if you had a project course on this app you built :) It seems like a cool Data Engineering project...Keep up the great work. :)

[@jonatanfriederichs7519]

9:33 "Look at me... I'm the captain now" meme hahahahah

[@davidagredano]

Apart from the great content, those transitions and all the editing in general is amazing!!!

[@AdarshSingh-rm6er]

Thanks Luke for putting enormous amount of efforts and time to help all the aspiring data scientist and analysts. I hope people notice and appreciate your hard work. Thanks again for your assistance!!❤

[@seekerdroid]

Please add data for DevOps, SRE and Platform Engineers. Great work. ThankYou.❤

[@shahriar0247]

Subscribed, because you provide value, thank you

[@greenc1088]

Thank you so much for this app and this video, mind-blowing amount of work was surely put into this.

[@web_jar6630]

Wow, this is immensly valuable! Thank you so much : )

[@AAhmed_Alii]

You are an inspiring data nerd!!

[@husseinwassouf2743]

I rarely comment on videos, but I must say, this is one of the most interesting videos I've watched this year and the website looks really nice too, As a computer vision engineer/AI Research Scientist I would be genuinely interested to learn about the skill-pay for these positions but man Incredible project!!

[@dairy831]

Love the website? Maybe add more tech Jobs/careers like UX designers, programmers, etc

[@dimitrispavlakis2590]

When Luke raises his eyebrows in bewilderment, you know the industry has a problem.

[@dimitrispavlakis2590]

Great job as always and also, Luke, at 14:35 it appears that the Data Scientist job has higher salary than Senior Data Scientist?

[@LukeBarousse]

Yeah I noticed this as well; it has to do with the grouping on the backend, I need to investigate this more