Let me know your thoughts in the comments and don't forget to hit LIKE and SUBSCRIBE :)
@sohamshah466611 ай бұрын
why you join Microsoft? you have your freelancing and your own one!?
@Coolthoom11 ай бұрын
@darshilparmar Thank you so much for your videos. I'm trying to purchase your 3 courses through the combo plan link but the page isn't loading for some reason. The individual courses load properly but the combo one doesn't. Kindly advise further.
@sivasankardevendla410811 ай бұрын
@@CoolthoomDid you purchase Courses?
@BShabnam11 ай бұрын
Can you please provide me your discord link, the link which mentioned is showing as expired
@Yeah_WTH9 ай бұрын
Bro can you please mention the duration for each of your courses?
@sam_temp9 ай бұрын
1) Book:- fundamentals of data engineering 2) Data warehouse (olap vs oltp, dimension table, ETL, ER-modelling, dimension modelling) 3) Snowflake (data warehouse) 4) Book:- The data warehouse ETL toolkit 5) Data processing (bath processing, real-time data processing) 6) Apache spark - real time data processing (core architecture, high level API, functions available) 7) Data spark (Pyspark) 8) Apache Kafka 9) Apache Airflow (workflow) 10) cloud 11) open table format 12) data observability tool 13) docker, Kubernetes
@phucluong634110 ай бұрын
00:04 Data engineering is a fast-growing field with high demand and numerous tools available. 02:24 Acquire computer science fundamentals and foundational data engineering skills. 04:41 SQL is the universal data language for communicating with databases. 06:58 Learning approach: Combine video learning with reading a book for effective learning. 09:11 Learning about data warehouses includes foundation and tools. 11:33 Data engineering involves bringing various data formats together and processing them efficiently. 13:52 Learning Data Engineering and Cloud Platforms 16:09 Open table format and data observability tools are key trends in data engineering. 18:10 Stay consistent and learn in public 20:15 Encouragement to engage with the video content
@rupeshphanindrasaiande7993Ай бұрын
I am going to be data engineer by December 2024 for sure.... My journey started with Data engineer :)
@VirajPrabhu-nn9ny5 ай бұрын
As a Data Engineer I can say this is a very good roadmap! Very well structured
@ahmetalperenyildirim618411 ай бұрын
Darshil, thank you! I'm following you for 2 years and now working as Data Analyst. I want be a DE! Great topics quite clear, thank you for sharing!
@khushbukeshari557710 ай бұрын
Hi Can you please help me on this? Can you provide me the roadmap how to move to as a data analyst? What are ths courses are required?
@alansmailov6147 Жыл бұрын
watched till the end and already committed for 4 month, just learned basics of ci/cd in azure devops. hope getting a decent job in new year. massive thanks to u Darshil and all the community u building here! happy new year from Kazakhstan, Almaty
@LOFI_WORLD_SONG11 ай бұрын
Hello can you tell me what are challenging and hard in data engineering also. I am in devops should I continue or should I switch to data engineer. As I don't want coding !!!
@alansmailov614711 ай бұрын
guys i did it, landed my first job as Azure Data Engineer, huge thanks to Darshil
@alansmailov614711 ай бұрын
@@LOFI_WORLD_SONGhonestly i don’t know😅
@MohamedSahith878 ай бұрын
@@alansmailov6147 where i can learn data engineering?
@ChristianeRhelyJoselleA.Bacani5 ай бұрын
@@LOFI_WORLD_SONG if you don`t want coding as sad I said it but Data Engineering is a hard coding jobs you will automate the task as much as possible and the core concepts is data pipelines and databases so you need to code as much as possible too so yeah if you don`t want coding data engineering is not for you they are software engineers also that specialized in backend
@srajangupta29217 ай бұрын
00:04 Data engineering is a fast-growing field with high demand and numerous tools available. 02:24 Acquire computer science fundamentals and foundational data engineering skills. 04:41 SQL is the universal data language for communicating with databases. 06:58 Learning approach: Combine video learning with reading a book for effective learning. 09:11 Learning about data warehouses includes foundation and tools. 11:33 Data engineering involves bringing various data formats together and processing them efficiently. 13:52 Learning Data Engineering and Cloud Platforms 16:09 Open table format and data observability tools are key trends in data engineering. 18:10 Stay consistent and learn in public 20:15 Encouragement to engage with the video content
@hritikapal683 Жыл бұрын
Already followed your 2023 roadmap and learnt everything mentioned just building projects these days thankyou Darshil watched this to get the knowledge of modern data engineering tools quality content as always!
@DarshilParmar Жыл бұрын
Thank you
@dawateden-yh4yy Жыл бұрын
@@DarshilParmar MAKE COMPLETE COURSE AS SHASHANK WEBSITE GROW DATA SKILLS
@prof.mangabhai Жыл бұрын
Hey hritika , how did you build your project, any good KZbin channels or resources you used?
@tamarainwang636211 ай бұрын
Getting my first data engineering role in 2024. Thank you!!
@njorogekamau38206 ай бұрын
I'm giving myself at least one year to learn data engineering without any expectations. I hope to revisit this comment again next year having landed a data engineering role.
@AHSAN880775 ай бұрын
Me too on the same path.
@Vincent456785 ай бұрын
@@AHSAN88077 Same
@HoopAlchemy2 ай бұрын
How is the journey so far
@mrweirdo16311 ай бұрын
I am gonna become a Data Engineer in 2024 💪
@mr.chintuji11 ай бұрын
Which coding language u prefer
@TM-op1xs10 ай бұрын
Me too
@rishabhjain138110 ай бұрын
Me too
@viraleditzofficial7899 ай бұрын
Mee too
@teamxipratikop92478 ай бұрын
Python sir @@mr.chintuji
@payalpokale21411 ай бұрын
Hey Darshil,I am working as data engineer since 9 years almost now, couldn’t stop myself to go till last, good content man, almost have touched based all the tools & technologies are mentioned. Yeah it’s like big sea one should keep learning and growing. Keep up the good work and keep creating good content.
@newagene827611 ай бұрын
what would you suggest a person wanting to switch from swe to data engineering
@ankurghosh23878 ай бұрын
hey can I connect with you for guidance?
@adib_shaikh Жыл бұрын
As per your roadmap that you mentioned in 2023, i just completed the advance postgresSQL , now i sharpening my skills with python, thanks for guiding us❤️ hope I'll become Data engineer , with pursuing your roadmap in 2024😊
@Greyhat2 Жыл бұрын
Same case here
@karthikvibuthi96358 ай бұрын
I will start my data engineering journey today. With many projects I will gain skills from these road map as well as essential technologies outside the course and as they emerge
@navarrodba Жыл бұрын
20 years as an Oracle DBA. Finally I’ll move do DE
@darshanmr54253 ай бұрын
Actually I am trying to change my domain to data engineering. I am currently working in oracle. Can u please guide me.
@FarhadYousefiRazin10 ай бұрын
Hi. Thanks for the roadmap, everything was clear. I didn't undrestand just one thing. You said we better to stick to just one web service like AWS. I wanted to know its function in the learning path, like what will we do in the web service
@DarshilParmar10 ай бұрын
Get started, you'll understand it, create account and do my KZbin data Analytics projects
@sabyasachichoudhury271711 ай бұрын
1. Positive Mindset 2. Stop Distractions 3. First 5 videos CS50 By havard university 4. Python 5. SQL 6. Raed basics of data engineering 7. Data warehouse - snowflake 8. Data processing - Batch processing - Apache spark Streaming Data - apache kalfka 9.Workflow management tool -Apache work flow 10. AWS
@malikmudassarawan11 ай бұрын
Consistency is the key and to have consistency you need proper motivation. Mostly we loose motivation along the way
@soumobratamanna6681 Жыл бұрын
I alreasy started learning data engineering after watching your past videos , I will be become data engineer . Thanks for the clear roadmap and instructions .
@DarshilParmar Жыл бұрын
All the best
@soumobratamanna6681 Жыл бұрын
@@DarshilParmar Thanks a lot for sharing such insightful content
@soumobratamanna6681 Жыл бұрын
@@DarshilParmar Previously I was working as a data engineer in a early growing startup company in Bangalore. I resigned last month only due to some project issues. Now actively looking for a job . Would like to get some suggestions from you regarding job hunt in data science domain
@ayandazwane_11 ай бұрын
Thank you, this video was very informative, I watched all of it and I will certainly become a data engineer.
@dondedios156210 күн бұрын
I'M GOING TO BECOME A DATA ENGINEER. THANK YOU VERY MUCH, DARSHIL. GREETINGS FROM ARGENTINA.
@Aviitr3723 ай бұрын
Next year till june i will develop my skillset fully to become date engineer and doing intern at end of my third year daily devotion 2.5 to 3 hr
@AYUSH-KHAIRE3 ай бұрын
sat 14 sept 2024 : I am going to become the best data engineer !
@deepthireddy3480 Жыл бұрын
I am going to become data engineer.. I have watched your video till the end.. And i wanna say you something that you are going to reach 200k subscribers very soon... Thank you so much for spreading such a great knowledge..
@DarshilParmar Жыл бұрын
Thank you, jai Shree Krishna
@deepthireddy3480 Жыл бұрын
@@DarshilParmar jai shree krishna
@Korudo10 ай бұрын
I’m going to become a data engineer. I do data integration in my day job, and I want to grow and become truly excellent at this.
@simpledrawing7284 Жыл бұрын
Hi Darshil, can you make a video on role of data engineering in Generative AI and LLM models.
@DarshilParmar Жыл бұрын
I’ll put this in list
@_k_a_m_a_l. Жыл бұрын
I am working as an ETL developer and I will become a Data engineer in 2024 we are using Vertica Data Warehouse My doubt is which is good Vertica or Snowflake I saw some blogs that Vertica is more powerful in query performance than Snowflake
@faruqolasupo227711 ай бұрын
Thanks for sharing this roadmap - watched to the end with ❤ from Nigeria
@peterobumneme39118 ай бұрын
Good day. I am also a Nigerian pathing on the journey of Data Engineering. can we link up??
@KeyBooksInsights Жыл бұрын
Everyone is teaching roadmaps but no one is teaching domain knowledge like retail, hospital,aerospace etc. please do a video.
@DarshilParmar Жыл бұрын
I have many projects, those are enough to get you started with all of these
@KeyBooksInsights Жыл бұрын
@@DarshilParmardoes a video regarding your day to day life.
@abhinavtiwari423811 ай бұрын
Domain knowledge matters the most with the advent of AI which can be utilized for technical part
@joelsarpong1847 Жыл бұрын
I will become a Data Engineer in the year 2024 due to your road maps and your course provided. Looking forward to the rest of the courses coming up.
@the_witcherr2755 ай бұрын
I watched this this video till the end. I really want to become data engineer. Thanks for this amazing roadmap.
@wckd672611 ай бұрын
Watched it till the end and I swear to god I'm going to become a data engineer this year
@teegeorgee2 ай бұрын
I watched this video to the end thrice. I enjoyed it. So cleared and i il be buying your course. I am a Data Engineer and there are just too many things t learn to be on top of the game.. This life is a Game. Get in touch.
@adityaloya16110 ай бұрын
I am going to become a Data Engineer. I watched this video till the end. Thank you so much for the content.
@moinshaikh855110 ай бұрын
I’m going to become a Data Engineer! Thank you for your useful information!
@kalyanishende6189 ай бұрын
Thank you Darshil... I am on the journey to become DE now watching this video and the roadmap you mentioned in the video is pretty cool. Thanks for sharing such useful content
@SiempreSunshine310 ай бұрын
My goal is to become a data engineer by the end of the year 2025 mastering all the concepts and technical tools related to this field
@Shahnawaz_Ansari_ Жыл бұрын
Great video and resources mentioned Appreciated 👏
@DarshilParmar Жыл бұрын
Glad it was helpful!
@safafatima61249 күн бұрын
Where are the resources?
@hazarijayesh9807 Жыл бұрын
Intrested , watched video till the end. ready to start journey for data engineer.
@xavier144 Жыл бұрын
Will AI take up Data Eng job? please make a video on it. also how to search for data eng jobs can you make a video on this also?
@DarshilParmar Жыл бұрын
I already have two videos on this, just check my channel
@haridatta549511 ай бұрын
Watched till the end!! Great content. Will start learning from today
@fahadbawazir56210 ай бұрын
Data Engineering + DEVOPS (Aws or GCP or Azure) that is Docker + Kubernetes = ULTIMATE Data Engineer
@stevenlomon8 ай бұрын
I watched til the end and I am going to become a data engineer! Love and good vibes from Sweden
@narenbot5 ай бұрын
Awesome god tier roadmap.. I will become a data engineer by this year .. thanks bro ❤
@Maverickghst2 ай бұрын
Thank you for the detailed roadmap & guide. I will become a data engineer in coming months.
@manishpatil4045Ай бұрын
Hello Darshil i am unable to login data vidya and my community app, two week ago it was running but now it not and currently i live in UK
@DarshilParmarАй бұрын
Please email on info@datavidhya.com
@Reactionz.34026 ай бұрын
I'm going to become by Data Engineer before the end of 2024. The journey just began.
@jigarrthaker24417 ай бұрын
Hi Darshil, Thank you so much for providing such clarity Data engineering path, Currently I am working at organization which handle Splunk stacks and also i handle and work on splunk stacks which are on Snowflakes and also i work on Docker and kubernetes so somewhere this roadmap gives me clarity and open opportunity path to get carrier Data Engineering. Thank you once again and keep updating us with such of informative knowledge and also from your experience.
@viveksingh11211 ай бұрын
Thanks Darshil, I watched this video till end and will keep following you to build my journey to become a Data Engineer
@nanayaw715911 ай бұрын
I am going to be a Data Engineer in 2024 and the years beyond
@sanjanagoud115511 ай бұрын
Thank you for the video Darshil..... I am going to start my career in the field Data Engineer. for sure in future i will become an Data Engineer.
@amoghshukla22923 ай бұрын
I am going to become a Data Engineer & Learn Every SKills Mentioned here before 18 feb 2025(Thats my birthday)
@kavyamuralidharan6878 Жыл бұрын
Very clear and driving roadmap video, thanks for the guidance!😃
@vishwasoundararajan68412 ай бұрын
I will became a data engineer and watched till the end🎉...thanks for sharing❤❤
@Cheer4SK Жыл бұрын
I’m going to become a data engineer! 🥳 You guys have got this, too! 🌟
@lily0721 Жыл бұрын
I’m going to become a Data Engineer! Thank you for your useful information!
@amangurjar9714 Жыл бұрын
do comapnies hire fresher for data eng role in india ? aws or azure what to learn ?
@mellowtones1985 Жыл бұрын
I would say both but I'm an Azure guy.
@sabarishv90437 ай бұрын
Excellent Road map, sure I'll become data engineer in two months ❤
@angellavado763 Жыл бұрын
I'll become a master in Data Engineering in 2024! 💪🏼🤩 Greetings from Peru 🇵🇪.
@AryanRaghuvanshi-tm9el Жыл бұрын
I have watched your end to end project videos previously, really amazing content you have been providing, I will check out your courses.. keep uploading videos like these ..
@DarshilParmar Жыл бұрын
Awesome, thank you!
@AmanKumar-sr5wj8 ай бұрын
How much python is needed Any library which we need to learn 🤔
@Shrinath5113 ай бұрын
Pandas,Numpy,Matplotlib and Scikit Learn
@Gokulprasanth-gs8zi Жыл бұрын
I am already in the journey, thanks for sharing valuable content
@nagalakshmia1291 Жыл бұрын
i have already started my data engineering career that's from now
@mr.amitdas1541 Жыл бұрын
i ve completed this vedio.. This is very insightful.. Thnk you for the guid.
@sibusisokanityi11 ай бұрын
Great road map to data engineering I'm currently pushing data science but I also love data engineering....so now I'm pushing both 😅
@prof.mangabhai Жыл бұрын
Highly anticipated for spark and aws courses !!
@KaizokuOuNaruto Жыл бұрын
so many applicants for data engineer roles for just 1 opening in companies? 1 job and 11k applicants and even more than that.. what is this? why does nobody talk about this? how can we stand out from them? just with the projects or need AWS solution architect, and data engineer associate new cert? or gcp and azure data engineer? snowflake certifications? how to deal with this problem ?
@DarshilParmar Жыл бұрын
Answer is in your question even though there are so many applicants you can beat them with good project and certification
@KaizokuOuNaruto Жыл бұрын
@@DarshilParmar thank you for the reply, just confused because heard someone say that certifications are not really something that can get you a job, so thought that being certfied isnt worth the effort and skill so asked this .. good projects and certifications is the way...
@gudiatoka Жыл бұрын
Is dbt and snowflake required for azure data engineer???
@DarshilParmar Жыл бұрын
Yes
@harishparamathmananda138511 ай бұрын
Watched till the end! Thanks for the tips and tricks, I'll become data Engineer in less than 6 months. 🎉
@jbh707911 ай бұрын
Excellent content. Keep the good work up!
@ShivamKumar-pk1rf11 ай бұрын
Got the roadmap Thank you so much
@icon5819 Жыл бұрын
Hi Darshil, can you please drop rest of the courses quickly. I want everthing related to the course at a single place and your course is worthy enough for that
@reynardtcloete695911 ай бұрын
Great video brother :) thanks man
@waynelast16853 ай бұрын
I don't say this lightly.... you have excellent content.
@arjitsingh3519 Жыл бұрын
I would like to start my career as data engineer. I already familiar with Python, SQL , DSA , and linux. Learning all those additional technologies/tools its not a big deal for me. But the problem, I have a 4yr career gap. Few people told don't go for data science related domain because it is difficult for a fresher with a gap to get job. Is it that true can i go for full stack rather than DE? I'm stucked Kindly enlighten me bro..
@DarshilParmar Жыл бұрын
Hi, You can always explain your career gap and also showcase you took efforts to learn new things, if you can prove you have skills by projects then no one can stop you
@Dear.bi61010 ай бұрын
I watched the full video and i am going be the Data Engineer in next 6-7 months
@sriharisrinivasan1307 Жыл бұрын
Quick question: If we purchase your all-in-one combo course, Will you add the Apache & Pyspark course, or will it be launched separately as an additional purchase? Would like to have all round course material at one place for All the Data engineering topics.
@DarshilParmar Жыл бұрын
It will be separate, current price is according to 3 courses only
@sriharisrinivasan1307 Жыл бұрын
@@DarshilParmar Okay thank you
@hemanthsagar35378 ай бұрын
Thank you for your inputs! Completed Databricks certified Data Engineer associate after following your certification path. I am following every video that you upload. Thanks alot ❤
@atharvajoshi10038 ай бұрын
Watched till the end. Really inspiring video for all data engineer aspirants.
@Aditi9917711 ай бұрын
Stayed till the end ❤ A data analyst here, will be a data engineer in 2024 ❤ Thanks for the video
@shandeepraula Жыл бұрын
I am not able to open the aws account, it is showing invalid as soon as I enter the debit card information in the payment option. please give some solution
@Rider-jn6zh Жыл бұрын
Hello Darshil, What do you think of Microsoft fabric ? Will it replace traditional data engineer tools. Kindly help us to understand this MS Fabric. Its advantage and scope in future.
@mellowtones1985 Жыл бұрын
I'm learning Fabric now and so far, so good.
@Rider-jn6zh Жыл бұрын
@@mellowtones1985 for what solution u r learning? For DE, DA, or DS
@mellowtones1985 Жыл бұрын
@@Rider-jn6zh At the moment DE and DA. I’ve been using all the Microsoft pieces separately ADF, DataLake, Azure Spark, PowerBi etc. So far it’s very interesting to see how all can be used under one platform.
@Rider-jn6zh Жыл бұрын
@@mellowtones1985 can you please send me the resource link that u are going through for ms fabric
@LOFI_WORLD_SONG11 ай бұрын
@@mellowtones1985is it easy to become data engineer, no or very less coding, with less responsibility and continuous learning. Which devops or data engineering is best ?
@SanjayKumar-rw2gj Жыл бұрын
I'm going to become a high skilled Data Engineer in 2024. Will follow the roadmap thoroughly. You mentioned that we can get all these skills in 6-8 months, how much time daily I need to spend and there are bunch of tools to learn like, sql, python, Kafka, spark, cloud and many more is there any specific order to be followed or can few things be done in parallel?
@ektabangar40949 ай бұрын
Hi Darshil, I am currently working as ETL developer. I have 3 years of experience. I am looking for better opportunities. Can you please guide me if possible?
@DANNYEL20122 Жыл бұрын
So I'm learning python specifically for data engineering. What aspects of python do you think i need to focus on
@njoy2075 Жыл бұрын
Think of building a project where you have to parse a log file then join it with scraped web data then once the final dataframe is available, push it to sql. Now you can Google the components needed for the project. That's what you need to learn.
@ManiKanturi11 ай бұрын
Thank you :) I'm going to become the Data Engineer. Please make the course for the remaining topics or tools.
@oshebase Жыл бұрын
Thanks for this guide. I'll bevome data engineer come 2024
@arindamsinha58575 ай бұрын
Does your course spark with databricks use pyspark? Is your databricks and spark course cover end to end basic to advanced or need to refer anything else other than your course. Please help with these answers and also say if there is any pre requisite for the course apart from python, sql dwh?
@hUnterrr3842 ай бұрын
After being in cybersecurity domain for 3 years, can i switch to data engineering role? I'm not talking about just completing a personal project, how can I get a job in other company if I have experience in other domain industrial projects?
@akhilsrivatsav Жыл бұрын
I will be data engineer by March. And watched your video completely. ❤
@dreamlands3970 Жыл бұрын
I am now watched complete video i will become data engineer in 2024 from basic to strate from now❤
@rbrindha7 ай бұрын
Have finished the course through Google programmes. Can you suggest me on how to pass the GC-DE?
@fahadbawazir56210 ай бұрын
please make Apache Spark + Data bricks along with Snowflake complete video with handful of exercises & its application in the real life scenario, much awaited your reply
@DataScienceAndEngineering Жыл бұрын
Thanks for the video. Really Great Video.
@himanshusikandriya5133 Жыл бұрын
I will be Data engineer in 2024 and I will definitely make it count 😇
@praveenbhandari2516 Жыл бұрын
In the recent trend of this era who is more earning data scientist or data engineering?
@DarshilParmar Жыл бұрын
DE
@barnabasjema6620 Жыл бұрын
can you share the books link. i could not find it on the internet
@DarshilParmar Жыл бұрын
Just search Fundamentals of Data Engineering
@vinaygundu98674 ай бұрын
I want to be Data Engineer. Watched your video till the end ..
@okorochaobinna770111 ай бұрын
You're a blessing to an aspiring data engineer
@saljeshmaharjan67605 ай бұрын
Watched till end, this is literally god tier roadmap