How to Do Data Exploration (step-by-step tutorial on real-life dataset)

[@prinjeshshah9128]

I was searching for a video where someone explains their reasoning in data exploration from last 15 days. This video has now become bookmark for my future data exploration works. Thank you very much.

[@misraturp]

That's so nice to hear! Keep up the good work Prinjesh!

[@AlissaFernelius]

Honestly your the most honest and humble trader on KZbin!!

[@lara-rosetadman3499]

Hi Misra, this video was so helpful! I'm starting my master's in Data Science this September and you've honestly been such a role model for me! Thank you and keep up the great work!

[@misraturp]

That's so nice to hear Lara-Rose, thank you! Best of luck in your master's. I'm sure you'll do great!

[@zeinomadikizela4783]

Which University

[@lara-rosetadman3499]

@@zeinomadikizela4783 University of the West of England (Bristol)

[@Ha-mb4yy]

@@lara-rosetadman3499 im at cdf

[@Sir_Lancelotz]

I didn't finish the video, and now I really understand why this is important, good job, excellent video!

[@stephanielynn9808]

Found you as I start to work on a project for my MS in analytics! This has definitely helped me make better progress than before.

[@misraturp]

Fantastic!

[@sergiopellitero4136]

This is the kind of videos that I am looking for. Let's see if it is interesting.

[@ExtraKanin]

Hi Misra. I'm 18 minutes into the video and I'm still able to follow. thank you for this! Most of the articles I see on Google just jump straight into data cleaning and I don't even know how they detected the data errors they're trying to clean in the first place.

[@misraturp]

❤

[@swadhikarc7858]

Very useful indeed.. learnt how to think like a data analyst as a beginner

[@lianyan1412]

Really like how you have explained the thought process when comes to data understand and exploration. Learnt a lot!

[@misraturp]

Great to hear!

[@djmd808]

Just wanted to let you know that your videos breathed new life into my Udacity Nanodegree experience. I have really been stalling on the last two classes, but this video and the cleaning one (along with others) were so much easier to watch and understand than the Udacity instruction provided in the course. Thank you!

[@misraturp]

Wow, thank you. That's great to hear! Best of luck with your courses. :)

[@mmikeves8986]

I appreciate your explanation even though i was looking for something else,

[@arindam_maji]

a definite bookmark video for data analysts

[@Naturebykittu748]

you explained so well. Just awesome. Thank you..

[@SimaManiyevaDEV]

Thank you so much! I love your explanation.

[@ramvenkatachalam8153]

Wow . Great DataSet . just what i was looking for . I was searching for a video where someone explains all important things on datascience . This video has now become bookmark for my future data exploration works. Thank you very much Misra . ur channel is the best in the world.

[@misraturp]

Thank you Ram! That's very nice to hear. :)

[@ramvenkatachalam8153]

Hi Misra . Plz put more videos like this to help everyone in their career growth . Thanks a lot .

[@SFW7]

Thank you so much for making this video! I'm just starting out with using python for data analysis and this video is so informative and inspiring. :)

[@gunhild1951]

Great video! Very informative and helpful 😃 I would love if you can upload more videos like this where you go through the steps of exploratory data analysis. I love that you really bring up every little thing of how it could be when doing EDA. Like for example where you talked about the data explanation and how it could be in the real life. Just the thing about documentation of the dataset fields and how it sometimes is not so obvious and that you therefore need to talk to someone responsible etcetera etcetera. This kind of information that you brought up helps me to picture how I could be. Maybe it's silly but a simple thing like helped me big time. Overall, a perfect how-to-do-video. More videos like this would be appreciated! 😄

[@misraturp]

This is super useful feedback for me Gunhild thank you! Personally, I also really like little details like that that can really give one a feeling for what to expect from a job so nice to hear you thought it was helpful. I will prioritize similar videos in the future!

[@gunhild1951]

​@@misraturp Hi again, Thanks for replying Misra! :) Well of course, I have to show my appreciation when the content is so good. Exactly, it's the feeling and to be able to visualize things that helps the most when you're to trying to familiarize with a new subject matter. Thanks, that would be perfect if you could upload more :)

[@santdayalverma8255]

Hi Misra, I love your videos. The way you explain topics in a simple manner is really helpful. Thank you so much!

[@massoudkadivar8758]

I love the way you teaching! Thank you

[@misraturp]

You're very welcome!

[@smartlymade]

thank you for this video! i was very overwhelmed by a dataset that i was looking at and didn't know how to start. great video

[@misraturp]

You're so welcome!

[@Olumasei]

You teach better than my MSc lecturers. Thank you

[@misraturp]

You are very welcome Samuel. That's nice to hear that you like the videos. :)

[@T4ngerin0]

It‘s a pleasure to watch your Videos. Thank you Misra! 🙏🏽

[@misraturp]

That's very nice to hear, thank you!

[@abhishekjadhav7340]

Thank you Misra, I personally like your videos a lot. You really teach Good .

[@misraturp]

Thank you!

[@swapnildeshpande21]

Best explanation and video to kickstart thinking about datasets...want more quality video like this... Keep it up

[@misraturp]

Thanks!

[@jbruges]

this video was very helpful, I'm going to watch all of them

[@misraturp]

Awesome!

[@erfanmoosavi9428]

Thank you so much Mısra! You explain so gooood!

[@misraturp]

Thank you!

[@leonbeler2711]

Thank you so much for making this video! I am just getting started in the field and your video has given me lots of tips and tricks that would've taken me months to figure out by myself. Also: yay for more women in Data-Science.

[@misraturp]

Thank you! And I'm glad it was helpful. :)

[@last_ivka]

Wonderful explanation, thank you!

[@datacollade]

Thank you so much for this great video !

[@gotitgotya]

its very informative ... thank you so much for uploading this❣

[@misraturp]

You're welcome!

[@mehdismaeili3743]

Hi , you are a good teacher.thanks for your useful videos.

[@misraturp]

Thank you, that's great to hear!

[@cloudnatives9105]

Excellent video.. thanks for sharing! Learned a lot on the data exploration. Ms. Misra.. Do you have a video on just plotting data while doing the exploration?

[@Labbsatr1]

Çok verimli bi videoydu mısra çok teşekkür ederiz

[@misraturp]

Rica ederim! :)

[@superawesomecaptainmcfluff9506]

Actually a really funny video. At around 14:39, you said you didn't know what an inch was. I was amused and then I remembered that you were Dutch haha. Great video! Love it! P.S. Imperial units suck!

[@misraturp]

Have to say I agree. Can't really see any reason to use the imperial system. :D

[@superawesomecaptainmcfluff9506]

@@misraturp Oh wow! Having you reply is so cool. I did a project on the NYC Collisions dataset using your Streamlit templates. Love it. Thanks for the help! I can't wait to see your channel grow to 100k+ subs especially with DS/ML being a rapidly growing field. I have one Q if you don't mind answering: Do you have any tips on making my GitHub profile more attractive to recruiters, and really making sure the projects done properly showcase my skills?

[@misraturp]

Hey ​@@superawesomecaptainmcfluff9506 , Thanks a lot for your support! For the github account, I would make sure to include a bunch of things: * in the readme mention all libraries, programming language, technologies, ML algorithms you used for that project. recruiters are looking for keywords, give them as many keywords as you can. * Have a lessons learned, or future work kind of analysis of your work. Doesn't have to be long. This will serve to show that you are aware of the shortcomings and what can be done better in projects. * Make sure you have headings, comments and small notes that structure and explain your code. This should be a good start. Just dumping code in github unfortunately doesn't work. Data science is more about understanding and explaining your code than the code itself. This question inspired me to write this up a bit longer though. So I will go send my email subscribers an email about this now. :D

[@superawesomecaptainmcfluff9506]

@@misraturp Wow, you've been so incredibly helpful! I follow your newsletter a lot so hope to see your email soon! Thanks for all the tips, I especially liked the one about "lessons learned" and improving upon that. Thanks again!

[@misraturp]

@@superawesomecaptainmcfluff9506 You are very welcome! And thank you for the question. I love your username by the way, is it okay if I mention it in the email?

[@HarishKumar-qt3mr]

23:49 to 23 : 51 just listen it really 😍

[@siddhantnaik]

Very nicely done! Looking forward to more data cleaning videos. Keep the good work going on. Thanks!!

[@misraturp]

Thank you Siddhant!

[@udaykumar4B3]

Thank you so much 🙏 your video helped me a lot, keep doing this🤞

[@misraturp]

You're very welcome :)

[@dpratte]

Very nice job! In my experience over many years in data warehousing, good luck finding the 'data dictionary' type document you describe. Most orgs don't have the discipline to maintain that. So you'll need to develop relationships with the people who can help you! Thanks Again!

[@misraturp]

Thanks Dan!

[@harikishan437]

First of all tq a lot , I took coaching in data science but i never had an xact idea what we need to do in pre-processing and what are things we need to see and what are enough for us.....after watching this i got the clarity on preprocessing , that what should i do in that step. Again tq a lot @Misra Turp 🤝🤝🤝🤝❣❣❣

[@misraturp]

You are very welcome Hari! I'm glad it was helpful!

[@jeevan1409]

You saved my project ❤️

[@misraturp]

That's amazing!

[@pliniado]

Thanks Misra, I'm Python student (intermediate level, I think) and this video was just what I was lookin for.

[@misraturp]

That's great to hear Pablo!

[@arnabroy4870]

Mam, First And Foremost you are very Beautiful,and Secondly your tutorial is awesome, it gave me a lot of insights about how to do data cleaning.. Thank You Mam,Lots of Love and Respect from India❤️

[@mr.abu-baker8bp460]

So much helpful , thankk alot!!

[@misraturp]

You're welcome :)

[@onurerdogan2236]

Very useful video.Thanks for sharing

[@misraturp]

Thanks Onur! :)

[@pimpirisnais]

Thanks, very practical

[@misraturp]

You're very welcome!

[@arpangoyal7337]

Hi Misra, just came across your channel and absolutely loved this video, so crisp and informative! I have just 1 suggestion: it would be so much more helpful if the video was like "Raw" (maybe a separate, longer video which includes the difficulties you came across and how you solved those?). That said, subscribed to your channel and hoping to learn more about Analytics!

[@misraturp]

Hey Arpan, thank you for your nice words and also taking the time to give your feedback. :) That actually is a good idea. I might do a blind data exploration with a dataset I've never seen before soon!

[@chauhermione137]

thank you so much! Your video is really helpful

[@misraturp]

You are very welcome! 🤗

[@felixisnr1]

really helpful. big thanks!

[@misraturp]

You're welcome! Glad it helped. :)

[@axelrasmussen5365]

Great video. Thanks

[@misraturp]

Glad you liked it!

[@aleh3627]

We have veey wide trees in Argentina. Easily over 3 meters in diameter. They are not officially classified as trees, but the trunk is definitely of that diameter. The roots are also huge and tend to extend to the surface. Usually they become playgrounds for kids. I used to play around them as a kid all of the time.

[@misraturp]

That's crazy. What are those trees called?

[@aleh3627]

@@misraturp we call them "gomero". Not sure about the proper name. If you Google "gomero argentina", you can find them.

[@Victoryoflight]

Very beautiful girl. I wonder if she is married or not

[@KeithEmsAndrew-pf2pn]

thanks to your videos

[@ziaurrahman626]

Thanks for ur nice explanation. Could u plz share dataset and code?

[@hrithiksingh5131]

thanks, great informative video. Please make videos on creating portfolio projects using python pandas,matplotlib

[@misraturp]

Great suggestion! If you're interested I have a course where I teach how to build a portfolio project: www.soyouwanttobeadatascientist.com/hods

[@diegomartins7214]

Thank you!

Hi Misra, thank for your helpful video, you're so good at Data but you may gain some about tree 😄

[@andrespino8552]

Awesome. Thank you so much :)

[@misraturp]

You're very welcome!

[@govindant8360]

Awesome Mam 👌👌

[@misraturp]

Thank you! :)

[@froylanrodriguez7624]

I am a year late but this video is GREAT!! Thanks a bunch

[@misraturp]

That's great to hear!

[@paragandozdroch3791]

Can someone please let me know , how the search bar drop down on 23:47 min? thank you

[@ziaurrahman626]

Thank u so much. Plz share the code and dataset..

[@KapitanAliRidho]

Thanks for the video Misra. Done subs

[@misraturp]

Thank you!

[@Sylas_Tube]

in the first video i saw , i was like godd! she is beautiful! so that was how i watched next 26 videos from u🤒

[@shayp20]

Hi Misra. Thank you for this video. Is there a chance you can post the code you write in this video?

[@misraturp]

I do not have the code I developed in this video yet but I might make a similar video again soon and share the code. Stay tuned!

[@billionairepodcast]

hi @misraturp, why you said ID is categorical value ? Why you said it's continuous when it's a whole number, a discrete. thank you

[@CaribouDataScience]

What playlist is this video part of?

[@misraturp]

Here it is: kzbin.info/www/bejne/p6nTfHZ4i5tji5Y

[@ueto1985]

It worked! Thank you..

[@misraturp]

You're very welcome :)

[@peaceandlove8862]

Can you please help how to get the data set thanks

[@marypazcuessy3004]

tree_census_subset isn't loading after I remove all the unneeded columns, not sure what I'm doing wrong

[@janewade5619]

Also for outliers, max sidewalk width in NYC is 30 ft (360 inches). So the width of a tree max would be a quarter of that (90 inches)?

[@misraturp]

Hey, I haven't even thought about including that information, that's a great idea! Kudos!

[@csanchez9536]

Actually the biggest known tree diameter is like 24 meters or something like that. 450 inches is very reasonable

[@rangabharath4253]

Awesome

[@misraturp]

Thank you!

[@yunisahmed4772]

a good Teacher and a beautiful girl ! i love you

[@yourdataguy_hammad]

You're so cute, it was hard not to watch your video all the way through.😁😁

[@nagasai5243]

Pls tell me how to unnest

[@ataires]

You are so pretty and so good at explaining the process. Thumbs up!

[@jpgunlukleri]

Türkçe videolar yüklediğiniz kanalımız da var mı????

[@misraturp]

Simdilik yok ne yazik ki

[@trend758]

How many of you watching this video for mentor in video 😂😂😂 I am watching for her.

[@lubin2764]

Any idea what is om.datasets ?

[@misraturp]

Could you elaborate Lubin about what you mean by om.datasets?

[@rajsonawane8607]

Hi Misra, Thank you so much for this video. Can you please demonstrate using JSON instead of CSV from the same website?

[@misraturp]

Honestly, if I were working with JSON files, I would first make them into dataframes and then do the data exploration. So the approach would not change. :)

[@parshavkarani8331]

8:00

[@asjadnaeem2557]

Hey! Can i get a copy of code?

[@misraturp]

I don't have it uploaded anywhere unfortunately.

[@ramsri992]

You look so beautiful mam and nice explanation

[@misraturp]

👉 Get real world data science experience by doing hands-on work www.misraturp.com/hods

[@travisfubu9053]

I kind like the way you explain thing in the tutorial but I think if you worked on income data or maybe some cancer research data would have been simple I mean trees is kinda not interesting enough to fully engage with the set lol

[@misraturp]

Fair enough. It's just sometimes a bit tricky to find datasets that allow one to work on it publicly like this. In the latest videos I've been using a dataset on open positions in New York. Maybe that'd be better suited.

[@travisfubu9053]

@@misraturp yes definitely. Maybe it's just me I'm an economics graduate so a set on trees kind made me like "meh why trees"

[@misraturp]

@@travisfubu9053 Hahah alright, next time something a bit more real-life-like for you!

[@mahammad4051]

türkçe de gelsin

[@misraturp]

Bir gun o da olur!

[@lysedeborah2179]

You are so beautiful

[@magicmedia7950]

Great video . But she moves too fast.!

[@dimakapranov7634]

en.wikipedia.org/wiki/Sequoiadendron_giganteumac

[@Kristina_Tsoy]

Great video, thank a lot!

[@misraturp]

You're very welcome!