How Data Scientists Collect Data? The Process is Sometimes Painful

/ desiamericanprofessor

[@shubhendra9526]

I was pursuing my internship in data science in my 3rd year & people around me were fascinated about which techniques to apply for, on the data sets, but I always found data cleaning to be the toughest, as it had no designated process to follow and was completely based on your gut feel & experience. However then, my manager, told me that there are 100 guys available to analyse the clean data & apply algos on top of it but a very few of them have patience to dive deep into the unclean & ugly data so as to make it analytics ready. Later the same statement was confirmed by my other mentors & managers as I proceeded with other internships. So I can relate to your statement, very well, at 1:53. There were times where I had spent weeks in cleaning data and analysis took few days instead.

[@suryaprabhakaran9077]

Five ways by which "Quality Data" is generated in the Industry Scale: 1. Intra Company Data - Data by the company itself - More clean and readily usable 2. Calculated Surveys - Surveying to calculated sample of people 3. Major Surveys - Surveying that may also include general public - obviously false claims are a part and parcel, thorough cleaning is mandatory. 4. Experimental Data - By conducting experiments and evaluating hypotheses 5. Sentimental Analysis of Social Media

[@sujandahal8827]

Loved the way you have Tulsi plants in your backyard.

[@DesiAmericanProfessor]

my mother planted them :)

[@yashwanthnamburi]

sir very well explained . Thankyou so much for the crystal clear explanation sir .

[@anuragsingh9089]

Thankuu for simplifying this process i have actually visited various sources but by far yours explanation directly connected the dots .❤

[@aycajr]

Idk, I felt like you told us more what a data analyst does than how they actually gather their data to get to conclusions but thanks for the video

[@mrudulak2771]

Waw...flowers started blooming in ur backyard 👌👌👌

[@pandumaggi]

Your home garden is beautiful. What is the name of the violet flower plants behind you?

[@HellRaiZOR13]

So true the preprocessing part of the data is the most critical and hardest of all the other stuff. If you have crossed it successfully or in a reliable manner the next step of modeling and forecasting becomes relatively easier.

[@ArupGhoshAmmasandra]

Nice presentation Sir.. 👏 I watch your videos whenever I receive an alert notification.. Keep it up Sir.. Informative

[@DesiAmericanProfessor]

So nice of you

[@ArupGhoshAmmasandra]

@@DesiAmericanProfessor Thank you 😊

[@rajatadhikari7408]

Thanks sir!

[@bhagavan9416]

I am doing BSC Data Science From IIT Madras , Thanks for the information Sir

[@DesiAmericanProfessor]

All the best

[@chandrakalamane7983]

Sir my son is mechanicls but he want to dos in data scince / buziness anyletics ....can he eligible ..pls guide to us sir

[@chandrakalamane7983]

Or ...wich mechanicls stem course is best future he will do ..pls pls give to us yours precious time sir ..

[@pasudhir9308]

hello professor , you are stressing more on data science , is it a hype or really there is a demand ? (even for short term )

[@DesiAmericanProfessor]

these videos are based on requests made by subscribers

[@As-zc3kt]

Nice video 👍

[@tadepalliprasad]

Growth of jargon in the recent years it's nothing but statistics and analysts and modeling known since atleast a hundred years

[@rohitpanja8743]

Hello sir I'm complete bsc math .i want msc data science.can u tell me which stream of data science is best?

[@Anirudh0630]

Sir, how many colleges should I apply to in the US for undergrad?

[@Mr.Nobody-k3c]

legends says helicopter is still not landed 😆

[@sankalpkushwaha4393]

How can join PHD after Btech

[@raghunathnayak1]

Namaste Dr. Chaitanya sir, can you please tell me about PHD in hotel management in the U.S. Is there any information you can collect for me. Thank you sir, have a great day!

[@DesiAmericanProfessor]

I don't even know if there is such a thing called PhD in Hotel Management. I don't think it even exists but I can't be sure

[@raghunathnayak1]

@@DesiAmericanProfessor it's all right sir. I asked you about that, because I've completed Master of Hotel Management (MHM) from Utkal University of Culture, Odisha, A Government of India recognised university and also completed "Diploma in food production" from "Institute of Hotel Management Catering Technology and Applied Nutrition" (IHM), Bhubaneswar. Then I looked for PHD program in hospitality industry after completion of these courses. Now I am looking for some information about PHD program in hotel management, that's why I asked you about that , well Thank you so much sir for your time Always grateful for your informative videos . Have a great time!

[@bushrafatimakhan]

The Most Negative KZbinr I've come across 😂

[@DesiAmericanProfessor]

haha, thankfully you did not accuse me of lying. Positive or negative, as long as what I say is truth to the best of my knowledge, its all good.