Perform Exploratory Data Analysis In Minutes- Data Science| Machine Learning

[@krishnaik06]

Please note Pandas profiling will not work properly when u have many features in ur dataset. I tried some, ran out of memory.

[@shashwatdev2371]

Make a video on Block chain vs Data Science

[@souvikghosh6509]

in anaconda, pandas-profiling version is 1.4.1, unable to perform ProfileReport() work.

[@madhan-adavani]

Even the library Dtale works in similar fashion. It has more features than pandas profiling. But, am not sure about the time it takes for execution.

[@rajeshbc5405]

Is there a way to speed up the profiling by excluding certain columns n Som features like correlation? I tried running this on the credit card default dataset from kaggle n it hung

[@_I_N_D_R_A__]

@@souvikghosh6509 same issue but what we will do plz help me..

[@kailashmahadar3257]

Despite of (me) knowing so little about DS and not knowing how huge it is , I must say you are the person from whom I came to know that I still have many things to learn. Thank you sir for your unconditional effort. I would have had to pay thousands or lakhs for the knowledge you are providing free of cost.(I came to know DS exists because of you)

[@sreshtasharon1002]

I haven't seen any DS KZbin channel better than this ..hats off Krish!!

[@sagarkawade2541]

wow how amazing the exploratory data analysis did in only few minutes . great sir thank u

[@dheerajkumark2268]

Kindly make video on pros and cons of ML algorithms and it reason behind evolution of algorithms

[@VikashKumar-ty6uy]

Wah ....Maza aa gaya, yeh concept dekh ke

[@KalyanGk0]

Every time i stuck your videos clear all my doubts ..thank you krish 😊

[@ukuleleguy16cs36]

This is amazing library for EDA..

[@abhijeetwaghchaure6504]

It actually makes coding so easy..Thanks Krish..Please make such videos which informed us more and more newest libraries.

[@sachinjoshi187]

Thank you so much..This will help me a lot at work. Really like your energy level and the easy way of explaining the concept.Thank You.

[@midhunskani]

Thanks for introducing me to this amazing library. Im good data pre processing and cleaning stuff. But i wasnt good in data visualization. This library would be very useful to people like me. Also the quality of your videos has vastly improved with a good microphone

[@gayatrikvr1111]

Hi Midhul I have just started with EDA. Can you please help me the sources that helped you master data processing and data cleaning. Thanks 😊

[@midhunskani]

@@gayatrikvr1111 When did u start programming ? If you are completely new to programming then i would recommend taking a udemy course which is pretty cheap to get just started with the basics. After that if you need more help then reply

[@koruvappaspandu4180]

This library is awesome #Thank u Krish Bro

[@mdyousufuddin]

Amazing, Saved a lot of time. ThankYou very much..........

[@jagrutisheth1996]

Something amezing I learn today, Thank you so much

[@sandipansarkar9211]

Great explanation. Need to practice in Jupyter notebook which is pending.Thanks

[@albertopenalver1435]

Very amazing. Thanks for sharing

[@chinmayjape4981]

Great Library and Awesome Video... Thanks for sharing this....

[@Drkalaamarab]

❤️ Brilliant demonstration

[@darshitsolanki7352]

Amazing yrr krish no code nothing man soo so esy 🙏🙏🙏🙏😂😂😂😂😂😂😂😂😂😂😂😂😂😂

[@aadityajaiswal2225]

Thanks sir it helped me a lot 😁😁 Excellent video 👌👌

[@vvkwadhwa]

Boss it's really awesome and thanks a lot for sharing your videos with upcoming features...

[@akhilrapalli4118]

Great video krish 👏👏👏👍🏻👍🏻👌

[@gauravsharma-bl2sw]

Hi Krish, I am a grad student who completed my Masters from the University Of Arizona and now going for Ph.D. in this field. I Have one doubt here. The procedure I used to follow is this. I always do comparing and finding missing values first and then move towards scaling. Variable Identification; X, y => #cat, #Num Describe the data, info, head(), etc. => read the data properly, get an insight into it. Outliers feature-wise Missing values if #really large, then first fill them separately, separate them form outliers. else check for outliers For missing value treatment: dropna, fillna, Imputer(mean, median, mode), predictive Modeling(will gonna get too behaved data), K-NN( k=? The dataset should not be too large). For outliers: Visualization - Box plot, scatter plot, hist plot Detect - Box plot; -1.5 IQR to 1.5 IQR SD* - (2-3) x SD 5th to 95th %tile Mahalanobis distance Remove the outliers - drop them, natural log, reduce the wgts, treat them separately Entire dataset outliers Imbalance Data - final class Univariate correlation - Cat-count %age, cont curve, skewness, kurtosis Treat skewness and kurtosis Feature selection / PCA Feature correlation/bivariate correlation - if any two are the same, drop either, helps in visualization the relationship between them. Cat - Cat - cat1 table, cat2 table, table(cat1 v/s cat2), chi2 test, see if you need to treat them separately Cont - Cont - scatter plot, correlation = cov(X,Y)/(varX VarY)^0.5 Cat-Cont - see if you can treat them separately, separate them by tables and test p-values (z-test, t-test, ANOVA, Wilcoxon, Friedman) Feature engineering - Variable transformation - either sqrt, cube root => left skewed [cubic (-, +, 0), sqrt (+,0)] or loge=>right skewed[except 0, -] Done to convert non-lin to liner relationship Can use binning Variable creation

[@rakeshreddy3750]

Most amazing ds video I've ever seen

[@sankhabanerjee3533]

Krish,this is amazing ⭐ Thanks for sharing, it will help a lot

[@leutrimhajrullahu3521]

He is the chosen one...

[@yogenderkushwaha5523]

This is amazing sir. really worked

[@madhukumaryadav7194]

Thank You Krish . This seems to be a wonderful library

[@datasciencewithraghav]

i learned something new today. Thank you

[@prasadvlogs5510]

Amazing Krishna

[@AshitDebdas]

with one shot we can get 98% idea about data set..

[@skyrayzor3693]

Thank you for sharing this thing this was very helpful

[@mohanmike8780]

Learnt new skill 👌 thank u Krish bro

[@shashisharde8016]

thankyou krish .you have been amazing. thanx for all the help.

[@Uma_maheswar_rao]

sir can you make a video on reverse engineering. It will very help full for begineers, please sir.

[@niharmhaske9778]

Great work bro

[@rohandas1478]

This is really cool.!!!!

[@anuragmishra6262]

This is Fantastic !!!!

[@chintanchitroda5511]

you should try eazeml package

[@arjyabasu1311]

Amazing video sir !!!

[@shashwatdev2371]

Make a video on Block chain vs Data Science

[@niranjanjamkhande3773]

Fantastic...!

[@prasunprakash2297]

i tried installing pandas-profiling, its throwing error: no attribute called to_widget

[@krishnasarathmaddula194]

This is too good. thanks for educating us.

[@sandipansarkar9211]

finished watching

[@adilgondal7568]

bro, thank you sooooo much for this. you are awesome.

[@niyazahmad9133]

Osm i never heard abt this just amazing..

[@rtr.shubhamgrover1280]

tru dtale and sweetviz

[@AyushGupta-kp9xf]

Sir will you teach in the ineuron course ?

[@evan7306]

Thanks! Can you teach us about tranformers and attention model?

[@ravibhat2849]

Is okay to prefer this method compared to the manual one?

[@pureupstairs9538]

Did you find the answer?

[@AshishKashyap-zq8ws]

sir data science ke liye python mein expert hona jaruri hai

[@umabansod]

Its Amazing 👍

[@debarshichanda8588]

This is amazing 😍

[@nikhilgaikwad9954]

Code with harry told about this yesterday

[@krishnaik06]

Wowlet me check

[@vish8877]

I also saw this on medium today morning, but you made it interesting

[@manishshinde4954]

Hi Krishna, Can you make videos on streamlit? This was very informative.

[@vish8877]

Awesome

[@nothing8919]

Thank you alot Sir,

[@saiprakash5224]

Great Video!!

[@midhileshmomidi2434]

Have seen this in medium yesterday

[@nilavasen8631]

Dear Krish, Can you please let me know the key topics needed to learn Data Analytics area ( not the actual ML algo part) using Python ? Do we need to have in depth knowledge of Stat/Math to become Data Analyst ? Thanks in advance.

[@raiyyantaukueer2944]

How to check which version of pandas profiling is installed I tried pandas_profiling.__version__ but it didn't work??

[@vibhusw9794]

Is it required the data to be normalized before using this lib and also if we are using this lib, then is Manual EDA still required?

[@NeeRaja_Sweet_Home]

Thank You !!! for the great information

[@GodModeGamingGG]

I'm getting error at the code: profile = ProfileReport(df, title = 'Profiling Report', explorative=True) It's saying, TypeError: _plot_histogram() got an unexpected keyword argument 'title' I've installed pandas-profiling. Am I missing anything?

[@shankybatra5487]

Hi Krish, This is awesome and it really reduced time in doing EDA. Just one question i have? When i am trying the command "profile.to_widgets() " it gives an error as " TraitError: n_rows and n_columns must be positive integer ". i tried profile.to_notebook_() and it works but i am not sure what happend with widget command. please advise. thanks

[@beyond_numbers77]

i am also facing the same issue

[@kosanaraghusai6106]

I had a doubt regarding EDA , for suppose I had a dataset that contains 3 folders , in that 3 folders I have files with .jpeg format. Now , I need to perform EDA on this dataset, and also Can I convert the data into csv file????

[@mugisharonald6197]

Okay this is so good but i have a question, Is using this library enough to perform EDA on every data/ dataset? Or are there reasons where EDA would be done from scratch. I mean if pandas-profiling is there why is it that some people do not use it for Exploratory Data Analysis?

[@rrrprogram8667]

Anything similar library in R???

[@shashanks2024]

Hey krish. Thanks for this video. Also I've got a doubt that what if the dataset is huge. And this ends up taking a lot of time. Is there a way where we could reduce the time by considering not the entire dataset but only a part of it?

[@kunalgoyal8529]

I think you should drop a few columns and then pass it for profiling.

[@nizamudeenk8744]

Its not working in google colab

[@vervitkhandelwal]

Sir ,Why do i need ineuron course if i can study from study material you have provided ?

[@krishnaik06]

Real world projects and internship is the main thing and definitely the syllabus is advanced

[@basavarajpatil9821]

@@krishnaik06 where to find internship sir.

[@karamikoalexanderkrisna3285]

Can you do unsupervised learning for GIS/Remote sensing projects?

[@ashifaappu6750]

sir when i have given the code : profile = ProfileReport(df,title='pandas report on iris',explorative=True) TypeError: _plot_histogram() got an unexpected keyword argument 'title'

[@shakshisharma81]

Got the same error.how did u resolve?

[@asagaming7]

Great info!!

[@FunnyGamer1]

video on whole skillset needed data analysis for b-tech undergraduate?

[@tusharrewatkar3805]

Just by executing one line of code we can do whole EDA.This is good but then everyone can do whole EDA what will be the difference maker?

[@joe8ones]

exactly..i feel that very soon, maybe data scientists would be out of job, everything is becoming automated

[@MuhammadAhmed-jm1bs]

That's where the beauty of DS comes, you just cannot analyze the data by yourself, you need to have the understanding of various DS concepts in order to get all this information. Just the information is not enough and even this library works on limited datasets. So no worries you cannot replace DS over a certain library.

[@sandipansarkar9211]

finished practice but pandas profiling is not working

[@sandipansarkar9211]

I have finished practicing in Jupyter notebook but i am facing a error which is

[@satyendrasingh3805]

_plot_histogram() got an unexpected keyword argument 'title' . How to resolve this error ?

[@pradeepkumar-wh5oq]

Sir i get an error while installing pandas-profiling, its not installing astropy and shows like setup for astropy not build

[@raghubandi9076]

How can we deploy this to larger audience

[@allieubisse470]

I've been using this Library and gives me errors via Google colab.

[@RealSlimShady7]

I was stuck in the same problem with Colab, I have to pip install it everytime and then it worked for me. Try it out.

[@aryapulkit8886]

here is the solution !! kzbin.info/www/bejne/pn3bmKdoZdB-jbc

[@viveksingh881]

is this library reliable or sufficient enough for eda?

[@jeevankumar3527]

Soo we overcome the use of tableau

[@pavankulkarni841]

Bro What about Competitive Programming is it stopped?

[@AshitDebdas]

would you mind to recommend me some other really good channel related to data science

[@snehadixit4222]

I tried installing PP Library concat() got an unexpected keyword argument 'join_axes', can you please make some proper video on this. thing

[@001Debjeet]

profile = tableau

[@Taranggpt6]

Why am i getting different view also parameters like title, explorative are giveing me error and only ProfileReport(df) is working for me and giving ne output.. but not including all the things ..

[@krishnaik06]

Yes it will work too

[@Taranggpt6]

@@krishnaik06 Hi krish,. But in that way it is not giving ne the all the information like you got

[@darshitsolanki7352]

Hey krish my explorative and .to_widget() is also not working pllzzzzzzzzzzzz help🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏🙏someone

[@Taranggpt6]

@@darshitsolanki7352 same for me bro but still without using .to_widget() output is ready as krish also told it will work too.. but thing is we are getting lesser information compared to what krish got in his video

[@darshitsolanki7352]

@@krishnaik06 hey krish plzz help my explorative as well to_widgets is not working plzzz help🙏🙏🙏🙏🙏🙏

[@raghavaritti8973]

there goes 50% of a data analyst's job in 18 mins

[@pawanpu3202]

if we are using small data set, with limited variables, is there any limitations in using this library?

[@krishnaik06]

No limitations as such

[@pawanpu3202]

Thanks Krish!! You are great, I love to watch your tutorial. Keep providing us tutorials 🙏🙏

[@mansiupadhyay5387]

Im getting javascript error under variables section of the report. Any fixes anyone?

[@aashirbadmaharana2666]

👌🏻

[@himadrijoshi3745]

i really wanted to use this library....but its take eons to deliver outputs

[@darshitsolanki7352]

Hey krish i tried this one but it is giving an error here explorative ha no attribute

[@kilarunagarjun9277]

TraitError: n_rows and n_columns must be positive integer (Can anybody help me)

[@kirankumarj8229]

HI Krish, I want to join in youtube channel and I am a student of Ineuron. How to join the channel. Please let me know.

[@siddharthchauhan3404]

If i am trying to do on my dataset i am getting KeyError: 'Requested level (var1) does not match index name (None)'. Can anyone help me out with the error?

[@khushpatelmd]

I am getting TypeError: _plot_histogram() got an unexpected keyword argument 'title' Update: Install it directly from github as there is some issue with latest version of pandas pip install github.com/pandas-profiling/pandas-profiling/archive/master.zip

[@jsverma143]

Hi Krish i am getting error while installing pandas-profiling ERROR: Cannot uninstall 'llvmlite'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.

[@mithunsarkar7495]

Same for me as well.. Also it uninstalled all important existing libraries.

[@nibinjoseph2136]

ModuleNotFoundError: No module named 'pandas_profiling' tried many times installing.but didn't work! can somebody help???

[@krishnaik06]

Pip install pandas-profiling is the command

[@nibinjoseph2136]

@@krishnaik06 but still not working. tried in administrator as well

[@nibinjoseph2136]

says Requirement already satisfied but y error again in Jupiter notebook?