How do I change display options in pandas?

Have you ever wanted to change the way your DataFrame is displayed? Perhaps you needed to see more rows or columns, or modify the formatting of numbers? In this video, I'll demonstrate how to change the settings for five common display options in pandas.
SUBSCRIBE to learn data science with Python:
www.youtube.co...
JOIN the "Data School Insiders" community and receive exclusive rewards:
/ dataschool
== RESOURCES ==
GitHub repository for the series: github.com/jus...
"get_option" documentation: pandas.pydata.o...
"set_option" documentation: pandas.pydata.o...
"reset_option" documentation: pandas.pydata.o...
"describe_option" documentation: pandas.pydata.o...
More about options and settings: pandas.pydata.o...
== LET'S CONNECT! ==
Newsletter: www.dataschool...
Twitter: / justmarkham
Facebook: / datascienceschool
LinkedIn: / justmarkham

[@LonglongFeng]

the best and most detail-oriented tutorial I've seen on KZbin. thanks

[@dataschool]

You are very welcome! Glad the videos are helpful to you!

[@AbdallahProgrammer]

Thank you so much for this awesome playlist it is really helpful

[@dataschool]

Glad it was helpful!

[@noel2577]

I have been hooked to your videos like a tv show ever since I watched the first one and I want to say that not only are these videos extremely useful and valuable but they are just as much entertaining as well. btw I've been hearing about some other, though not free, really powerful data analysis tools such as Alteryx and Pathwise. would absolutely love to watch if you create videos on those.

[@dataschool]

Thanks very much for your kind words! Also thanks for your suggestions 👍

[@marty590]

Thanks Kevin.

[@dataschool]

You're very welcome! Hope it was helpful to you!

[@fernandai.b.140]

Thanks for the video, it is clear and easy to understand 👍

[@dataschool]

Glad it helped!

[@benogidan]

pd.set_option('display.float_format','{:,.0f}'.format) will get the decimal points off

[@dataschool]

Good to know, thank you!

[@sindhumohandas1479]

Truly helpful video.. thankyou so much😊..

[@dataschool]

Glad it was helpful!

[@hephepiyey]

Hello there! Thank you for the explanation. So I was wondering if it's possible to set the column width to its max to show the numbers because I am seeing +06 in my column and I really wanted to show everything. Is that possible? Thank you!

[@rajarshi_4479]

How do we select the first 4 digits of each values in a column which is consisting of 10 digit numbers..can you plz make a video on it.. It's been of great help from all your videos

[@dataschool]

Use a string method. See this video: kzbin.info/www/bejne/mKDJknZmfsieftE

[@FabioRBelotto]

How do I set new default values or save my display changes even after restarting the IDE?

[@nelson3391]

Thank you for the excellent explanation.

[@sinabaghaei3504]

Thanks dear Kevin for explanation. My pandas File doesn't show set_option for numbers more than 10. it just shows None and less than 10. Can you please explain to me why is that? I use panda 1.1.3

[@fadilyassin4597]

thank you for your videos very good explanations , can you please tell us how you show the grid in the Dataframe, your DataFrame looks like excel sheet please, thank you

[@dataschool]

Great question! The formatting depends on your coding environment. I'm using Jupyter.

[@PocketInfinite]

Is it possible to have it display in a nice table in IDLE like how it does in Jupyter? Jinja just won't work for me...

[@dataschool]

I'm not sure, sorry!

[@suhasnalawade344]

Thank you , information helped me

[@saikannan665]

in my idle pandas the spaces between two columns is clumsy how can correct it can you please help me with it

[@PavanKumar-wx6nl]

How do i apply complete back ground color to entire pivot table with customized alignments inside text?

[@dembobademboba6924]

Thank you. Very helpful

[@dataschool]

You're welcome!

[@kleczekr]

Hello Kevin! I am impressed by the quality of the material you provide on your channel. I have a brief question when it comes to the number formatting, which you explained in the video. Would it be difficult to introduce commas in non-standard places, e.g. to indicate Indian lakhs and crores, so that, e.g., to write 1 lakh rupees as 1,00,000; and 1 crore rupees as 1,00,00,000? Thank you for the wonderful series! Rafal

[@dataschool]

Thanks for your kind words! Regarding your question, it's not clear to me whether that is easy or even possible. I'd suggest reading the Python documentation on string formatting to find out: docs.python.org/2/library/string.html#custom-string-formatting

[@kleczekr]

Thank you!

[@shivamkakkar4779]

I want to know how your columns and rows are coming beautifully? As for me there are no lines when I run the CSV file in jupyter notebook

[@dataschool]

Depends on the version of Jupyter notebook

[@fernandomancio2148]

Great stuff! Really helpful! Tks

[@dataschool]

You're welcome!

[@biganubhav]

How do you display the df in this nice table-like style within the jupyter notebook?

[@dataschool]

I think it depends on the version of Jupyter notebook you are using.

[@meghasyam427]

Hi Kevin, for somereason pd.set_option('display.float_format', '{:,}'.format) is not working for me nor throwing an error. The format is not getting applied. Can you help

[@dataschool]

Not sure off-hand, I'm sorry!

[@sachavanweeren9578]

excellent tutorial. Thanks a lot!

[@dataschool]

You're very welcome!

[@MrKingoverall]

THANKS MAN !!!!!!!!!!!!!! Yet again !!!!!!!!!!!!!

[@dataschool]

You're very welcome!

[@faridlgifarikertabudi6508]

can we set float format for ONLY certain column? For example, i want to make float format for 'x' column, but NOT for other column. Please answer this master,. Thank you!

[@dataschool]

I don't think so, but I'm not sure!

[@haifenghong4918]

Thank you, Kevin. I have one question: after pd.set_option('precision', 2)，the precision of numbers in the 'Fare' column is 2, but why the precision of numbers in the 'Age' column is still 1?

[@haifenghong4918]

And what's more, what is the difference between 'display.precision' and 'precision'? It seems that the results are the same in both cases.

[@dataschool]

display.precision and precision are the same, because pandas allows for partial matches in this case.

[@skyvisionworld512]

Hello Kevin, How do you remove comma from a data frame? (meaning doing the reverse of what we did here)

[@dataschool]

You probably need to use a string method. This video may help: kzbin.info/www/bejne/mKDJknZmfsieftE

[@samkitjain7301]

What is the difference between labels and columns in functions like drop( )? Also, when I use X_train = train.drop(columns=['Survived'], inplace=True)) It gives output as None

[@dataschool]

Regarding drop, this video should help: kzbin.info/www/bejne/qpaYe6WJeLxggrs Regarding the None output, that's because of inplace. Hope that helps!

[@Vinay_Gurram]

Can you please let me know - how to save the "output of IDLE" in windows ? - Thanks advance

[@dataschool]

I'm not sure, sorry!

[@Vinay_Gurram]

Data School thanks for such a quick reply

[@mutazkanaan6796]

thank you very much

[@dataschool]

You're welcome!

[@kalpatarunayak5619]

its not work in pycharm....plz help

[@dataschool]

Not sure how to help, sorry!

[@MohamedTarek-td3tn]

I'm using pycharm and it's work fine, make sure the series type is float .

[@csbhaskar]

thanks man

[@dataschool]

You're welcome!

[@curtismoxam5382]

Trick question, nothing is simple about Pandas