Python Pandas Tutorial: Data Analysis & Visualization With Pivot Table in Pandas#14

Hi Guys, In this video I have talked about how you can create pivot tables with visualization in Python. Pivot table is an very essential concept for data analysis, data wrangling and data pre-processing purpose. With pivot table we can easily summarize our data really fast from any dataset.
Most people likely have experience with pivot tables in MS Excel. Python provides also a same flavor using Pandas. Really using pandas pivot table you can look at your data from a different alignment and pivot extensively used in analyzing or summarizing the data.
This video covers as follows in greater details:
Pandas Pivot Table introduction
Why use Pivot Tables?
Pandas Pivot Table function syntax and parameters.
How to pick specific column in Pivot Table?
How to use aggregate function in Pivot Table?
How to apply multiple aggregate function on a single column in Pivot Table?
How to handle null values in Pivot Table?
How to set the total in each row and column using margins parameter?
How to apply filter in Pivot Table?
How to sort the data in Pivot Table?
How to create pivot table on specific portion of the data?
Use query method and its benefit with Pivot Table?
Create "bar" chart using Pivot Table.
Create "line" chart using Pivot Table.
How to plot sales month wise (extract month name from date column) and visualize it?
*More!!!
Raw Data Set: github.com/Abh...
Last Tutorial: • Python Pandas Tutorial...
Always looking for your valuable suggestion on what kind of videos you want in future, leave me a comment with your suggestion. Keep watching!!!
Python Teaser: • A Beautiful Python Pro...
Python Pandas Tutorial: • Python Pandas Tutorial...
Python Playlist: • Python Tutorial for Be...
Python Data Structure Playlist: • Python Data Structure
Python OOPs Playlist: • Object Oriented Progra...
Python Excel Automation: • Excel Automation Using...

[@vitorribeirosa]

Thank you very much for sharing this content!!! Cheers :)

[@dss1871]

Amazing 👍👍

[@mosama22]

Thank you thank you thank you 😊😊😊😊

[@aleksandarpetrovic2632]

Amazing tutorial

[@franciscodiaz8857]

Thanks, excellent explanation

[@TheNinesku]

Спасибо, Абхишек! 🌞🌞🌞

[@kukki619]

Thanks for very informative video

[@zhuzhujin9481]

this video is amazing

[@pramishprakash]

Thanks alot sir

[@ranjithraghunathan1267]

Super

[@shivamgaur2246]

How to show count of na data using panda pivot just like excel pivot

[@automatewithamit]

Thanks for your Video ! Can you please let me know if we can put those collapse and expand functionality in actually generated pivot table in excel using python ??

[@ProgrammingIsFunn]

You can watch video if possible: Excel Pivot Table and Aggregations using OpenPxl and Pandas-Part-5 kzbin.info/www/bejne/eYq0oZufjpanec0 Or in order to achieve the same feature just like ms excel then we can use xlwings

[@saurabhkunal3624]

how to put month in correct order . I see its alphabetical order of months i need to show correct order of months

[@MrFishingo]

great video! one question... when I sort_values, my "ALL" row gets in the middle of the table as there are values greater and lower than the total (all).... how can I sort values but the code needs to understand that "ALL" is the total and should go in the bottom of the df. THANKS!!!!

[@ProgrammingIsFunn]

Thanks Ricardo. See, by default ALL row will be at bottom of the DF. For your case, might your data in object/string format that why you are getting ALL row in mid or wrong place. Try to run your code on the same data which I have used in the video.

[@akileshreddy2150]

How can you add multiple filter? Like in the video we gave region as east and I want to give one more filter like date as 11/08/2016. Basically I wanted to know how do we give multiple filter?

[@ProgrammingIsFunn]

Hi Akilesh, Thanks for your comment. We can add as many filter as you want on a single DataFrame. I am sharing a one video where you can learn many different ways to apply the filter on multiple columns with multiple conditions. kzbin.info/www/bejne/oGW3Z4KtntKZfLs In case do you have any question on it please post your comment.

[@akileshreddy2150]

@@ProgrammingIsFunn Thank you so much!!

[@tawandamukarati4051]

Thank you for the video. Is it possible to plot the same data using Plotly?

[@ProgrammingIsFunn]

Yes we can, plotly is one of the power full package for interactive data visualisation. And sharing a video where I have used plotly throughly. kzbin.info/www/bejne/baqkqGSkhcalm68

[@Al-Ahdal]

How to format numbers i.e. values in the pivot table? and rounding options. How to sort months by month number in plotting graph, as in the video they aren't in the correct order? How to show the values in millions, thousands in pivot table?

[@cheonglily3992]

i like to know can we store the pivot table and the data into spreadsheet and keep.

[@prathyusharobbi947]

Can we create a pivot table in excel itself without using pandas using python?

[@ProgrammingIsFunn]

Yes we can using python library xlwings or win32.

[@prathyusharobbi947]

@@ProgrammingIsFunn Is there any reference for the same?

[@Al-Ahdal]

Hi, how to format numbers i.e. values in the pivot table?

[@praveenkumar-ub4ni]

How do I do the show details (the option which gives details of that value in a new spreadsheet) in python?

[@K-mk6pc]

Hi i am doing the same for the data frame having 26L rows and 115 variables. It is taking huge time to compute. Any ideas ?

[@igorrettally9577]

Excellent video, very detailed and clear, I just have one question, how can I order the months in the chart in chronological order instead of alphabetical?

[@ProgrammingIsFunn]

Using matplotlib we can plot the chart in month's order. But in pivot table by default index will be sort in ascending or alphabetical order.

[@arpeshmistry6550]

Hello bro !! Can we create the links in the pivot table in pandas while exporting the data to the excel sheet

[@vimalchawla6740]

How can I get an index of all your Videos on Pandas, like 1, 2, 3, 4, etc.

[@ProgrammingIsFunn]

Python Pandas - Data Science and Automation kzbin.info/aero/PLWuFHho1zKhUJpe9WfSyvrrQrzqDErbmv

[@BlueSkyGoldSun]

What is the name of the dataset in kaggle ? Or is it created by you personally?

[@shashi_kamal_chakraborty]

Hello Sir, I tried to use the data set, by the github link you have provided. But, I think there's something wrong with it. When I tried to read it, the raw link, I got this error... "UnicodeDecodeError: 'utf-8' codec can't decode byte 0xf6 in position 42492: invalid start byte". Please, help me with your kind suggestions about how to get rid of this.

[@Tommy7417]

Guys Guys Guys Guys Guys GuysGuys Guys, need more and more GuysGuysGuysGuysGuysGuysGuysGuysGuysGuysGuys

[@ProgrammingIsFunn]

Yes 🙌

[@JssRider]

Thank you for the video. New learner and new subscriber for you. In minute 3.20 -> kzbin.info/www/bejne/pZeonqCAebB4jpI How would you do to see "Consumer" in all rows and not only in the first one? Like excel "Repeat all labels" Thank you in advanced.

[@ProgrammingIsFunn]

Hi, Thanks for your comment. You can reset the index of Pivot table, for you information Pivot Table is also just like a DataFrame. So you can reset the index for repeating the 'Consumer', follow the below line. pd.pivot_table(sample, index = ['Segment','State']).reset_index()

[@JssRider]

@@ProgrammingIsFunn Thank you for responding. I'm afraid I've failed to do it, this is my code for the pivot table in case you can help. Anyway it's no big deal, I can do it after exporting the file in excel. pivot=pd.pivot_table(df,index=["COMPTE","DEVISE D'ORIGINE"],columns= "TYPE EVENEMENT",values='FINAL MONTANT',aggfunc= ["sum"],margins=True,margins_name="Total") pivot.fillna(0,inplace=True) Thank you again, I'll keep watching your videos, I need to learn a lot haha.