Easy Spreadsheet Data Analysis Methods - Python Pandas Tutorial

[@gurupartapkhalsa6565]

One of my favorite things to do with pandas is normalize data, it so happens that your data was already normalized. However, in pandas it's so easy to take a spreadsheet of arbitrary values and call (stats =pandas.DataFrame.describe( )) then stats.transpose( ) and then take the original frame and simply say (normalized = ((pandas.DataFrame - stats['mean']) / stats['std'])) I believe this is one of the hottest quick tips. I'm sorry if you've already covered this, but this is your first video I've ever seen.

[@christoph231090]

more of that please - especially pandas methods 👍

[@christineeubanks5565]

Derrick you make learning python easy!

[@rynrbe3066]

Thank you for making the transition from Excel to Python a little more easier for us all! 🙂

[@skyblue021]

Great and very useful video, thank you Derrick, there are a lot of people appreciating your work!

[@robertpearson2143]

You could talk about handling utf-8 characters. The problem can be when you pull a CSV into excel and it converts to the Microsoft character set. When you pull that up in pandas it can sometimes be a mess. Fix can be to load with encoding=’utf-8’. Thanks for the great videos.

[@faheemshaikh1055]

Your Voice is so perfect for YT. I'm sure you'll grow big...

[@SaraAce737]

Thank you for this, I am an accountant learning python. The course I am taking on Linkedin is great but i didn't know how it would be applied in the context of what i work with (spreadsheets). Going thru this video really helped the light bulb come on in my brain and helped python make more sense.

[@saadsalique6760]

Thank you sm for going through it really helped me becuase I have a prog assesment that is 30% due in 3 days and had no idea on what to do.'

[@nicombor]

Awesome easy to follow tutorial. Thank you!

[@gee_rex]

Derrick your videos are cool, right to the point and clear

[@devasenathipathi8592]

Hello Derrick Thank you for making useful videos on Python, Expecting more from you. Could you group all your videos in order to go through one after the another in sequence. Once again Kudos for your work.

[@nghiepcrypto7034]

very useful. Thanks from Viet Nam

[@loveyoutube22]

Thank you Derrick. U make Python so easy for us👋👋👋🙏😃

[@FabioJulioRoque]

Excelent methods! Good explanation....I learn to much with you.

[@roger_rogers]

this is more data prep. would love to see random forest, regression, etc.

[@nishantpurohit100]

Hey nice video..looking forward to more>>>THANKSS

[@blackeagle3587]

Why is it I cannot open the excel file in visual studio code? Even though I already finished installing pandas in library

[@TexasStar007]

Thanks Derrick! Your teaching method is great but could you please slowdown a little bit and also explain why you are doing this?

[@JP-jn2yx]

My new profile4 output file copied over the row# from the old df into ColA, but unlike yours starting at 0, mine started at 110333. I added a condition to the to_excel command (, index = False) and that got rid of the row numbers as a column, and still retained 0 indexing on the new DataFrame.

[@luqmanhakim7781]

Love it very useful ! Looking forward for more content like this :)

[@anthonyrojas9989]

Hey Derrick great content. Do you have anything discussing web scraping for analysis type of videos?

[@hempen1]

I have been struggling with aggregating demand history by month. Parts A, B, C demanded on multiple different days in a month for different quantities month over month. I would like to know how to show month, part, quantity. Can you help?

[@CodeWithDerrick]

Sure! What’s your date format look like? One column for the month and another for the day? Or just a column with something like 12/16/19 ? I would probably handle this with a groupby method if you only need the aggregated sums of the demands

[@hempen1]

Derrick Sherrill. Great. One column of dates 12/15/2019. I have been trying to use a groupby, but no luck. Thank you

[@will2see]

When exporting to excel I get this error: ModuleNotFoundError: No module named 'xlwt'

[@shelleyterhune6]

Excellent! Thank you!

[@yuangchengyuancheng4460]

Pretty enjoy watching your awesome video...Inspire me a lot...Cheers mate.

[@sujayguru123]

Also could you suggest how to do conditional formatting with different colours

[@sujayguru123]

Good idea... I will work on it... This is Dann

[@mattjkelly201]

I'm trying to do this in vscode on a chromebook, but am unable to work out the file path structure. Any ideas?

[@karakol86]

.nunique() and .unique() are my favs for data analysis

[@nasirsayyed9589]

How is it better than pivot function in that also we can do right??

[@neginebrahimi6175]

I have group af data files that I most organize them in an exel file.every excel file most be about a same row ib every file and datas that are related to especial row. Could you help or let me know which videos are more useful for me?

[@knockn9ck]

You should make a scpecific video about how to install pandas and nunpy on python, specially on Windows. I tried to look for it on how to on the internet and YT but it wasnt nearly as clear or easy as you showed in this very video. Im sure if you go a little into detail it will be great!

[@ashishkharangate1110]

How to find the rows that satisfy certain conditions in the column data

[@ashishkharangate1110]

How to display rows that satisfy conditions as per data in columns

[@linhdao8041]

Hi Derrick, i found your video very useful but i have a problem that prevented me from working with pandas. For me i used Visual studio Code as text editor, when i execute the code, the terminal always shows : 'pandas' has no attribute 'read_csv' (most likely due to a circular import). How can i fix this problem even though i installed pandas? Thank you so much

[@arjunjoshy7829]

Derrick very informative video, if I actually want to analyse data from one excel with particular conditions and update to a count column in another excel what shoudl I do?

[@remilang9683]

hello, i got problem, at first, im starting to learn python , and i stuck on one stupid problem, i have data sheet with example, date,time, name,phone,email, and i will merge date and time to one column, any useful tips ? i think i googled all i can, butstill no luck, i tried, merge them in openoffice, but it just make one line at a time , my sheep is over 65000 lines... and as it does, it merge the datata one behid other not on separate line as i expect... but i like to have it in script cuz then i can automate outpu from sheet and analyze the data, but im stuck, please help me thank you

[@harrykaranikas7741]

Nice video!! but this all can be done easily in Excel also.Can you make a video that really showcase the power of python (pandas). Thank you

[@lancetschirhart7676]

Check out his back catalogue. He's done some pretty good work there already :) kzbin.info/www/bejne/mqXYfIaPpcmWfMU

[@shahzan525]

Nice.........👍👍

[@manoharvirgo]

Gr8 videos Print('Thank you very much !!')

[@subzeroLV]

I'm really enjoying your videos, and am learning a lot! Have you done a tutorial on cleansing data of certain characters? Like if I had a spreadsheet with 8 columns, and 1000+ rows, and wanted to scan and remove all special characters like $%^&#, etc... and then write everything back to a new spreadsheet. Any advice on the best way to handle that?

[@lancetschirhart7676]

learn regex (import re) It looks hard, but it really isn't*. Just a little bit of memorization. This is all you need: www.w3schools.com/python/python_regex.asp *provided you have some python basics down, like variable assignment and function calls.

[@CodeWithDerrick]

Hey Tod, thanks for the kind words! For sure, Lance's solution of using regular expressions is how I'd do this too. This is a great idea for a video, I'll put up a video walk through today on a solution that will (hopefully) work.

[@cinnabar546]

Hello for newbies like me, you need to install the openpyxl library to extract the excel file.

[@bishaladhikari3806]

how do you analyze relationship between multiple columns using python?

[@robertcliffort2354]

great.

[@bertataixes1320]

Is it possible to import an Excel column by its number? I'm working on reading differents columns (from about 300) inside a loop but I only find the way to select a column by its name, not by its number!

[@CodingIsFun]

You could use iloc for this, example. Column B would be: df.iloc[:, 1] Note, that indexing starts at 0 by default. Hence, column A would be df.iloc[:, 0]

[@jitendramakwana2719]

@derrick 👍

[@chandramouliful]

Nice Video. Could you please make a video on how to format the columns and rows in an excel file using Python. Example: applying borders, changing cell interior color, font and etc.

[@aryanjaiswal1886]

Which is the best free text editor we can use for Windows?

[@kartikgupchup3324]

Hello Derrick ! Great stuff. Just a small query - Why was the complete file path not assigned to the variable excel_file_path but just the file name ?

[@CodingIsFun]

As the excel file was in the same directory as the python script. If your excel file is not in the same directory, you would need to specify the exact path.

[@azizelkali3842]

Thank you for this great job. My question is : how can i obtint output.xlsx with more d'an one condition.

[@moali1836]

Hi, great video, How would you filter more than 1 id, e.g 4 and 5 and 6

[@ameykadam3272]

Thank you very much brother. Love from India ❤️ ❤️❤️

[@wetFIREEE]

Very good 👍

[@SanjeevKumar-pj9mh]

Hi, i have a doubt that all the above operations we can perform it in excel...then why to use python to do this operations.

[@expat2010]

For me, Pandas is far, far more intuitive and just overall easier to write, troubleshoot, and test code than Excel macros. Also, this example is pushing the maximum limit of rows with Excel. I seriously doubt Excel could handle it without crashing.

[@pponcho8245]

I know this is a dumb question, but what are the advantages of analyzing a spreadsheet in python? I mean, why of the same can be done within excel? I'm sure there are advantages but I would like to know why they are

[@MrMenace3210]

Because once you are 'fluent' with a coding language you don't have to do all the moving copying and pasting like you would in excel. You can just type and run code. Of course when you're a beginner it's very hard to see the point

[@Ivan-zz9hd]

Hi Derrick, enjoy your videos a lot. Can you tell me three main things that Python can do where Excel can not (assuming advanced excel user)

[@CodeWithDerrick]

Hey Ivan Yu, sorry for the delay in getting back to you. I get this question a lot. Excel is definitely more powerful than python when it comes to spreadsheet manipulation tasks. So there's nothing that python can do spreadsheet wise that excel cannot. The reason to use python for these tasks is integrating spreadsheets with other stuff. Python's sometimes called a 'glue' because connectivity is so easy. If you ever wanted to do more than just spreadsheet analysis (connecting to websites, machine learning on your data, automation, API calls, etc) Python gives us the ability to do it all, so for people deciding between VBA or Python, I always encourage python. It just opens up so many doors in the future, and can usually handle all the excel work too.

[@dipeshshrestha2086]

hello brother i have a column name Total Traded Quantity which has values like 1.01M, 1.11k,.... 1) what does this M & K mens in this data set? 2) And how can i make this column simple float

[@CodeWithDerrick]

My guess is that the M means multiplied by one million & the k means multiplied by one thousand. So in your example (1.01M = 1,010,000 & 1.11k = 1,110) To change these to floats, you could probably do it in one operation, but what would make more sense to me, is to split the numbers and letters into two different columns using the .split() method, then conditionally multiple them depending on the value in the letter column. Might be slow for a larger data set, but that's the first thing that comes to mind.

[@yulisseptarangga3819]

hello sir pandas can make the value in 1 excel column be like this [2,1,3,1], thank you

[@reiswanb]

Dude i am getting error occurred , whatever your code written , i am using windows7 , tried so much yah

[@yunkel]

👍

[@kapamagicman]

Good video. FYI you look like a young Tom Brady

[@hephaistion3]

You are just so cute!

[@sujayguru123]

Where are you today?????