One of my favorite things to do with pandas is normalize data, it so happens that your data was already normalized. However, in pandas it's so easy to take a spreadsheet of arbitrary values and call (stats =pandas.DataFrame.describe( )) then stats.transpose( ) and then take the original frame and simply say (normalized = ((pandas.DataFrame - stats['mean']) / stats['std'])) I believe this is one of the hottest quick tips. I'm sorry if you've already covered this, but this is your first video I've ever seen.
@christoph2310904 жыл бұрын
more of that please - especially pandas methods 👍
@christineeubanks55654 жыл бұрын
Derrick you make learning python easy!
@rynrbe30662 жыл бұрын
Thank you for making the transition from Excel to Python a little more easier for us all! 🙂
@skyblue0214 жыл бұрын
Great and very useful video, thank you Derrick, there are a lot of people appreciating your work!
@robertpearson21434 жыл бұрын
You could talk about handling utf-8 characters. The problem can be when you pull a CSV into excel and it converts to the Microsoft character set. When you pull that up in pandas it can sometimes be a mess. Fix can be to load with encoding=’utf-8’. Thanks for the great videos.
@faheemshaikh10554 жыл бұрын
Your Voice is so perfect for YT. I'm sure you'll grow big...
@SaraAce7373 жыл бұрын
Thank you for this, I am an accountant learning python. The course I am taking on Linkedin is great but i didn't know how it would be applied in the context of what i work with (spreadsheets). Going thru this video really helped the light bulb come on in my brain and helped python make more sense.
@saadsalique6760 Жыл бұрын
Thank you sm for going through it really helped me becuase I have a prog assesment that is 30% due in 3 days and had no idea on what to do.'
@nicombor4 жыл бұрын
Awesome easy to follow tutorial. Thank you!
@gee_rex4 жыл бұрын
Derrick your videos are cool, right to the point and clear
@devasenathipathi85924 жыл бұрын
Hello Derrick Thank you for making useful videos on Python, Expecting more from you. Could you group all your videos in order to go through one after the another in sequence. Once again Kudos for your work.
@nghiepcrypto70344 жыл бұрын
very useful. Thanks from Viet Nam
@loveyoutube224 жыл бұрын
Thank you Derrick. U make Python so easy for us👋👋👋🙏😃
@FabioJulioRoque4 жыл бұрын
Excelent methods! Good explanation....I learn to much with you.
@roger_rogers3 жыл бұрын
this is more data prep. would love to see random forest, regression, etc.
@nishantpurohit1002 жыл бұрын
Hey nice video..looking forward to more>>>THANKSS
@blackeagle3587 Жыл бұрын
Why is it I cannot open the excel file in visual studio code? Even though I already finished installing pandas in library
@TexasStar0074 жыл бұрын
Thanks Derrick! Your teaching method is great but could you please slowdown a little bit and also explain why you are doing this?
@JP-jn2yx2 жыл бұрын
My new profile4 output file copied over the row# from the old df into ColA, but unlike yours starting at 0, mine started at 110333. I added a condition to the to_excel command (, index = False) and that got rid of the row numbers as a column, and still retained 0 indexing on the new DataFrame.
@luqmanhakim77814 жыл бұрын
Love it very useful ! Looking forward for more content like this :)
@anthonyrojas9989 Жыл бұрын
Hey Derrick great content. Do you have anything discussing web scraping for analysis type of videos?
@hempen14 жыл бұрын
I have been struggling with aggregating demand history by month. Parts A, B, C demanded on multiple different days in a month for different quantities month over month. I would like to know how to show month, part, quantity. Can you help?
@CodeWithDerrick4 жыл бұрын
Sure! What’s your date format look like? One column for the month and another for the day? Or just a column with something like 12/16/19 ? I would probably handle this with a groupby method if you only need the aggregated sums of the demands
@hempen14 жыл бұрын
Derrick Sherrill. Great. One column of dates 12/15/2019. I have been trying to use a groupby, but no luck. Thank you
@will2see2 жыл бұрын
When exporting to excel I get this error: ModuleNotFoundError: No module named 'xlwt'
@shelleyterhune64 жыл бұрын
Excellent! Thank you!
@yuangchengyuancheng44604 жыл бұрын
Pretty enjoy watching your awesome video...Inspire me a lot...Cheers mate.
@sujayguru1232 жыл бұрын
Also could you suggest how to do conditional formatting with different colours
@sujayguru1232 жыл бұрын
Good idea... I will work on it... This is Dann
@mattjkelly2014 жыл бұрын
I'm trying to do this in vscode on a chromebook, but am unable to work out the file path structure. Any ideas?
@karakol863 жыл бұрын
.nunique() and .unique() are my favs for data analysis
@nasirsayyed95892 жыл бұрын
How is it better than pivot function in that also we can do right??
@neginebrahimi61754 жыл бұрын
I have group af data files that I most organize them in an exel file.every excel file most be about a same row ib every file and datas that are related to especial row. Could you help or let me know which videos are more useful for me?
@knockn9ck3 жыл бұрын
You should make a scpecific video about how to install pandas and nunpy on python, specially on Windows. I tried to look for it on how to on the internet and YT but it wasnt nearly as clear or easy as you showed in this very video. Im sure if you go a little into detail it will be great!
@ashishkharangate1110 Жыл бұрын
How to find the rows that satisfy certain conditions in the column data
@ashishkharangate1110 Жыл бұрын
How to display rows that satisfy conditions as per data in columns
@linhdao80413 жыл бұрын
Hi Derrick, i found your video very useful but i have a problem that prevented me from working with pandas. For me i used Visual studio Code as text editor, when i execute the code, the terminal always shows : 'pandas' has no attribute 'read_csv' (most likely due to a circular import). How can i fix this problem even though i installed pandas? Thank you so much
@arjunjoshy78293 жыл бұрын
Derrick very informative video, if I actually want to analyse data from one excel with particular conditions and update to a count column in another excel what shoudl I do?
@remilang96834 жыл бұрын
hello, i got problem, at first, im starting to learn python , and i stuck on one stupid problem, i have data sheet with example, date,time, name,phone,email, and i will merge date and time to one column, any useful tips ? i think i googled all i can, butstill no luck, i tried, merge them in openoffice, but it just make one line at a time , my sheep is over 65000 lines... and as it does, it merge the datata one behid other not on separate line as i expect... but i like to have it in script cuz then i can automate outpu from sheet and analyze the data, but im stuck, please help me thank you
@harrykaranikas77414 жыл бұрын
Nice video!! but this all can be done easily in Excel also.Can you make a video that really showcase the power of python (pandas). Thank you
@lancetschirhart76764 жыл бұрын
Check out his back catalogue. He's done some pretty good work there already :) kzbin.info/www/bejne/mqXYfIaPpcmWfMU
@shahzan5254 жыл бұрын
Nice.........👍👍
@manoharvirgo3 жыл бұрын
Gr8 videos Print('Thank you very much !!')
@subzeroLV4 жыл бұрын
I'm really enjoying your videos, and am learning a lot! Have you done a tutorial on cleansing data of certain characters? Like if I had a spreadsheet with 8 columns, and 1000+ rows, and wanted to scan and remove all special characters like $%^&#, etc... and then write everything back to a new spreadsheet. Any advice on the best way to handle that?
@lancetschirhart76764 жыл бұрын
learn regex (import re) It looks hard, but it really isn't*. Just a little bit of memorization. This is all you need: www.w3schools.com/python/python_regex.asp *provided you have some python basics down, like variable assignment and function calls.
@CodeWithDerrick4 жыл бұрын
Hey Tod, thanks for the kind words! For sure, Lance's solution of using regular expressions is how I'd do this too. This is a great idea for a video, I'll put up a video walk through today on a solution that will (hopefully) work.
@cinnabar5464 жыл бұрын
Hello for newbies like me, you need to install the openpyxl library to extract the excel file.
@bishaladhikari38063 жыл бұрын
how do you analyze relationship between multiple columns using python?
@robertcliffort23542 жыл бұрын
great.
@bertataixes13204 жыл бұрын
Is it possible to import an Excel column by its number? I'm working on reading differents columns (from about 300) inside a loop but I only find the way to select a column by its name, not by its number!
@CodingIsFun4 жыл бұрын
You could use iloc for this, example. Column B would be: df.iloc[:, 1] Note, that indexing starts at 0 by default. Hence, column A would be df.iloc[:, 0]
@jitendramakwana27193 жыл бұрын
@derrick 👍
@chandramouliful4 жыл бұрын
Nice Video. Could you please make a video on how to format the columns and rows in an excel file using Python. Example: applying borders, changing cell interior color, font and etc.
@aryanjaiswal18864 жыл бұрын
Which is the best free text editor we can use for Windows?
@kartikgupchup33244 жыл бұрын
Hello Derrick ! Great stuff. Just a small query - Why was the complete file path not assigned to the variable excel_file_path but just the file name ?
@CodingIsFun4 жыл бұрын
As the excel file was in the same directory as the python script. If your excel file is not in the same directory, you would need to specify the exact path.
@azizelkali38423 жыл бұрын
Thank you for this great job. My question is : how can i obtint output.xlsx with more d'an one condition.
@moali18364 жыл бұрын
Hi, great video, How would you filter more than 1 id, e.g 4 and 5 and 6
@ameykadam32724 жыл бұрын
Thank you very much brother. Love from India ❤️ ❤️❤️
@wetFIREEE4 жыл бұрын
Very good 👍
@SanjeevKumar-pj9mh4 жыл бұрын
Hi, i have a doubt that all the above operations we can perform it in excel...then why to use python to do this operations.
@expat20104 жыл бұрын
For me, Pandas is far, far more intuitive and just overall easier to write, troubleshoot, and test code than Excel macros. Also, this example is pushing the maximum limit of rows with Excel. I seriously doubt Excel could handle it without crashing.
@pponcho82453 жыл бұрын
I know this is a dumb question, but what are the advantages of analyzing a spreadsheet in python? I mean, why of the same can be done within excel? I'm sure there are advantages but I would like to know why they are
@MrMenace3210 Жыл бұрын
Because once you are 'fluent' with a coding language you don't have to do all the moving copying and pasting like you would in excel. You can just type and run code. Of course when you're a beginner it's very hard to see the point
@Ivan-zz9hd4 жыл бұрын
Hi Derrick, enjoy your videos a lot. Can you tell me three main things that Python can do where Excel can not (assuming advanced excel user)
@CodeWithDerrick4 жыл бұрын
Hey Ivan Yu, sorry for the delay in getting back to you. I get this question a lot. Excel is definitely more powerful than python when it comes to spreadsheet manipulation tasks. So there's nothing that python can do spreadsheet wise that excel cannot. The reason to use python for these tasks is integrating spreadsheets with other stuff. Python's sometimes called a 'glue' because connectivity is so easy. If you ever wanted to do more than just spreadsheet analysis (connecting to websites, machine learning on your data, automation, API calls, etc) Python gives us the ability to do it all, so for people deciding between VBA or Python, I always encourage python. It just opens up so many doors in the future, and can usually handle all the excel work too.
@dipeshshrestha20864 жыл бұрын
hello brother i have a column name Total Traded Quantity which has values like 1.01M, 1.11k,.... 1) what does this M & K mens in this data set? 2) And how can i make this column simple float
@CodeWithDerrick4 жыл бұрын
My guess is that the M means multiplied by one million & the k means multiplied by one thousand. So in your example (1.01M = 1,010,000 & 1.11k = 1,110) To change these to floats, you could probably do it in one operation, but what would make more sense to me, is to split the numbers and letters into two different columns using the .split() method, then conditionally multiple them depending on the value in the letter column. Might be slow for a larger data set, but that's the first thing that comes to mind.
@yulisseptarangga38194 жыл бұрын
hello sir pandas can make the value in 1 excel column be like this [2,1,3,1], thank you
@reiswanb4 жыл бұрын
Dude i am getting error occurred , whatever your code written , i am using windows7 , tried so much yah