Python Automation: Downloading 95 Excel Files in Seconds

When it comes to Data Analytics and Data Science, not all data is created equal, and we would love everything to be well structured and available in a nice clean database or API. Sometimes we have to deal with lots of Excel data.
Off to a great start with building a simple Python flow that sources 95 Excel files automatically.
As promised here is the location of the 95 Excel files for you to follow along at home at practice: data.gov.au/da...

[@harrylane5390]

Glad to see you are back, can't wait for part 2!!

[@MakeDataUseful]

Thanks Harry!

[@danielaguilar9011]

I cannot express my gratitude. I had to download over 800 Excel files and process them. I knew how to process them once I had downloaded them, but I had zero experience with webscraping. You quite literally saved me a few days of work.

[@MakeDataUseful]

Fantastic to hear! Woohoo!! 🎉

[@Martin.Eriksson]

Love to see you back

[@MakeDataUseful]

Great to me back Martin!

[@dannyrock7261]

Love how you are still using Jupyter for doing amazing stuff

[@MakeDataUseful]

Thanks Danny! It’s been good to me over the years. Bigger projects and apps I use VSCODE but you really can’t go past a notebook for a tutorial!

[@muhammadawon8164]

Welcome, it's always nice to see you back on the channel. It's been a while so let's start learning again and I really hope this time we are not going anywhere :) Btw while looking for a solution for myself today, I found one of your videos on the recommendation, and the next second I realized that you have a new video uploaded on the channel. This is another proof that your knowledge is valuable and we are missing out so much for not having you here :) Once in a while, I always come back to this channel to see if there is any activity happening :) All the best!!

[@MakeDataUseful]

Thanks Muhammad! So happy to be back! I’m really excited to build out more end to end analysis series with lots of tips… and errors 😃 along the way. I’m working through an upload schedule so we don’t have any more big breaks! I really appreciate the support and kind words.

[@muhammadawon8164]

@@MakeDataUseful Awesome, please upload your analysis video soon, I have one week to complete this project and I am counting on you 😃. I'll look after the machine learning part but I need proper analysis skills and luckily you are back. Everything is happening coincidentally, it must be a dream 😂. Jokes aside, your teaching style deserves a noble price.

[@marcovirtual]

I have been watching all your videos lately. Jupyter is a great choice for these tutorials. You inspired me to download it and now that I'm using it I have much more understanding of what my variables actually contain when I scrape some data. Now i can find out very rapidly if something is going wrong. Thank you!

[@MakeDataUseful]

Thank you! Version 7 has recently been released out of beta and it’s got some pretty neat features. I was thinking about doing a short video about it.!

[@JohnBrute]

Good to see you back! Looking forward to more content

[@MakeDataUseful]

Thanks John! Glad to be back

[@nevinurey2997]

Oh it makes me happy to see you back doing your thing. Appreciate you sharing your skills :)

[@crisitianwelt]

Thank you very much!! It's incredibly useful for my daily tasks! I hope you come back soon.😊

[@bch854]

I hate to say I like videos like this… I remember when I was young and all I wanted to do was play out, or when I was slightly older, I just wanted to go out for a drink with mates. I think back to times like that and I’d have thought this stuff was major boring shit! As it happens, I really really appreciated this video, I know tax stuff is still major boring shit, but the way you navigated this was… (ahem).. a genuine expression of skill, so, err well done there…. Or something. Seriously, good job dude, I appreciate your effort.

[@oasiswaters3287]

Great videos! I just started python about a month ago and your videos explain semi-complex topics in a very understandable way. Already created a yellow pages scraper with the help of your explanations You're a natural teacher man, I appreciate you!

[@djb6515]

Thanks for this great video. As you are a big fan of the requests library , maybe you should use requests-html instead of selenium. Requests-html and requests are developed by the same programmer

[@moneyraymondottv]

Awesome content bro, really been enjoying it

[@MakeDataUseful]

Great to hear, lots more tutorials and fun projects to come!!

[@calvindoswell9254]

Your videos are great, super easy to follow, and you explain the concepts so well. Thank you!

[@MakeDataUseful]

Thanks for the great feedback Calvin!

[@JeffreyFlaker]

string has a .endswith. May be useful

[@MakeDataUseful]

Great call! That's why I love this community :D

[@JeffreyFlaker]

@@MakeDataUseful Since you saw there there other file types, split on the . within the name could also reveal what data is present and may be useful while investigating what you want to download

[@MakeDataUseful]

@@JeffreyFlaker I was thinking that after I did it. This could be a good approach to going fully automated. Identify each file type and treat accordingly.

[@velvetcasuat]

Hello ! Where were you man ? Long time since your last vid :D

[@MakeDataUseful]

Hey Velvet, too long! I have been super busy with client work but excited to make more time for sharing videos!

[@Lofeupsidedown]

Can you please make a tutorial on how to download data from a local sales data software by setting the time period from the software? It'd be very very helpful. TIA!

[@JustRollin]

The algorithm favors weekly uploads. You should try it even if content is light.

[@MakeDataUseful]

Thanks Jim, got some content in the works. Weekly is the goal

[@saicharan5846]

How to resolve key error href

[@youtea7324]

Kindly upload new learning content probably on machine learning and deep learning end to end real life projects. it is very sad to find out last video uploaded 7 months ago. I hope every thing is fine.

[@MakeDataUseful]

Thank you for the kind words, new videos in the works

[@harissaleem8791]

POST_SOMETHING_IT'S_BEEN_4_WEEKS...... !!!!!

[@MakeDataUseful]

This is the motivation I needed!! 🙏 Thank you

[@bokkenka]

Just as there is a startswith() method for strings, there is an endswith() method, so you don't need to do link[-5:] == ".xlsx'.

[@MakeDataUseful]

I love that, there is just so many methods built in! Good pick up 😎🤟

[@XxxionxX]

I want more how to make money with python episodes please. I subbed but there aren't many videos :(