Python Requests Tutorial: Request Web Pages, Download Images, POST Data, Read JSON, and More

[@coreyms]

My next video will be a real-world example of a script I wrote to monitor my personal website. We'll use the Request library to monitor the site, and if it is down then we will learn how to send an email and automatically restart the server. I hope everyone finds this useful! Hope you're having a great week!

[@premjilla8820]

can you please make tutorial o scraping twitter data using tweepy?

[@coreyms]

That's on my list of topics to cover, but I have some data science videos I'm trying to put together first. But yes, I definitely will at some point

[@swadhikarc7858]

Awesome idea. Thought that would be a great tutorial to see you teaching how to monitor a website in a candid way

[@tnhoang088]

@@coreyms Need more data science, computer vision or even Javascript videos. Your lecture is so good but do not upload all the series at the same time like the django, flask before. It's so overwhelming. And if you can, I slightly recommend that you should make a series about Javascript, Nodejs or something related to js. I think it's much more applicable than data science or AI ... Just a suggestion ;) Always appreciate your way of teaching

[@sujildevkota]

Can you make a video to run python script in the background and display message and progress bar in the web page using Django

[@NaderTaghinia]

09:57 " I never understand how some of these people are so productive and..." Since, I started watching your channel I have been thinking the exact same thing about you Mr. Schafer. Honestly, I could never understand how you could author so many impeccable videos on programming so fluently. You are giving so much to people like me. Thank you from the bottom of my heart :)

[@coreyms]

Oh wow. Thanks so much, Nader. I really appreciate the kind words :)

[@karimmoradi2003]

The same. I stopped video to write something like this. Corey! I watched many of your videos but I am still in doubt how you can be so humble, knowledgeable, and productive. You are just incredible. Along side of technology, I am learning morality. Thanks

[@AlexBerkk]

That's it! I'm disabling my adblock for your channel!

[@deus5215]

@yeeLix Felt that

[@paulthedanger]

@ً ok hackerr

[@arielgorlik2664]

@ً check out privacy badger

[@wege8409]

What a gentleman

[@rodricbr]

I'm disabling my brave shields for this guy

[@DifficultWorld7]

I have wasted my money on a python course on Udemy I've regretted to this day, and this guy spreading his knowledge for Free, such an awesome guy you are.. THANK YOU!!

[@n9583]

I’ve done that before

[@saurabhchaudhary7342]

I also want to start with Python. Given the fact that it's a four year old series, is it still enough ?

[@ivyunhinged9521]

No matter how much I know or who I start learning from, I always end up back to Corey for some reason. Clear and concise!

[@rahulreddy6541]

You have got passion in your voice which is helping people like me to learn programming in a much fun way. Love you for what you are. love you 3000.

[@timtudosa2519]

You will reach one million subscribers soon Corey. Your videos are so detailed and and easy to follow through. I now understand requests. Thanks for the effort in making these videos!

[@d3ad_shot-vlogsgaming553]

You were correct :)

[@void6670]

he did it

[@pranaybure2651]

Excellent insight on Requests, Corey! Requests library is my goto tool when APIs aren't working as expected. I recently used Requests(Sessions) in a script to mimic browser activities for a web portal as APIs had issues with patch fixes. Understanding browser components with Chrome Dev Tools in conjunction with Requests was really helpful to understand how requests attribute viz. Headers, Form-Data, Query-string params are assembled.

[@misskay007]

Harvard should hire you. I learned so much from watching your videos. Much more through than than CS50 course in web development(although it is a great series). Thank you, your hard work is very much appreciated. I will be donating and sharing.

[@coreyms]

Thanks!

[@cyberguygame9096]

Normally I'm the guy that is getting aggressive because the guy in the tutorial video doesn't tell what I want to know, but THIS -THIS IS DAMN GOOD.

[@archstampton5910]

Probably one of the more valuable KZbin video I have ever seen, as far as I am concerned.

[@muralimohan807]

Corey you are the best trainer or develper for me as when i see your videos ill get both new things and the things in my mind that i wish to ask you but you answer them in your video itself. so you are trainer and develper for me.keep the good work cheers.

[@andonglin8900]

WOW, the 100th video in your MARVELOUS Python tutorial series with my 100th thumbs up. Thank u Corey, you are truly amazing!

[@ramonmonda]

Hello Corey, I'm Brazilian and your video helped me a lot with my project! Thanks for the class! 👊

[@victoraugusto2224]

thanks man, im currently working in a project for a job application, your explanation saved my life

[@sudhirs003]

This is called something left behind when we move ahead...Good work Corey...

[@sevenessie]

Hey Corey, just wanted to tell you what I realized recently. Whenever I'm reading a tutorial or some explanations in python/web dev area, I read it with your voice :D. Thanks for the great work and please don't stop :)

[@alan-j]

Yes, I would say coreyms is the best place to learn python in the whole of youtube network.. Please dont stop this good work.. HATS OFF TO U..

[@sudarsandm]

Your video is a time saver. The information which we need to process from more than one blog or resource is presented elegantly and beautifully to us. Thank you Corey.

[@RajPatelMansuria]

You are awesome, the way you explain stuff with such calmness and speed is just out of the world. Thanks you again for posting great stuff 👏👏👏

[@coreyms]

Thanks!

[@lamis_18]

The best channel, finally ! I have found all basics that I've missed before, and I regret to not find it long time a go, thank u very much.

[@JoshuaDHarvey]

10:06 dude, welcome to the club. Your videos alone make most of us feel the same way so I can only imagine if these people from your perspective are another step up in productive... then I'm completely puzzled! Anyway, thanks for a great video Corey!

[@thengakola6217]

That was one of the few clean videos on the entire internet.........

[@juanbomfim22]

I'm crying inside cause that's exactly what I was looking for

[@Seiseary]

hahahaah

[@Lakshit.]

Damn true bro ... I was exactly looking for same

[@Danksta]

I’ve never related more to a KZbin comment

[@narendrar9940]

Hi Corey, Your videos have become my one source of all the information i need on python, your videos are simple and just great!, thank you very much.

[@sunilchetri3509]

Corey, your name is right up there in the list of people who are so productive and helpful. Your videos are just perfect for someone like me learning the ABCs of Python. Searched and listened to scores of videos but your videos are just perfect! no more no less. Your videos do not overwhelm someone like me. Am loving every bit of them. Just want to let you know that you are awesome!

[@dan-3268]

Ok, Corey... Corey-Corey-Corey.....*ominous silence" You are the Man. Hands down the most well-put and thought through videos on Python I've seen on KZbin. Much appreciated! I thank thee for thy work for tis magnificent

[@coreyms]

Thanks!

[@pratikshinde568]

Sir yours video is much more informative and is in more detail compared to others

[@philmontgomery502]

Excellent delivery Corey... the best!!

[@henriquepigozzo4707]

The timeout param is amazing. Thanks!

[@ihalil95]

I am really looking forward to seeing a video about threading. I hope you will make it as well! Thanks for great tutorials even better than paid courses around in my opinion! I'd rather support your channel instead of paying for less quality courses.

[@robinharris4706]

Great tutorial Corey. Really like your stuff - thank you for covering the material at a brisk pace. Loads of excellent, well presented content without having to listen to slow tedious simplifications. Awesome!

[@rohitd7834]

I was struggling a lot with requests. but now, I'm clear with it. Thanks Corey!! NO words to thank you. :)

[@teklehaimanotaman3150]

whenever I am challenged while working with python, then my mind recalls Corely.

[@iadorepop]

believe me !! i was so waiting for this 💓

[@krishnakuraku6853]

looking forward for more videos like this ..pleas post more videos..you are the best tutor in python

[@robertocardenosa493]

This is a great video. I plan to test its examples within python. The only thing I missed was the Patch command.

[@chaitanyakhambete]

awesome work bro... making simpler stuff more simpler keep it up

[@mrj1997]

Please teach everything ! your videos are fantastic.Thanks Corey

[@adamgdev]

You fucking killed it again! So precises and easy to understand AND had some good random nuggets in there. (HTTP request code meanings and httpbin). You're the man! Keep it up!!!

[@drygordspellweaver8761]

Thank God Corey has a requests tutorial

[@silverzero9524]

i wanted to get info from site but was stuck so wrote some bad code that doesnt help me much but works and now u post this time to modify my code :)

[@ahmadabzakh2343]

Hello Corey,, have been following you for quiet a while now,, really helpful in overall understanding of the subject in hands,, however, this is the first clip where I don't understand what's happening exactly, and obviously it's my problem, so wanted to ask about what prerequisites are needed in order to follow along in the video, again man many thanks for the effort put here,, you are one of a kind

[@ravindersanjay]

this video is worth watching. full of knowledge

[@nickd892]

Lol your the first guy I look for when I need a tutorial. Great video as always!

[@Bergamoism]

Great job on explaining this! Your tutorials are to the point, clear and cover everything we need to know. Every video takes me to the next level.

[@kautilyab]

For anyone who needs the most of the code written in this session : #pip install requests import requests r=requests.get("xkcd.com/353/") print(r) print(dir(r)) print(r.text) #downloading images r=requests.get("imgs.xkcd.com/comics/python.png") print(r.content) #writing a downloaded image to system with open ('comic.png', 'wb') as f: f.write(r.content) print(r.status_code) #200 is success #300 is redirects #400 are client errors .ie. if you don't have access or permission for you #500 are server errors print(r.ok) #Return true for anything less than 400 payload= {'page':2,'count':25} r=requests.get('httpbin.org/get', params=payload) print(r.text) print(r.url) payload= {'username':'corey','password':'testing'} r=requests.post('httpbin.org/post', data=payload) #data is used for payload to be more likely in a form print(r.text) #no args as it is a url parameter #form is uploaded #to know what values the 'form' url expects, we need to look at the source code #of the url #most of the times the output we get will be in json, so we have method we could use print(r.json()) #created a python dictionary from json response #to capture that in a variable r_dict=r.json() print(r_dict['form']) #the authentication done above is form based authentication #there are other types of authentication like basic authentication #'httpbin.org/basic-auth/corey/testing' this a url which basic authentication #and accepts only username= corey and password=testing #in auth, we provide a tuple for input parameters r=requests.get('httpbin.org/basic-auth/corey/testing', auth=("corey","testing")) print(r.text) print(r) r=requests.get('httpbin.org/basic-auth/corey/testing', auth=("coreyms","testing")) print(r.text) print(r) # , so unauthorized response #when checking if website is working or not it is good practice to keep "timeout" #or else it might hand indefinitely, exceptions if api's in website take too much time to load #'httpbin.org/delay/{delay} is used to delay the site by certain time r=requests.get('httpbin.org/delay/6', timeout=3); print(r) r=requests.get('httpbin.org/delay/1', timeout=3) ; print(r)

[@acpucio]

Thanks!!!

[@j.d.3890]

Hey Corey, thanks for this guide. In work sometimes `allow_redirects=False` as request param is helpful as well. Also if your request resulted in several redirects (which is also quite usual), request.history will return all request objects which have happened.

[@elghark]

Do u remember Miller's planet in the Interstellar movie? There, time used to move much slower than on Earth. Well, Corey's videos are the opposite: 20 minutes of contents here are the equivalent of 1 month spent studying hard on a python library ☺️☺️

[@bgable7707]

Concise, clear, explanation and examples. Always hitting the key points with any fluff, thanks!!!

[@asifahussain899]

Corey fam gonna be 1 million.. 💚 Cheers 🥂

[@joeking5211]

Absolutely super, well done, very well paced. Thank you for this, learned a lot.

[@jag831]

10:04 Yeah, I think that same thing every time I open any library. Respect to those guys

[@normoforan1444]

If you send a GET request to Merriam Webster online of "BEAST MODE" you will get back a png of Corey!!! 😂 Super job Corey, your videos are always uber understandable even to a neophyte such as myself!!!

[@Uxrandom996]

Thanks, for such an awesome high quality tutorial 😀 Very clear and quick to the point!

[@falconX5000]

Great work pal!!!!!! Looking forward to your next video.

[@willumdgork]

Outstanding tutorial! Thanks for the coaching and for pointing out the httpbin tool!!!

[@amitbajpai6265]

I been waiting for this long long time ago thank you Corey

[@myselfandpesit]

Thanks for the video. I am a total beginner to APIs. Would be good if you could suggest videos.

[@howiewhite4773]

You explain things the simplist and the best, i still cant get any of this stuff to work.

[@jenmanzella1948]

Your tutorials are FANTASTIC! Thank you

[@MusicGameFinatic999]

You are the man! You very much. Very well explained.

[@axeditingzone513]

thanks alot you saved my day .... i have only mistake in post request thanks alot

[@thatlinuxguy9902]

The best tutorial I've ever seen

[@mouradbarakat123]

This video is just in time for me! Thank You!

[@potatobot2802]

Thank you so much Corey for your time!

[@huy3986]

I really love your videos. Thank you so much and wish you're always happy.

[@arete_]

This was a good video. I am still struggling with using session objects though. Would love an in-depth on that. Happy new year! Stay safe

[@jeffgalef121]

Fantastic video. Thank you for your hard work.

[@olha_]

Great video as usual Corey! Please do more videos on Django and Rest Framework, thanks!

[@hrithicksen3644]

WE NOW WANT TO LEARN SELENIUM!!!!! PLEASE COREYY!!!

[@mmanuel6874]

I would love if you do Java Tutorials. Who's with me?

[@chaks2432]

Awesome, now i don't have to save each page 1 by 1 when downloading comics, just add the link and presto!

[@yolberpabon4973]

Genial Corey, me gusto el video y era lo que buscaba, una explicación rápida y clara de que es requests y ademas lo haces con profesionalidad (+sub)

[@j.n.y790]

FANTASTIC TUTORTIAL! well done

[@serious6037]

jfc, i finally found this... THANK YOU!!!!

[@ddpwe5269]

Gratz on your 1mil subs! Well deserved and surprised more haven't sub'd!

[@lindaduong289]

Best tutorial for requests

[@call-me-poor9313]

This Video is so helpful. I can not thank you enough

[@someonemaking5626]

this guy has videos on everything

[@karthikl4692]

Thanks Corey right video at right time

[@robinhood3841]

Thanks for the video we can now perform Dos attack XD am just kidding its a good method to use keep it up buddy

[@ahmedmani1051]

Hmmm im calling the popo

[@stonecoldcold2941]

Awesome Tutorial!

[@daegudude1048]

Like and thumbs up before watching it!!👍👍

[@mayawanjiru2020]

Yes. Fuck Yes.

[@ananyamahapatra6597]

😍😍😍 hey Corey… u are just the best 🥳

[@mariamhasan3733]

Excellent explanation!

[@Александр-р3э3м]

Thank you so much, Corey! I like your videos a lot!

[@wanderer-1986]

Awesome video! Thanks for posting this. Easy to follow your examples. Thank you

[@parthparadkar1021]

Thank you so much for this video!! Happy to have learnt something new today. Keep 'em coming! :D

[@mailionofficial3736]

Sir, I love your video and the clear voice put into doing the videos. Please let me know if you have any python data structure and algorithm courses I can buy. Thanks

[@eduardovillasmil832]

Excellent video go directly to the point

[@vijaysheri7390]

Awesome stuff, thanks. Can you please do a video on logging for just requests ?

[@alan-j]

@corey This is an awesome video on requests.. If anybody asks me what is the best place to learn python, i will directly point them to your channel. Can you also cover some indepth topics of this "requests" module?

[@andreiolegovich5971]

Thank you for creating this tutorial!

[@waiitwhaat]

Amazing tutorial. Kudos for making it. It was really awesome.

[@doug_silva]

Can I double like this video? It's so awesome!

[@JoeVariousInterest]

Great video. You covered exactly what I needed!

[@tolulopeayemobola1446]

Thank you very much for this video. You gave me some confidence

[@bilalkhan-bb9bo]

Big fan of your work, but please post a Video on REST API with all possible scenarios

[@mr.RAND5584]

Amazing i can request in my webhost-php. So easy to learn comparing to java httpurlconnection.

[@waltershu9199]

Thanks. Save me a lot of time and effort.