Making multiple HTTP requests using Python (synchronous, multiprocessing, multithreading, asyncio)

[@IndianPythonista]

Code: github.com/nikhilkumarsingh/async-http-requests-tut Multiprocessing in Python: kzbin.info/www/bejne/gKaXqZ6se9JjbdE Multithreading in Python: kzbin.info/www/bejne/kIGwaYd5r5qWmpo Concurrent Programming in Python (asyncio): kzbin.info/www/bejne/r2mYeGp9gb6bj6M

[@ibrahimaba8966]

.. can we use multiprocessing and multithreading at the same time ? I mean having n processes and m thread per process.

[@savantofillusions]

Your snake art got me to stay

[@praisedavid1653]

This is the most informative video I have seen on these features/modules. Kudos

[@zameerahmed1775]

Ur too good .............. youthful & motivating voice. Above all ur python concepts are up to the mark.

[@Millez]

0:59 Synchronous 4:23 Multiprocessing 7:43 Multithreading 15:23 AsyncIO

[@learnerb3403]

Incredible video sir with clarity in presentation and in depth knowledge. Thanks for sharing your knowledge. Looking forward for more such real time example videos.

[@shokhrukhabduahadov3985]

would be better if u put bookmarks to the video parts

[@sudhakarpandey693]

If someone explaining so nicely then plz don't mark 👎...if he is missing something then tell him personally.... don't make his moral down...I found his vedio perfect 👍thanks frnd

[@krishjodu3767]

Thanks for your wonderful video bro, It's raising AssertionError at timer

[@d7q0hdjfq39h]

You explain pretty well sir.... Learning Python from you is such a honour for me.

[@d7q0hdjfq39h]

God save my english.

[@zakaria.morchid]

I like those stuff here too

[@Kamehamehax21]

Thank you for this video. Nice explanation.

[@gregorybutcher2647]

Awesome video! Just one question: Do take different amount of processing power? if so which is more efficient, multithreading or asynio?

[@bufmouse13]

Incredible video, thank you! Im trying to find ways to turn three scripts that run a AI art generating bot into one and I think some of your examples is really going to help.

[@vishalwaghmare3130]

Best video on this topic

[@rajii515]

Thankyou for this video by the way.. it helps me a lot 👍👍

[@eduardogil1775]

Excellent explanation, Thanks for sharing! 👍🏼

[@mashoodurrehman9840]

Awesome.... keep making stuff like that.

[@samirbhattarai3441]

Nicely demonstrated. Great.👏

[@techqsr]

Informative 😍

[@SurendraTarai]

you are awesome, well explained... appreciate it. keep it up

[@mahdisecurity1700]

hi your video is very good subject. but for later video please : multiple function multiple sync multiple function multiple async multiple function multiple threading multiple function multiple processing and combine all concepts with simple language . thank you very much . god willing

[@drissaitkassimusic]

Best video to understand this tipic

[@michelromero7671]

Thanks for this video, I didn't actually watched it because of the great thumbnail that told me what I came looking for. (I left a like tho)

[@m.alaiady3627]

Nice explanation

[@getconsiousstate]

Any reason why ProcessPoolExecuter is not used for multiprocessing ? and what about multiprocessing.pool.ThreadPool ? Any Idea why these many modules are created for same functionality in Python ?

[@JamalanJuda]

What if I have a list of different URLs that I want to do GET from? How can I apply multithreading in that scenario?

[@josephomondi629]

great video buddy

[@bhola8023]

Which OS u are using and what's that theam

[@Berkeozbeek]

Could you please tell me how I can return the data printed from fetch() function in multithreadding? Whenever I tried to return it, t always gives me None for some reason but I can print it without any problem.

[@kiyotaka627]

thank you for this well designed video, very informative.

[@adnankaya]

Great tutorial! Thanks for sharing.

[@yt-1161]

@13:46 what are the downsides of having too many max_workers ?

[@Василий-й1у]

этому типу надо памятник поставить( в хорошем смысле :) )

[@maba7097]

Thank you for the video I have an app that I integrated with api. I send a message to it and it analyzes it and then returns a result t, but when I send many messages at the same time, it does not go well and you get a mess In my case, what solves my problem from what you mentioned?

[@ncjatin]

I have a question... Example in synchronous code.... We are only defining methods not calling it... Than also methods are running

[@googlemonkey7746]

Nice explained

[@arjunchatterjee5667]

superb video!

[@FRUXT]

Why no subtitles ?

[@TheJBardopoulos]

and what's the limit for max-workers (depends on my PC, I know, but how to find the limit?)

[@vsanjairaj]

I have to get status codes for 150k urls in a data frame. I want a new columns 'status' in the df and i want the response code of the request of url. What's the best way to do it?

[@akhil3365]

what is the difference between qrequests and asyncio

[@KirillBezzubkine]

The video is good. BUT: how would you make 10000 http requests when the api supports about 50 requests only at a time (otherwise it throws 429 error)? I need help with that. Thank you

[@kattynip0]

need to rotate IP

[@saurabhverma6108]

@@kattynip0 what solution did you find for it?

[@TanviAravind]

Thanks for making this video of Asyncio hope it covers web scrapping

[@TanviAravind]

I had finished python asyn await and aiohttp during the weekend... earlier it used to take 40 to 50 mins to scrap the data after aiohttp and Asyncio implementation it's just 90 Seconds

[@d7q0hdjfq39h]

@@TanviAravind yea it's such a time saving during projects.

[@PGhai]

Nikhil Bhai, do u also teach one on one?

[@IndianPythonista]

Hi. No plans to do that yet.

[@AngelGonzalez-kl8oi]

Great!

[@veereshgs5298]

Great 👍

[@bhaveshmevada8424]

Bro i want to post json data with requests.post method and i did it but it takes very long time to send all data...plz help me

[@nelsonkenmochi9353]

Nice video, thanks for that. :)

[@poojagautam1406]

Amazing tutorial! Thanks a lot.

[@_sharmaji.dev_]

AWESOME!!!! REALLY HELPED.

[@deepanshuchoudhary4598]

God bless you

[@lazypunk794]

Great job mate

[@yellie5629]

Can I organize and post your lecture on my blog, Medium? I will leave a reference.

[@kirtimali723]

my main function is not calling... can you help me with it?

[@ncjatin]

Just cross-check.. have you out @timer(1,1) before main function ?

[@sulaymanali8080]

really great. thanks a lot

[@YuvrajSingh-pz7wt]

Can u plzzz makr video on topic of what is channel in django and make chatting app ..plz sir

[@EnglishRain]

Brilliant video, thanks a lot!

[@dm-vh9yu]

Great video, keep it up

[@Duychienvt]

I think threadings are running inside one process. It is impossible to do faster than multil-processing. The reasons that your multithreading is faster : may be this is running multithreading inside multiprocessing Check out this video: kzbin.info/www/bejne/m5SuiJyXfah4gdU

[@abhisekkeshari4850]

Could you please add the timestamp of the methods that would be a great help

[@hgt3]

thank you

[@mithunnambiar1433]

An assertion error is stopping me from the synchronous method. does anyone experienced the same problem?

[@radiozamindar4710]

hello bro can i have some help ?

[@trickdigger5744]

Sir, Kindly check the pull request made on github.

[@ashishsondagar2812]

15:25 asyncio

[@nirakarpadhy]

!!! PETITION for making tutorials using examples of "POST" requests !!! @IndianPythonista Why does every tutorial and blog post always assume we only only need "get" requests? I try to implement the same code for "post" requests and I run into all sorts of errors. I wish you or someone on this earth for once did tutorials for fast http post requests.

[@switchblade3868]

Ahats that linux???

[@peterchao7429]

Great video, I have learned a lot here. One question I have is, instead of get HTTP request, what if I want to do post request?

[@giorgosK936]

naughty boy

[@kumarnitish6552]

Are you sure of the time calculation using a timer, because it seems like coding is taking more than what it prints in the console? Your timer logic is not correct

[@MythologyMystics]

Sir, can you let me know how to integrate asyncio to call multiple cameras to take a multiple angle picture once at a time.like using picamera over raspberry Pi. Thank you

[@MrPedala94]

sounds to me like you can just do that in a sequential manner.

[@Picker22]

dint understand all this sorry