HTTPX Tutorial - A next-generation HTTP client for Python

  Рет қаралды 104,589

Patrick Loeber

Patrick Loeber

Күн бұрын

Пікірлер: 118
@patloeber
@patloeber 2 жыл бұрын
What's your favorite HTTP library in Python?
@franciskatende1566
@franciskatende1566 2 жыл бұрын
httpx
@abdultheseekerofknowledge4453
@abdultheseekerofknowledge4453 2 жыл бұрын
requests
@thesupercoach
@thesupercoach 2 жыл бұрын
aiohttp
@0xN1nja
@0xN1nja 2 жыл бұрын
requests
@shanecaler1167
@shanecaler1167 2 жыл бұрын
Aiohttp because you can change proxies per request in a client rather than having to set the proxy at the time of creating the client. Httpx would be the better option if they had that one feature
@TimL_
@TimL_ 2 жыл бұрын
This was brilliant, the more involved topic, the comparisons, discussing correct practices, everything! Keep it up!
@anthonyaouad4190
@anthonyaouad4190 2 жыл бұрын
Small nitpick, can you please use time.perf_counter() instead of time.time() since a lot of beginners watch your videos and it's the better function
@cobyiv
@cobyiv 2 жыл бұрын
Why is it better?
@bongjunjang5683
@bongjunjang5683 2 жыл бұрын
@@cobyiv because perf_counter uses cpu clocks to measure the difference of two function calls, while time.time returns the system time, which is subject to changes by the operating system.
@bongjunjang5683
@bongjunjang5683 2 жыл бұрын
@@cobyiv the system time, also called as ‘real world time’, is always subject to changes because your operating system periodically tries to calibrate the clock with clock synchronization protocol. You should not use system time to measure the difference of two time points because the time measured latter can be smaller than the time measured earlier due to these changes.
@anthonyaouad4190
@anthonyaouad4190 2 жыл бұрын
@@cobyiv check out pep418 peps.python.org/pep-0418/#rationale time.perf_counter() has the highest resolution for time deltas and is the one that should be used.
@bytesizedfeed
@bytesizedfeed 2 жыл бұрын
Could you instead use time.process_time()?
@magno5157
@magno5157 2 жыл бұрын
I love Python! ... the simplicity of Pythonic ethos reverberates through even 3rd party Python modules
@CppExpedition
@CppExpedition 2 жыл бұрын
Thx Python Engineer for making High Quality Videos!
@theeox
@theeox 2 жыл бұрын
It's funny I recently ran into domaintools switching from requests to httpx and didn't know why. Thanks for the run down!
@uvle-ts8bi
@uvle-ts8bi 2 жыл бұрын
Thankx for breaking it down.. great tutorial for beginners
@Strikeviolet
@Strikeviolet 2 жыл бұрын
I used this in our project… best library for async and sync requests
@Zekei1234
@Zekei1234 2 жыл бұрын
I was trying to use this, but you can't pass context to event handlers. This means, for instance, that a response handler only knows the response, but it has no knowledge of what the request was. Handlers are only assigned at the client level (no per-request handlers). So to get different handling for each request, you need a new client. This breaks connection pooling. Ultimately, I went with aiohttp, as it allows passing context per request. Hopefully they add this feature to httpx.
@daynetran6697
@daynetran6697 2 жыл бұрын
This is a great video that came at the right time! I was working with an API for the past week and the part of the pipeline that took the longest was the APi request through the requests library. Now I'm going to implement this HTTTPX client and also try to work in the Async feature! Thank you! You're awesome!
@toosafelol
@toosafelol 2 жыл бұрын
httpx is very good library. amazing asyncio support. at my job we have replaced all httprequests in our code base with this. we used aiohttp and requests in the past.
@michak.6325
@michak.6325 2 жыл бұрын
Are there benefits compared to aiohttp? Performance should be comparable, but I'm curious if there is more... probably on testing flask / fastAPI as already mentioned?
@ivan2885
@ivan2885 2 жыл бұрын
so i think, as a HTTP client the bast solution for now is httpx, because AIOHTTP provides httpserver and httpclient as well.
@Assxz
@Assxz Жыл бұрын
aiohttp is faster than async httpx, but need more code to write and less intuitive (like requests library). and httpx supports http/2 which is faster
@ermalgashimramori
@ermalgashimramori 2 жыл бұрын
Great content, looking forward for more.
@Caedin8
@Caedin8 2 жыл бұрын
It would have been great if you verified that all the 150 Pokemon were successfully gathered after each time trial. We are just trusting that the outcome of the 0.57 second async gather is equivalent to the 7 second synchronous gathering of Pokemon details. I believe you, but I am skeptical and an extra 2 or 3 seconds in the video to print the contents of the lists after would have been appreciated! Thanks
@prateeksarangi9187
@prateeksarangi9187 2 жыл бұрын
Thanks mate !! Great one
@JuanDuran85
@JuanDuran85 2 жыл бұрын
Excellent. Thanks.
@JoshBecigneul
@JoshBecigneul 2 жыл бұрын
Any thoughts on whether additional code would be needed to handle a server's responses such as HTTP rate-limits?
@vishalmatam
@vishalmatam 2 жыл бұрын
Brilliant video!!
@fredieeevlogs7077
@fredieeevlogs7077 2 жыл бұрын
wow thanks for the tip
@chizzlemo3094
@chizzlemo3094 2 жыл бұрын
GREAT CONTENT, THANK YOU!
@tusharsnn
@tusharsnn 2 жыл бұрын
have you tried http2 for making request ? what was the performance difference between http 1.1 vs 2 ? I think requests does not support h2 but httpx does.
@shaheerzaman620
@shaheerzaman620 2 жыл бұрын
Very helpful!
@AiF0
@AiF0 2 жыл бұрын
Well what is the difference between it and the requests library?
@ChrisHalden007
@ChrisHalden007 2 жыл бұрын
Interesting. Thanks
@kosmonautofficial296
@kosmonautofficial296 2 жыл бұрын
Great video thanks! Now is this also able to handle well in a multiprocess async fashion? I am looking into aiomultuprocess and not sure if it would be better to run this over aiohttp.
@motaseamyousef7668
@motaseamyousef7668 2 жыл бұрын
Hi, thanks for all useful info Could you please make video list for your shorts videos
@Diablerick
@Diablerick 2 жыл бұрын
Nice.
@techshareurdu3948
@techshareurdu3948 2 жыл бұрын
I am new to your channel
@arthurdujardin2877
@arthurdujardin2877 2 жыл бұрын
What is the VS code theme used ? I really like it !
@Lucifer-xk9de
@Lucifer-xk9de 2 жыл бұрын
nice demo, the requests does not support asyncio, so there is aiohttp can help. now, we have another library which much convenient than aiohttp. the httpx have the same style as requests..thanks !
@JusticeNDOU
@JusticeNDOU 2 жыл бұрын
try using timeit to time method execution, python time library is not meant to time method execution
@bigdaddy5303
@bigdaddy5303 2 жыл бұрын
So they combined requests with aiohttp? Don't think I'm going to bother changing my code to just have a single import.
@stevanmeandzija
@stevanmeandzija Жыл бұрын
Do you know why memory leak is happening when using in fastapi on linux?
@commerceclassesbygoyalinst8373
@commerceclassesbygoyalinst8373 2 жыл бұрын
How Can i Use Place Method with Frames in Tkinter ?
@yashdawani1909
@yashdawani1909 2 жыл бұрын
import httpx as requests. Boom no refactoring required
@markjones9180
@markjones9180 2 жыл бұрын
What theme do you use in VS code?
@MrEloska
@MrEloska 2 жыл бұрын
In the last example there is no need for `asyncio.create_task`. You can do it just adding coroutines to list `tasks.append(get_pokemon(client, url))`. What's more - to make this code more "pythonic" you can do it like: `pokemons = await asyncio.gather(*[get_pokemon(client, f"{base_pokemon_url}/{i}") for i in range(1, 151)])` :D
@angeloj.willems4362
@angeloj.willems4362 2 жыл бұрын
True. I tried it without asyncio.ensure_future and it worked prefectly.
@techshareurdu3948
@techshareurdu3948 2 жыл бұрын
Can you please make a video on Aws Cloud Front How can I Use This http module with Python
@holthuizenoemoet591
@holthuizenoemoet591 2 жыл бұрын
I always wondered if something like this would work to build backend webframework with
@abdoemad3952
@abdoemad3952 2 жыл бұрын
can you build a desktop app. determining the area of any engineering shapes like rectangle ,..... .
@aminramazanifar9743
@aminramazanifar9743 2 жыл бұрын
Can you please give a lecture about 'with' ?
@nicenaija9952
@nicenaija9952 2 жыл бұрын
How well does this intergrate with Django?
@pritamsarkar3371
@pritamsarkar3371 2 жыл бұрын
the last example sometimes is giving "RuntimeError: Event loop is closed" or "httpx.ConnectTimeout" but sometimes it is executing properly, I am using python 3.8. , windows 10,, can you please explain what is happening, and what is the solution?
@pritamsarkar3371
@pritamsarkar3371 2 жыл бұрын
got the solution , just need to increase the timeout param
@vraymond2048
@vraymond2048 2 жыл бұрын
I'm pretty sure there is ways to archive similiar result with request module and threading.
@angeloj.willems4362
@angeloj.willems4362 2 жыл бұрын
That's the method I currently use. But this looks to be faster.
@lucianofeder5422
@lucianofeder5422 2 жыл бұрын
And using async you dont need more threads to just wait requests. You can take advantage of a single thread on those kinda of tasks.
@ehsankabiri8912
@ehsankabiri8912 Жыл бұрын
Hope some day, httpx supports (Async+Socks5 proxy)
@reinduhr
@reinduhr 5 ай бұрын
Nice explanation Patrick, but 'Pokémon' is plural. Not 'pokemons'
@Pelmenosaurus
@Pelmenosaurus 2 жыл бұрын
99% modern internet is adult content or advertisement. I remember the times when a page opened in a browser was tens of kilobytes in size, and not like modern monstrous pages in megabytes and tens of megabytes.
@ch4sethe5un
@ch4sethe5un 2 жыл бұрын
But can't you use requests in asyncio via to_thread?
@hicoop
@hicoop 2 жыл бұрын
Looks cool but not enough features to switch from requests
@muhamedqasim5390
@muhamedqasim5390 2 жыл бұрын
Which faster httpx or aiohttp
@maqarg
@maqarg Жыл бұрын
🎯 Key Takeaways for quick navigation: 00:00 📖 Introduction to HTTPX 00:27 🚀 Getting Started with HTTPX 01:37 📜 HTTPX Features 02:58 🧪 Basic Functionality of HTTPX 04:05 🔧 Advanced Usage with HTTPX Client 05:27 ⚡ Asynchronous API in HTTPX 06:24 🧪 Testing Web Applications with HTTPX 07:33 🚀 Speed Comparisons 10:58 🎉 Conclusion
@lazyh0rse
@lazyh0rse 2 жыл бұрын
Whats the point? If request is working perfectly then i dont see the need for more bloat and dependencies.
@int0matar
@int0matar 2 жыл бұрын
Why does python use single-line quotes instead of double quotes when defining a string literal? Golang always uses doubles. What could be the reason for this choice?
@tolia5587
@tolia5587 2 жыл бұрын
You can use double or single-line quotes. For example print("text"more text"text") won't work, but print("text'more text'text") will work
@int0matar
@int0matar 2 жыл бұрын
@@tolia5587 I didn't mean it, it's all clear. I'm talking about the fact that it would be more logical to always use double quotes.
@tolia5587
@tolia5587 2 жыл бұрын
@@int0matar Yeah, I agree with you
@Medx111
@Medx111 2 жыл бұрын
Make a video about socket
@bayy4202
@bayy4202 2 жыл бұрын
i think requests + asyncio.to_thread way simple and clean kkkk
@DecimasoN
@DecimasoN 2 жыл бұрын
I'd still choose aiohttp over httpx for pure async code
@CodingByAmp
@CodingByAmp 2 жыл бұрын
wow
@JokeryEU
@JokeryEU 2 жыл бұрын
its missing http/3
@blueapollo3982
@blueapollo3982 2 жыл бұрын
Is this better than uvicorn?
@vraymond2048
@vraymond2048 2 жыл бұрын
Uvicorn Gunicorn is for server side hosting. In contrast, Request and httpx module is client side to request result from server.
@TNeulaender
@TNeulaender 2 жыл бұрын
It's even better than Excel
@DenisRasulev
@DenisRasulev 2 жыл бұрын
Speed comparison starts at 7:33 - kzbin.info/www/bejne/p3LLZpd6hKl9a80
@martinhotmann7868
@martinhotmann7868 2 жыл бұрын
Nice, but honestly for a language that itself does not perform well and therefore always was the perfect wrapper and easy to handle, this async function (the right way) looks way to complicated. They should have made it WAY more simple.
@hansdietrich1496
@hansdietrich1496 2 жыл бұрын
"There is no way to get async with requests" ... well there is, using greenlets and gevent.
@armandophilippe6203
@armandophilippe6203 2 жыл бұрын
threading with request would have beeen as fast...
@akzual50
@akzual50 2 жыл бұрын
New gen? You mean someone just made helper methods deal with this for you
@ordinarygg
@ordinarygg 2 жыл бұрын
MEMORY LEAKS: httpx.Client and httpx.AsynClient is leaking memory when you are not passing custom ssl_context. So if you use it in production, be cautious behind tutorials in vacuum space != your real code.
@Dan-vu3vt
@Dan-vu3vt 2 жыл бұрын
You're comparing parallelism to synchronous code. This is not really a fair comparison.
@philippelhaus
@philippelhaus 2 жыл бұрын
No http/3…
@SteveWoznokav
@SteveWoznokav Жыл бұрын
This is useless without semaphores, you must divide the requests if you have many requests like over 1000
@jerrygeorge180
@jerrygeorge180 2 жыл бұрын
.
@Quidoute
@Quidoute 2 жыл бұрын
hell no why every new framework say "next generation framework" just stop saying just GO and do it or you RUST
@Jkauppa
@Jkauppa 2 жыл бұрын
trash expansions upon trash
@Jkauppa
@Jkauppa 2 жыл бұрын
you do thrash just for money sake, nothing useful, therefore trash
@Jkauppa
@Jkauppa 2 жыл бұрын
trash bloats around everything
This Is Why Python Data Classes Are Awesome
22:19
ArjanCodes
Рет қаралды 812 М.
Next-Level Concurrent Programming In Python With Asyncio
19:19
ArjanCodes
Рет қаралды 179 М.
Random Emoji Beatbox Challenge #beatbox #tiktok
00:47
BeatboxJCOP
Рет қаралды 45 МЛН
Friends make memories together part 2  | Trà Đặng #short #bestfriend #bff #tiktok
00:18
Sigma baby, you've conquered soap! 😲😮‍💨 LeoNata family #shorts
00:37
LangChain Crash Course - Build apps with language models
15:19
Patrick Loeber
Рет қаралды 127 М.
The Fastest Way to Loop in Python - An Unfortunate Truth
8:06
mCoding
Рет қаралды 1,4 МЛН
Always Check for the Hidden API when Web Scraping
11:50
John Watson Rooney
Рет қаралды 641 М.
Best Platforms to Host Python Apps (for free!!)
9:50
Patrick Loeber
Рет қаралды 129 М.
Unlocking your CPU cores in Python (multiprocessing)
12:16
mCoding
Рет қаралды 308 М.
How to create a great dev environment with Docker
29:55
Patrick Loeber
Рет қаралды 271 М.
Python dataclasses will save you HOURS, also featuring attrs
8:50
PyScript is officially here!🚀 Build web apps with Python & HTML
17:10
25 nooby Python habits you need to ditch
9:12
mCoding
Рет қаралды 1,8 МЛН
Random Emoji Beatbox Challenge #beatbox #tiktok
00:47
BeatboxJCOP
Рет қаралды 45 МЛН