The Easiest Way to Avoid Being Blocked When Web Scraping

Check Out ProxyScrape here: proxyscrape.co...
➡ WEB
johnwr.com
➡ COMMUNITY
/ discord
/ johnwatsonrooney
➡ PROXIES
proxyscrape.co...
➡ HOSTING (Digital Ocean)
m.do.co/c/c7c9...
If you are new, welcome. I'm John, a self taught Python developer working in the web and data space. I specialize in data extraction and automation. If you like programming and web content as much as I do, you can subscribe for weekly content.
⚠ DISCLAIMER
Some/all of the links above are affiliate links. By clicking on these links I receive a small commission should you chose to purchase any services or items.
This video was sponsored by ProxyScrape.

[@wahyuws]

Awesome content as always. Please make a video about browser fingerprinting and how to overcome it. Many thanks.

[@kexec.]

Thank you so much for this video. CF is big hurdles for scrapping nowadays.

[@graczew]

This is gold mate. Thanks for your time and effort to share this.

[@vizonex4316]

My tip: always use common user-agents and try to update your useragents regularly so that your blended in with the traffic of other devices.

[@x7NN]

Simple-useragent and simple-header pip packages are perfect for this!

[@princekha4540]

It would be great and helpful if you could make one about finger printing. Thanks for the video that you just uploaded.

[@Null-s8j]

0:54 please do a video on this

[@sujitbiswas1995]

Yes please boss

[@searchenginemaster]

Awesome! waiting your SeleniumBase review

[@patrickengel9341]

Is there also a video planned with higher bot protection?

[@artabra1019]

this is great! I dont need to use manulally open chrome to copy that cookies everytime.

[@naradakandawala4278]

Golden content ❤🍀

[@alexdin1565]

Thanks John, please can you share with us how its cost you proxyscrape for example 1M requests? or if you can a video to explain us how we calculate it before buying their proxies because I want something cheaper for my project, and if you can make video on how we can login or register without browser

[@mianashhad9802]

Another person here asking you to make a video on fingerprinting. One question that has been bothering me is that, why should you not use fingerprinting with something like curl_cffi every time you send a request to a server? Why wait for something to go wrong to use it and why ever use the simple requests library at all? I mean, what are the downsides of using fingerprinting. Your script becomes slow? Is it not as simple and convenient to code? Would love to know more about this.

[@irfanshaikh262]

1:01 help yeah mate.....

[@sujitbiswas1995]

Please boss make video about fingerprint, cipher, mimicking request etc.

[@bakasenpaidesu]

.