How To Build a Web Scraping API for Large-Scale Data Collection Using FastAPI

[@CTOSellsideSpA]

Gracias por compartir , saludos desde Chile

[@joshuatemitayo4544]

Please how does using multiprocessing scale? imo it limits you to number of cpus available and may lead to long wait time on the job queues if all the core are running a task. I think running in async should be better, please educate me

[@AkamaiDeveloper]

Hey there - What Tim may be getting at here is by using FastAPI, an asynchronous framework, along with multiprocessing you're getting the best of both worlds to overcome some of the limitations of python. This may not be the best configuration for everyone though.