How To Scrape Multiple Pages on Websites | Web Scraping using BeautifulSoup

[@WsCubeTechENGLISH]

😎Hey, thanks for watching! We’d love to know your thoughts/doubts here in the comments. 👉For professional self-paced certification courses (pre-recorded), visit: bit.ly/Pre-Recorded-Course 👉Don’t forget to SUBSCRIBE to our channel for more such videos & valuable content: bit.ly/WsCubeTech-English

[@rockysp1]

No one has explained so well on the entire KZbin channel, thank you ma'am

[@yourcreed104]

great explanation and she has good knowledge about this topic

[@carlosconde3498]

Great job!!!

[@harshjalan3218]

mam in case of while loop, problem is that when our code find("a",class_="_1LKTO3") tag it's find previous button link because class is same as next button tag. so it's again and again jump page no 1 and page no 2.

[@foodiesdaadda6576]

What is the solution for that

[@redskins3186]

I'm starting a grocery shopping website is there any way I can do this on a grocery store website? Where I can take everything, turn it into a CSV file and then just put it in my website. Basically like just taking their page with all the features exporting it into a CSV file and and then importing into my website. And having it all be the same exact way as on the grocery stores website with features and all? Please help lol

[@spoorthimv9325]

I am getting status code 403

[@atgnandu]

in for loop i am getting AttributeError: 'NoneType' object has no attribute 'get'

[@nikhilsatbhai6722]

can you please tell how to use while loop in case of different link in detailed

[@venkataeswaratmakuri6223]

mam it's showing error code 500 on trying to print the request how to resolve it

[@ayyamguari6134]

Same

[@surendra1764]

Will it work for Amazon

[@jayabishnoi7416]

status code is 403 can u help me with this

[@anjalirohilla5665]

same

[@abhisheksinghgurukul]

In my case it shows page not found how to fix it?

[@axelescalantemartinez7234]

Same here... did you find a solution?

[@abhisheksinghgurukul]

@@axelescalantemartinez7234 no I am not getting any solution.

[@madhainagarhighshool3403]

It's very difficult process. I think

[@ahmedelsaid8368]

it worked for me when i inspected the total number of pages:total_pages = int(soup.find("div", class_="_2MImiq").find("span").text.split("of")[-1].strip()) , instead of the "next" button and looped for it , added each number to the url

[@rafiqamar9606]

flipkart is giving me 500 status code

[@yogeshkhairnar5822]

there no option rather than paid proxies