Scraping Reddit with Puppeteer & NodeJs

[@alexanderkozhurkin5408]

Thank You, Fabian for nice tutorial. Why you dont attach link to github code? It will be easier to follow along. It's hard to type and watch the video

[@thechosenone89]

This tutorial is particularly useful because it's on a site where the markup hasn't changed much since the video was recorded. One thing did change though, basically there is a sponsored post at the top of the list of results now. And your span[class="rank"] selector won't work because that span in the sponsored post has a class of "rank sponsored" rather than just "rank". And the tagline classes will error out too but I didn't investigate why. Easy fix is to just replace "thing" with "self" in the elements declaration: let elements = await self.page.$$('#siteTable > div[class*="self"]'); The sponsored post doesn't have the self class.

[@ThiagodeSouzaRios]

Nice tutorial. Thanks for sharing your knowledge, it helps me a lot.

[@simplyfabian]

Glad it helps!

[@gabrielsoloman5000]

you're an excellent teacher, bought your udemy course and i'm loving it. i really wanted to purchase your complete web scraping stuff, but the exchange rate from USD to my local currency (BRL) is just terrible right now (1USD : 6BRL), so maybe in the future

[@simplyfabian]

Thank you! Let me know about this on twitter.com/grohsfabian and I will gladly give you a discount on the course 🙌

[@TheBotEmpire]

Nice and easy to follow good job :)

[@grenbowchi2747]

Thanks for a good quality tutorial !

[@Steve-Richter]

Good gosh, that was terrific!

[@jstodd4398]

You dont explain how to run the code. I assume from your video the only dependency i need to install is puppeteer. When i launch it, it says localhost cannot connect.

[@totallynotbluu]

it's because puppeteer doesnt launch a web server at all

[@Bartasek94]

Would it work with vote/downvote specific comment, not post?

[@HK-sw3vi]

awesome stuff!

[@erenay40]

awesome tutorial, thank you!

[@alonsouribemx]

Hello, how can you get the results by browsing the pagination?, thank you!

[@planetmall2]

Great job. Thank you!

[@soltiscd]

Will you show how to call upon it on the front end?

[@simplyfabian]

Hey man, what do you mean by that?

[@soltiscd]

@@simplyfabian implementing it into some kind of project. Excuse me if I don't explain well enough. Such as your imdb, how cpf you make it into a front end for a user to call upon some data?

[@simplyfabian]

I understand shat you mean now, you want it to be connected to a frontend and return on demand data. Im not sure if I am going to show that and when but thank you for the suggestion! Will definitely note it down 🔥

[@BESTEVERDUDE19]

Local host 808 file not found*

[@22mahmoud]

How do you use a debugger like that, I mean how to make debugger open the browser and follow the script !!

[@simplyfabian]

Hey Mahmoud, please go back to part one and two to see exactly which option I used to have the browser open like that when initiating it. The code lines are there 🙏🏼

[@22mahmoud]

@@simplyfabian Thanks dude :D it works

[@conceptualelegance]

this is way out of my league. where does nr come from? thats the biggest one, slice i dont get either. sigh. not noob friendly enough

[@Churtleneck]

nr is just a parameter to the function getResults. Its supposed to be the number of posts to grab on a page but I guess he didnt use it in this tutorial and just grabbed all the posts on the page instead

[@rodrigoorellana2389]

you rocks!

[@KillerKotHD]

🔥🔥🔥

[@piotrszymanski8325]

Very good video but it is the same as any other one! MAN, plz show how to scrape more advancet sites like for example this new version of Reddit which is dinamicly rendered with random classes, show what are the best practices, make something great, because if somebody want to scrape fb for example he cant say it is to hard so lets scrape pizzeria website, man...

[@dankchannel1404]

ohh ok

[@ufcfights6466]

awesome