Web Scraping With Javascript (Puppeteer Tutorial)

Learn puppeteer in less than one hour. Since I had to take down 3 of the videos I had on my puppeteer series I decided to make this video. I will go over the basics of web scraping and browser automation in NodeJS.
🚀 Learn ReactJS By Building 6 Projects: codedamn.com/l...
Social
▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬▬
Website: machadopedro.com
Linkedin: / machadop1407
Instagram: / _pedro.machado_
Github: github.com/mac...
Email: [e-mail]
Tags:
Puppeteer
Web Scraping
NodeJS Tutorial
API Tutorial

[@juanhenriquerezende]

Estou maratonando seu canal e feliz por ter encontrado ele. Você ensina mto melhor q varios professores de curso q eu paguei pra ter, parabéns pela didática e pelo conteúdo q você vem trazendo.

[@PedroTechnologies]

Muito obrigado Luiz! Fico feliz :)

[@SachinSharma590]

Awesome explanation man... After looking to more than 10 videos about web scraping i can definitely say your is the best

[@RahulShinde-xs9rl]

Thanks

[@RahulShinde-xs9rl]

Nice Video 👍🏼 I was looking for such type of content from long time. Thanks you're Amazing 🤗. Please continue the series on puppeteer.

[@PedroTechnologies]

Thank you Rahul! I really appreciate the support!

[@tech3425]

Always the best place to start learning something new

[@adanulabidin]

Thank you so much dude. Amazingly explained and well structured video. Keep it up 🎉

[@erickgutierrez5260]

Awesome videos man, congratulations and thanks for your so clear explanation on all of them!

[@ghettosmurfph]

One of the best tutorials on this, well done!

[@StanislavBrusgul]

Best video for puppeteer.. Great Video! Thank you

[@alejandroaquino3186]

Thanks for this, bro! I've been trying to find a decent course on web scraping with nodejs but most suck!

[@jtothey1993]

Very concise and easy to follow. Great video.

[@TheNamesJT]

You don't need that weird function syntax Pedro? you can just create an async arrow function and then put everything inside that and make sure to call that function outside of it to initialize it once you finished your scraping.

[@mariuslancha]

very insightful dude

[@fal8202]

Thanks , very concise way of teaching and fun to follow

[@FPLogistic]

Great explanation, subscribed!

[@devcoder6326]

Pretty simple to understand, good job!

[@444ous]

Thanks for this one as well, Pedro!

[@shashikant1166]

nice explanation , thnx from INDIA

[@PodDropBits]

awesome tutorial man! Can you do one where you crawl and scrape? I am new to all of this and with you learned the scraping part thanks.

[@michelgerges2678]

THIS IS SO SICK THANK YOU🚀

[@AlexIvanov-uh1yz]

Thx so much, you've got new subscriber!

[@danangponorogo166]

At last I found a reason of why your 2 puppeteer tutorial is missing .. :D

[@PedroTechnologies]

Yeah, i felt really bad cause i really liked that series hahaha

[@levihalperin7649]

Maybe you can upload it as private and share the link to it in this videos description

[@its_lilcent9916]

I love this video, thank you so much for all the informations.

[@mitalisalaria265]

enjoyed it ,great work

[@TheNamesJT]

I wounder what the legality is if you plan to offer a scraping service on fiverr and one of your clients ask to scrape data on a website that doesn't allow scraping? how can you find if a website doesn't or allows web scraping? i looked on some terms of uses and privacy policies but can't find any hits when using find and searching keywords like scraping, web scraping ect.

[@danielaugusto719]

Thanks man, this was very helpfull

[@MrYopisimoni]

thank you for a such good videos you publish

[@shoprecartteam9567]

Please make a video on apollo server express backend and nextjs ssr with authentication with cookies apollo client. It will be a good one. And thanks for quality contents

[@MrRossss1]

Great stuff. Thank you

[@htcsaj7876]

Hey Pedro, amazing tutorial. How to add realtime notifications to this scraping.Is is possible

[@heitormbonfim]

Great Video, broh, but I come to think "hell, what a brazilian name you've got" hahaha

[@PedroTechnologies]

Eu sou brasileiro kkkkkkkk

[@heitormbonfim]

@@PedroTechnologies imaginei KKKKKKK

[@abdelrhmanrhyaseen6194]

Super cooool

[@linamariafernandezcardona2433]

Very nice video, can you maybe make one on how to scrape SPA's?

[@levihalperin7649]

What about using js path of xpath to find specific button?

[@thulasiramg246]

Awesome tutorial …can you explain how to access HTML elements style lik font family,size,color,width,…etc

[@thatolebethe8896]

Thanks for video really good

[@aymenbachiri-yh2hd]

Thank You

[@tristetempsj5893]

Awesome !

[@zacharykrivda140]

How would you cycle through and click all of the buttons on a page that all have the same class?

[@Star-hw8bh]

thank you for this

[@thatolebethe8896]

how do u deal with pagination. For example I want to scrape Amazon books and there's 50 pages each with books and I want to grab all books across 50 pages

[@juguetestoys1137]

great ! how can I copy the data obtained, inside a html div, instead of viewing it, in console. thanks

[@giribabuanisetti3450]

can you make next video on MERN stack

[@aice0927]

How to grab the data using its custom attribute?

[@anakin2389]

I rececived an error:failed to launche the browser process.PLease help me

[@ashimov1970]

I wonder if KZbin allows webscraping it

[@XELTRA1]

how to click checkbox hCaptchs and select images ?? can you make it a video???

[@erfanm4805]

nice

[@jacobabraham6453]

Goat

[@bg-sj9tx]

Can u do with captcha

[@wf2w323]

i love you man

[@josephwong2832]

awesome

[@patrycjamichaek8794]

Is your website down?

[@RahulRoy-um8rs]

Can be solve epub to html

[@alperenyildirim821]

The tutorial is good but the only thing that I didn't like is that you didn't use ".quote > span.text" to get the quotes themselves directly yet instead, you wrote extra lines of code to get that. Also to get the author info, ".quote > span > .author" or ".quote .author" could have been used.

[@rezaulmasum205]

some websites disable document object as a result it is impossible to scrap data from that, could show us how to resolve it ?

[@PedroTechnologies]

You can easily add a user agent to puppeteer which fixes this. I go over it in my other puppeteer series. I should have mentioned it in this video :)

[@rezaulmasum205]

@@PedroTechnologies waiting for that

[@yuvraj2274]

Hello sir Please help me building product comparison website using web scraping in javascript please make video on it

[@NolanMakatche]

Your website is down :(

[@first275]

Instead of series bring a full length crash course

[@nelohenriq]

Are you portuguese?

[@prateektiwari4116]

I am trying very hard to learn mern by my own but i got struck while storing jwt auth token on cookie... It is not storing any cookie while making post rqst in node js.... Plss pedro if u can help me anyhow Thank You

[@junky3445]

great tutorial only problem was I couldn't get it to work on edge browser cause I refuse to get chrome, I used puppeteer-core, and edge-paths which is recommend for edge and imported my executablePath property to the browser await function and still nothing, looked all over could't find a solution.

[@mandayli9641]

simple solution, sto refusing to get chrome

[@thevasupodcast4561]

in last example I tried to logout after the login using await page.click('a[href="/logout"]'); but it didn't work, it worked when I copy pasted it 2 times. why is it not working with only a single line??

[@randohundo9795]

May I suggest something that might be stupid? Try to give it a few moments before performing the action. Set a timeout of a few seconds and check if it works that way. I might be completely wrong but I think it has something to do with the action being asychronous. Again, this might be wrong, but it's worth a try if you have time.