Web Scraping with Puppeteer & Node.js: Chrome Automation

Join my premium 2024 bootcamp here learnwebcode.teachable.com/p/...
0:00 Intro
1:20 Installing Puppeteer
4:29 Taking a Screenshot
7:09 Scraping Text From HTML
15:34 Saving Images to Hard Drive
21:45 Clicking a Button
25:16 Filling Out a Form
30:51 Scheduling a Task to Repeat
The practice URL I'm working with in the video: learnwebcode.github.io/practi...
My finished example code: gist.github.com/LearnWebCode/...
Follow me for updates on new videos or projects:
Instagram: / javaschiff
Twitter: / learnwebcode
Facebook: / brad-schiff-1542576316...
Twitch: / learnwebcode

[@kaliteliyazlmc1376]

34:52 "Hope you feel like you learned something". Man, I learned a lot! Thank you!

[@mackenmd]

Fantastic course and the automation part at the end is almost immediately applicable to me! You just instantaneously put yourself on my tech radar! Thank you, sir.

[@shahriarparvezshuvo4760]

Awesome, I just literally looking for this. Thanks Brad. Good to see you. 😁

[@phubbert91]

Hello. Your course was the first time I was able to follow along and not hit a snag. This was so much fun. Thank you.

[@cecilec9234]

Unlike some KZbinrs on here you explain EVERYTHING. You make it so easy! Best teacher ever thankyou!

[@sagimisan6422]

Thank you ! It was a great course !! It helped me a lot, and I finally found answers to my questions.

[@Cho1279624]

Your explanation is crystal clear. Thank you so much!!!

[@pranavrao244]

Great video! As someone with 0 development experience who wanted to archive many images, this was perfect.

[@suhailxeaser]

Perfect timing, I was looking for selenium and my favorite teacher has made a video on the similar tool. Great :)

[@mikeparker444]

This is really good. I started getting into this about a year ago, and coming back to it was a blur. It's all coming back to me now.

[@jacobvalenzuela2546]

I tried web scraping in December 2020 but had no luck. I am very happy I found this video!

[@basement_grower]

Great video! You explain the content very well. Thank you sharing your knowledge!

[@webmaster246]

Every time I watch this , combo for towel under the keyboard & Mr. Barksalot makes my day , Brad ! :D

[@danielelgressy]

simple, clear, amazing ! Thank you for making this video

[@sk8leesk8]

New favorite teacher. I actually have hated using javascript since 1998, but I have a reason to use Puppeteer. Great video!

[@hirenpatel2236]

Beautifully explained! Thank you!

[@keawewong6110]

Very cool node pack. Thanks, Brad. I am taking your WP dev course. Enjoy it very much. The extra plugin lessons you added are a gem. Thanks so much! Let's keep things rolling. I will see you in the next KZbin video 😆

[@kashmirtechtv2948]

You are amazing!! ❤️❤️❤️❤️❤️❤️ He explained the things that 99 percent of the youtubers don't share.

[@PhilippeRigovanov]

Great tutorial! Thank you for the video and for the code!

[@victory_lucky]

thanks so much for this. i first heard about cron few years back while working with wordpress, i would definitely learn more about it.

[@artificialhits]

I'm on minute 6 and my jaw is on the floor already, this is exactly what I needed. Thank you!

[@arnonasquira796]

this is a great video, and your explenations and examples are very good

[@alex-desroches]

this was a great tour of puppeteer. thanks!

[@dilipgokulapati3597]

Best video to understand puppeteer, hats off. Thanks for ur efforts

[@talhamuneer5485]

Thank-you! Sir Great Tutorial… Clear in depth explanation!

[@thabisomagwaza4431]

Amazing video man. Thanks for sharing the knowledge!

[@mh_tareq]

Wow! this is exactly what I was looking for. Thank you so much.

[@991122bc]

Really enjoy the way you teach, I did learn something every time I watched, awesome ! Now I can practice, great

[@joaquingavernet]

REALLY useful!!! Thank you so much from Buenos Aires, Argentina

[@thomasblack3415]

Great course! I had some trouble with $eval and $$eval before this now I totally get it. Thank you!

[@mohabbatshikderkowshik3739]

Excellent brother, very grateful to you 💜💜💜

[@Stan-mh7bf]

Wow such a neat and clever code, I just could not resist to subscribe!

[@Habib_HBB_17]

The best teacher forever 💪❤️

[@vickylondon1543]

You are doing a wonderful job by giving Knowledge many thanks

[@isagive]

thanks a lot man, you make it easy to follow and learn 🙏🙏

[@xavierbeaud]

Very interesting subject and excellent teacher !

[@leonardosales526]

Oh! What i was looking for. Thanks!😮

[@zohar10001000]

excellent tutorial ,it makes it so easy, thanks!

[@talhamikaaiyl5483]

Awesome tutorial, thank you!

[@CodingJourney]

Brilliant!! Huge thanks and love 🙂💙💙

[@youdjparents]

you're a great teacher, thanks!

[@tedmureithi6483]

Your cat really does mewalot, this was very helpful to me in getting started with puppeteer

[@lliscn1701]

Great explanation!

[@TheTahmeed]

Really love the way you teach ❤️

[@anaelennaemeka4078]

Awesome, explained in details

[@netanelarbiv6858]

Great course!

[@nafeysolutions4808]

great way of expalining things.. thanks

[@eshaanbagga5159]

Amazing amazing tutorial!!!

[@RamonChiNangWong078]

I start learning puppeteer for a whatsapp project of mine and also some refresher of JS Since I haven't code that much anymore, but I've to say that this was a very informative tuts. Good Job!

[@BusaFurian]

Very very nicely done!!! 👍👍👍👍

[@meshaelshahid7082]

BEST PUPPETEER VIDEO!

[@fizruk7644]

oh FINALLY reeeally good tutorial on this topic

[@yannik8271]

Thank you so much man! Great explanation!:)

[@AyushPanditofficial]

Wow nice to see you again

[@OstonCodeCypher]

You always read my mind, and btw thanks for the WordPress course. Am now able to earn my living becoz of you. LONG LIVE Brad.

[@user-gi6yc5nu6g]

Amazing content 🔥

[@nazarpasha]

Perfect bro thanks!

[@etambuyulikukela420]

solid tutorial thanks man

[@nicetomeetugaming7024]

Thanks for this amazing video sir!

[@gavincoulson3900]

Great vid, thanks for this

[@becuasegoodreason]

Perfect explains

[@nicolaslupo5021]

Thx! Awesome content!

[@nasimaakther6906]

I have watched full video. Wow so amazing...

[@fredb5626]

loved the video man - really helped me out

[@hadiasghari2266]

u r the only reason that i am still coding in js.

[@rupertxyz]

This was a great tutorial!

[@JoseHenrique-xg1lp]

I had never tried puppeteer before because I thought it would be so hard... It turns out this is a breeze, thank you! Just my two cents on crons, we realistically are going to use PM2 to restart automatically the app if anything goes wrong, even if the physical server reboots... personally... I set up our express server and crons to be different entrypoints in the same codebase. I'm yet to see a problem with this approach (perhaps slightly hurt performance and node libs stability)

[@ianherring1090]

thank you very much for your detailed explanation. One of the best teachers on youtube. BTW, how would you webscrape with web3 i.e. metamask required to see the info on page?

[@jayanth704]

Really Great Content !! Learnt Web Scraping with such ease !! Keep doing bro You jsut earned a Sub!!

[@andrewbateman2282]

Thanks, great video.

[@PuraMolleja]

This video help me so much 💯 Thank you

[@pramodhsp6326]

awesome this is mind-blowing

[@kamaleshpramanik7645]

Thank you very much Sir ...

[@auychatcharin940]

Thank you very much.

[@rajendraku.mohanty6216]

❤️❤️❤️ great sir

[@user-mo3cw6go7c]

Hooo the best channel on the earth 🌍

[@TobiasBier]

35 minutes ran looking like 5 mins...great job explaining! thanks

[@barnabysomkuti4195]

this is gold

[@dtg2219]

Nice Video!

[@LuenWarneke]

Excellent

[@innovativeideas442]

my favourite teacher

[@AlexAlex-js9pu]

Thanks!!!

[@michaelday6987]

What a great kickstarter tutorial. As someone who is using using web scraping to help me refresh my Javascript skills, this is exactly what I need to get a jump out of the gate.

[@vighneshmanjrekar5213]

Thank you

[@babayaga6172]

Super ❤️

[@soyox20]

I love you bro

[@user8ZAKC1X6KC]

Great tutorial. I am having an odd experience (which I assume is due to my lack of experience). I am getting a massive string of errors when I do this, but it still works. Like the output is what is expected. I have traced the errors back to possibility that I am using the wrong version of Node.JS (I am using the most current) but I don't know which version I should be using to squelch those errors or if it even matters. They are mostly navigation errors "Unable to navigate it invalid URL ..../puppeteer/common/Connection.js :230:24" etc... in the terminal.

[@kamuiellis610]

Dude i bought a course on udemy about puppeteer and you explain more stuff on this topic smh. Thank you

[@Shifter21000]

Hi Brad, Thanks for this. I heard we can start a puppeteer browser and then control it remotely from JS, that would be a really nice tool to know.

[@tedspens]

I was trying to figure out the best way to copy images, current prices and other information from some online catalogs, and here you pop in with exactly what I need. But what I really want to know is how you got that code to scrape my thoughts. Thanks!

[@mohammedalnoaimi6416]

love you

[@johng8316]

Awesome Video Brad! Loved it. One note however. I am running Node JS version 17.1.0 and my node-cron failed without first installing a module called uuid. I'm assuming its a necessary dependency. npm install uuid did the trick. In case anyone else has this issue.

[@PodDropBits]

great tutorial! How would you crawl on the website using your "Scraping Text from HTML" part? Can you do a part 2 of this that shows us how to crawl with scraping?

[@rangabharath4253]

Awesome

[@omargian_stw1305]

Great tutorial. Very helpful. One question. I have a task that is extract data from website and then convert it to json I don't need to store those data instead I need to send it those data to another website via api rest. Any idea or suggestions is welcome.

[@danielasuarez6017]

Can you show how we would add this data to an excel sheet after we automate it? This is very helpful! Thanks so much!!

[@yannik8271]

Thank you so much man. :) But could someone pls explain to me what the buffer method as seen at 20:52 exactly does? When do you use it? Thank you very much!

[@soumyadeepmondal4347]

I love you sir 😭😭😭😭😭

[@user-rn4ry1oe4f]

Большое спасибо

[@salim6482]

Please make a video or a blog an how can we open chrome with some extensions using puppereer