Web Scraping in Bubble.io How-to Tutorial

[@HervéDURANTE-h5y]

MERCI beaucoup pour cette vidéo clair et precise ! J'ai beaucoup avancé avec cette vidéo. il me reste une question : comment faire pour les image ? bonne journée !!

[@NoCodeAcademy]

Hi you're very welcome. For images, once logged into your Scraping Bee account, navigate to the "HTML API Request Builder " page and then select the "🏞 Extract images from a web page" under their Starter Templates section. Might have a few other settings to dial in but hopefully that gets you off in the right direction.

[@Axantemir]

Gracias. Las posibilidades del scraping son infinitas. Gracias a ti las personas de todo el mundo conseguimos inspiración para desarrollar proyectos interesantes.

[@NoCodeAcademy]

Gracias por el comment. Es con mucho gusto.

[@irishjoe2006]

awesome video man. Can you make the same video for images, or showing the scraped text and images in a RG?

[@NoCodeAcademy]

Hey thanks Irish Joe for the kind words. Yes, once logged into your Scraping Bee account, navigate to the "HTML API Request Builder " page and then select the "🏞 Extract images from a web page" under their Starter Templates section. Might have a few other settings to dial in but hopefully that gets you off in the right direction!

[@irishjoe2006]

@@NoCodeAcademy thanks man!

[@parabunx]

What is the plug in to crawl pages ? Thank you very much for your help :)

[@NoCodeAcademy]

Check the video

[@MisCopilotos]

Nice! It'd be great to see one of crawl + scrape of an entire site.

[@NoCodeAcademy]

Hey agreed on that! Showing off the full details of specific setup may show up in a course in the near future. But if you're interested at present, you could check the crawl plugin, which when you give it a URL it returns a list of URLs. Then if you've seen the loop video on the channel, it'd simply be combining the work shown in this video with a loop that would loop through the list of URLs from the crawler. Pretty epic what we can make these days and only limited by our imaginations!

[@MisCopilotos]

@@NoCodeAcademy super clear, thanks!

[@MisCopilotos]

@@NoCodeAcademy quick question, do you have the crawl plugin link? I'd like to test your idea of combining: "crawl plugin" + "scrapingbee plugin" + "loop". Thanks! Also, much appreciated if you show the way with a tutorial ☺.

[@NoCodeAcademy]

@@MisCopilotos hey try this plugin bubble.io/plugin/links-crawler-1687798195342x704730760022065200. The workflow takes a URL as the input and outputs a list of texts for the URLs it crawled. You could display those into a repeating group via a state variable once its value is set with the results of the workflow output. If you want to add selection functionality so users can decide which ones they want to scrape, you might try this video: kzbin.info/www/bejne/bILddnSXhZxlmqM

[@MisCopilotos]

@@NoCodeAcademy thanks!!

[@tardigr8]

In the result bar, how can we make the text result box extend with the quantity of the words? mine doesn't oddly...

[@NoCodeAcademy]

Hi thanks for the comment, you mean the UI? In the Property Settings Panel of the text element, double check that "Make this element fixed-height" is not checked. If that doesn't do it, play around with the various height settings for it and see if that gets you there. Hope that helps.

[@BiowallEu]

Hey man, great video! Could you do some tutorial on how to use bubble and backendless for european users... there is a huge interest in europe because of GDPR laws and there is literally no tutorials out there...😊

[@NoCodeAcademy]

Hey thanks for the kind words. Right now my focus in on releasing a new course so sadly I'm not taking on things with steeper learning curves like a brand new tool, though I hear you on the topic of GDPR. You might try this plugin to explore if Supabase is roughly an equivalent to Backendless?? bubble.io/plugin/supabase-by-nocodegarden-1687446439843x865924681433350100