The Ultimate Scraper Tutorial | Extract Data Without Code

🎓 Full Tutorial: s.bardeen.ai/tutorials_bardee...
🔻 Download Bardeen: s.bardeen.ai/bardeenai-extens...
ℹ️ Need help? Join our Slack community: s.bardeen.ai/slack_support-ci...
🔍️ Explore Playbooks
s.bardeen.ai/playbooks-_avail...
📖 Video Chapters:
00:00 Intro
00:50 Scraping Fundamentals
07:39 How To Edit Your Scraper Template
11:12 Scraping Lists
17:22 Adding Scraping Limits
18:58 How To Scrape Data In The Background
22:20 Data Enrichment
25:48 Deep Scraping (Multiple Scrapers In One Automation)
29:53 Advanced Scraping: Custom Element Selectors
34:03 Advanced Scraping: Element Attributes
39:17 End notes
🤖 About Bardeen
Bardeen is a productivity app that automates your manual tasks with shortcuts. Follow our channel to learn about the latest tips about automating your day-to-day workflows and staying productive as a knowledge worker.
🐦 s.bardeen.ai/_yt_twitter
🕴 s.bardeen.ai/-yt_linkedin
😻 Popular Automations
Meetings: s.bardeen.ai/bardeenai_best-m...
Scraper: s.bardeen.ai/bardeen-ai-scraper

[@Bardeenai]

📖 Video Chapters: 00:00 Intro 00:50 Scraping Fundamentals 07:39 How To Edit Your Scraper Template 11:12 Scraping Lists 17:22 Adding Scraping Limits 18:58 How To Scrape Data In The Background 22:20 Data Enrichment 25:48 Deep Scraping (Multiple Scrapers In One Automation) 29:53 Advanced Scraping: Custom Element Selectors 34:03 Advanced Scraping: Element Attributes 39:17 End notes

[@markisrael1714]

Fantastic walkthrough Bardeen functionality. Easy to follow. Also, just so happens to address my exact use case. Thanks!!

[@DUANEYAISER]

This is an amazingly powerful tool, thank you so much!

[@ojaschaudhari3856]

both his jawline and his ai is amazing

[@user-cj1yf9pr2i]

Amazing tool and great tutorial, thank you!

[@PascalWeinberger]

Such a cool and useful video!

[@leighauza]

Love this! Excited to try it out!

[@mohammedhatem7492]

Thank you

[@sabrinamarin2598]

hi!! is there a way i can scrape rich text and export it into an CSV while maintaining its formatting? thank you

[@user-vd6kl1cs6p]

can we scrape email directly into google sheet by URL in sheet already exist

[@orelhassid]

Amazing Thank you, high quality content 🔥 I really want to see how you can scrape from multiple lists. Think about a gallery of posts grouped by category. So how you can extract the lists of all posts even if they are in different lists? Bonus: capture the category name and add to google sheet as a category column Thanks

[@Bardeenai]

List scraper within a list scraper? Like in Inception? Please share the use case in our community on Slack: bardeen.ai/community

[@Friday13thTrader]

Love your energy....can this be used to scrap historical intraday futures data. Its easy to get daily data from Yahoo Finance but more difficult to get historical intraday.

[@kevinjayhepiga4951]

Hi, I am really in need of help about this scraper as this will really help me scrape details in facebook ads library

[@keysunlocked]

Thumbnail game strong 😮‍💨

[@DaphneMarina88]

nice video-- also which video editor are you using for the rectangle view of you? it's cool

[@Bardeenai]

Thanks! We edit things from scratch in Adobe Premier. So it's not a particular app, but you can try "Screen Studio"

[@vikingzeppelin]

This is a very important video. I think i'm gonna buy Bardeen now

[@Bardeenai]

🙌 Lets us know if you need any help! Our user community is a great place to start: bardeen.ai/community

[@Ali.Solt1]

when i entered 100 link, it open all of them in a 1 sec which is not good and know me as bot, what should i do?

[@meejaan3883]

Do you have any Lifetime deal? or Appsumo?

[@user-sk4vk3lo7w]

Great Tutorial! I tried the extension. There were around 3-4 list items on the page and after scrapping A list, I couldn't scrap the others(Let' say B,C,D), it was repeatedly showing one of the list items from the B list equal to the no of items in A.

[@sandymakesplans]

you might need to look into their pagination feature if you're scraping pages that only yield a certain amount of results

[@charlieneely2859]

This all seems awesome. curious if there's a way to scrape the content of an individual page's posts on facebook?

[@Bardeenai]

Yes. It should be possible with the scrape. Try the list scraper with infinite scroll.

[@sandeeppvn0503]

I have occurring multiple times in my page. I want to capture all the text inside each of these and put it in one field. If I do .listing-content-provider-14ydav7 as the permutation, I get only the first span text. How to get the other ones and append them? We don't know how many such spans could be there, but surely multiple.

[@adrian80212]

Hi, I would like to know how you are going to scrape data from private channel that I have access to and using 2fa login. I would like to automaticaly add new members to my LinkedIn without doing this manually.

[@VGwritesalot]

Love this tutorial. I could use some assistance, though. I'm trying to find information/more details about the "more options" functions that come up in the scraper (click, hover, input). They've been added since the last time I used the Bardeen sraper, and I can't find anything on what they do or how they work. I skimmed this video but couldn't find it here. Can you point me in the right direction?

[@Bardeenai]

There is a drop-down menu with "more options." You can find it here: share.cleanshot.com/19HTjmLh

[@gadizalman7420]

How do you load links to scrape from Google Sheet instead of copy paste into "Provide Links" action? I followed the instructions in the video and built a scraper which I have to copy paste the links to scrape into "Provide Links" action. I would like to find an action which connect a list of links (Google Sheet) to the "Provide Links". Thanks a lot for the information! it's an amazing tool!

[@Bardeenai]

Hey Gadi! Here is exactly the video for this use case: kzbin.info/www/bejne/mWqsda1uesShm80&ab_channel=Bardeen

[@yahiammarey9595]

That is really great. What if I want to scrap email address and contact details?

[@Bardeenai]

You can do this, if the information is displayed on the page.

[@nj595]

Does it support regional languages?

[@nsdesignstore7815]

How can I scrap emails from Google business profile?I want to contact businesses with bad reviews.

[@phokavn]

can you make more detail Scrape data etsy, amazon to google sheet

[@Bardeenai]

We have a pre-build scraper template for Amazon. You can build an automation without having to build a scraper template. Just got into the builder and type "amazon" in the scraper template argument.

[@JeffKang84]

35:08 "you can grab the link to the post text itself, and the link if it was listed, but not the link to the post itself". "and the link if it was listed" What is that a link to? It's what "Get Link" is pointing to. Is it a link to a transient version of the post? Where the posts still have "…see more"?

[@afrosymphony8207]

please can you make an indepth video on use cases for datascraping.

[@Bardeenai]

Tell us more about your use case, please.

[@afrosymphony8207]

@@Bardeenai thats the thing i aint got no usecase cause i barely even know what datascraping is lool. like how is this benefiial and to whom. i know some people make money scraping the web but for why?

[@danyt19]

For an infinite list that loads as you scroll, can you specify the pausing time between scrolls?

[@Bardeenai]

Yes, you can set up a delay in the action set up. The argument is called "Custom Delay In Seconds". share.cleanshot.com/HNshqZQT

[@camiloriano-galviz9851]

Hey, thanks for the information. Very helpful. I am trying to scrape a pop up (same URL as the original page). How can I scrape the pop up correctly? Have a nice day :)

[@camiloriano-galviz9851]

In a list set up*

[@Bardeenai]

You should be able to scrape pop ups without a problem if they are visible using the standard scraper template. You can also use click actions to open and close pop-ups.

[@kimberlyjones4112]

Hi, Can this template be programmed to scrape various social media platforms by category for individuals full name, email address, cell number etc.? As well as, collect the same information from members, followers, anyone who's left a comment/reply etc.? It would also be nice if we could extract the same information from other platforms such as Amazon, Etsy etc.

[@Bardeenai]

Unfortunately, you need to create a separate scraper template for each website.

[@mahamriz964]

can you please show us how to scrapw data like emails from a prospect list of website url's? I am unable to do that

[@Bardeenai]

Here is a video: kzbin.info/www/bejne/lYSZZqVmqteYrtU&ab_channel=Bardeen Hope it helps.

[@carlos_mann]

Is there a way to automate, a template, that automatically downloads the data / media?

[@Bardeenai]

Please share the use case. Where do you want to get the data from?

[@carlos_mann]

@@Bardeenai A subscription based platform that I pay monthly for & login to access the data. However I have to download each individual file one by one, (of course after login). Curious to know if I can have a template that I pull up and it can download each item automatically to the designated folder location that is assigned to the download to be saved. Hopefully that makes sense.

[@sandeep22584]

Nice scrapping dear can i scrapped linkedin post also ?

[@Bardeenai]

Yes you can! It’s one of our very common use cases. www.bardeen.ai/playbooks/save-linkedin-posts-from-search-to-google-sheets

[@juangoodtrade5571]

Is it possible to have more than 2 scraper in one automation? i.e. Category - Sub Category - Individual Product

[@Bardeenai]

Yes. It's called "Deep Scraping." First extract a list, and then use the "scrape in the background" action to visit each individual page in that list.

[@Jimmy-ys2dn]

looks simple, but damn what a complicated UI, am i the only one?

[@marysmith3710]

Will this information automatically update? Do the computer need to be on?

[@Bardeenai]

The scraper extracts the information once. But if you want to track changes, you can try this automation: kzbin.info/www/bejne/eZK6hpibaN-qoqs

[@zone66]

does bardeen allow to retrieve dynamic input parameters for the list page scraping ? for example: prefilling form-fields of the search field with help of an input csv file, or by retrieving input data from a given url ?

[@Bardeenai]

- Bardeen doesn't support CSV as an _input_ - Bardeen doesn't have _dynamic_ form filling capabilities yet (we are working on it)

[@anon-wi8mg]

i have an issue with the paginations, it only goes up to the 3rd page

[@Bardeenai]

What website are you trying to scrape? Please share so that we can look into that.

[@sls700brabus3]

the websites will just block you or start a are you a robot puzzle. So this thing does not work. I had many ideas of scraping in past, its just not possible because of the puzzle-

[@MarkErroldLazareto]

can i use vpn to prevent it?

[@richestmotherfuckeralive]

Bruv if want linkedin leads i have about a billion do you want it

[@Basit7]

I dont get the prospects for outreach option

[@Bardeenai]

Please tell us more about your use case.

[@MadhavMayur]

Does it works with youtube data scraping

[@Bardeenai]

It does. Here are all the KZbin automations: www.bardeen.ai/playbooks?integration=KZbin

[@hariomgupta4677]

Hello sir I need your help I want to extract phone number all group members how can i do and this software is Free ❓

[@MdShohebUddin]

I also need phone number and email address as well.

[@siddharthakar9369]

Can anyone please tell me how to scrap the details of the linkedin page especially the followers of the linkedin page which I own

[@Bardeenai]

Is it a LinkedIn company or a profile page?

[@UmairAliUGINTL]

How to extract emails from linkedin profile?

[@Bardeenai]

Yes. If it exists. We are also working on email finder integrations.

[@lilianxx8073]

Many of them are very good ideas, but the app still has quite a bit bugs. Hope it gets fixed and better soon!

[@Bardeenai]

Lilian, can you please share the bugs you've encountered so that we can take a closer look with the engineering team? This is a good place to track the status: bardeen.canny.io/

[@sandymakesplans]

​@@Bardeenaido you all plan on deploying a mobile app ?

[@siddharthakar7190]

Can we scrap the followers from LinkedIn Like I own a page or say someone else

[@Bardeenai]

Yes, you can. :)

[@siddharthakar7190]

@@Bardeenai wow thanks Do you have any links for this ?

[@d1m18]

LinkedIn only examples?

[@Bardeenai]

The scraper can extract information from almost any website. :)

[@shoaibyehya3600]

does it allow to extract comments from facebook ?

[@Bardeenai]

Yes.

[@swapnilk3683]

to do this all manually one by one 😢 that's my job ... cuz e-mail ID is important in this all to generate one lead

[@Bardeenai]

What website are you scraping?

[@swapnilk3683]

@@Bardeenai LinkedIn m using.. everyday arround 100 leads in 9 hours but i have to do manually one by one so it takes lot of time to generate and to find e-mail

[@DueInfomation]

There are much better once's that get emaill addresses.

[@awesome-brs]

The info it scrapes from Linkedin is pretty useless. The gold is in the contact field. Scraping that would be impressive as it usually has the email address and phone #'s.

[@Bardeenai]

Spot on Bobbie. And the good thing is that Bardeen actually scrapes that info too (and uses a click action). Here is the automation: www.bardeen.ai/playbooks/scrape-linkedin-profile-to-google-sheets

[@awesome-brs]

@@Bardeenai very cool. I will check it out. Thanks.

[@rovlad]

I swear this software while being probably amazing it's so fucking stupid when it comes down to grabbing data from a menu... ridiculously difficult

[@Dropdabrickonyotoes]

Wayyyy too expensive not scalable

[@deepakshetty53]

Is this free

[@Bardeenai]

Yes, there is a free tier. Here is more info: www.bardeen.ai/pricing

[@lunitajungleexperience]

Hi, i just discover Bardeen and i literally fall in love with it. I see all the tutorial...SUPER WELL DONE! everything works super well but now i'm stuck because i need to get all the link to each facebook page of my contact but on messenger i need to click on the name to open the page and get the link to the page, do you have any idea? Basically the link to the fb page is inside a list that the page download just when i click on the name so i really have zero idea on how to do it:( Could you help?

[@Bardeenai]

Thank you! Have you tried the "click" action inside the scraper? You can use it + custom delay action. Here: share.cleanshot.com/jG1Dt5m9