How to scrape large volumes of pages using Axiom.ai

[@danledbetter8431]

If one wants to scrape a google search for a specific type of business, beyond scraping the the search results that yield business name and the blurb about the business, are you able to also scrape the phone number and address that appears only if you click on each business’ link in the search?

[@Browserbots]

Do the following 1. Add an 'Interact with interface' step 2. Add sub-step 'Get data from webpage' in the interact. 3. Add a 'Click Element' to reveal the data 4. Add another sub-step 'Get data from webpage' to scrape the phone number etc.

[@brettott9335]

is there a way to run an axiom automation to perform an action on multiple tabs that are open in a window? Currently, whenever I run the axiom, only the one page I start the extension from gets run.

[@Browserbots]

Axiom opens a new browser instance. You can use additional "Go To Page" sub-steps inside the "Interact" steps to open new tabs. There are also steps to switch between tabs and close them.

[@brettott9335]

@@Browserbots is there a way/ how could I gather the urls/ apply to All of the tabs I have open in a window?

[@JoshuaBates01]

I keep getting hit with the linkedin login wall after several runs, any ideas?

[@Browserbots]

Sounds like you are logged out and hitting the LinkedIn rate limit.

[@Browserbots]

You can start with this template axiom.ai/recipes/web-scraping-in-batches.html

[@bashvlas]

Very interesting :)

[@arslanaliwarsi6309]

Is it free or paid?

[@Browserbots]

Thank you for your question, Axiom is a paid for service.