Web Scraper intro tutorial

[@wispme]

this is so useful. thank you for making this extension.

[@Derek_Read]

The selector tool didn't show up for me until updating to Chrome 87.0.4280.88 However, prior to this it was possible (though very annoying) to manually enter values for selectors. Very nice tool. It would be nice to be able to configure which columns are output to the CSV file, as I am finding there is data in there I don't want, specifically web-scraper-order and web-scraper-start-url. It might also be useful for some people that have created a site map already to be able to eliminate columns from output without having to edit selectors before running a scrape. I'm thinking perhaps just listing each column prior to the actual CSV creation so that people can uncheck a few that they might not want for this particular scrape. Of course this can be done afterwards in another tool.

[@shashrandi]

Thanks! Very helpful tutorial!

[@En1minute]

Hello, je passais par ici pour voir un peu les tuto qui existent et potentiellement me donner des idées, et franchement ta vidéo est très sympa :) Perso je me suis lancé un défi de faire un format très court : des tutos en 1 minute ! C'est pas toujours évident ^^ Bonne continuation ! :)

[@samshteinman2132]

Great tool thank you I just used this! Is there a way to only export certain columns? I do realize I could edit it in the CSV viewer but would be nice to have the option to export certain columns :)

[@brandonfoy9583]

Incredible! Thank you so much!

[@lippe-tripreiseninlippe670]

Found the Holy Grail!! Thank you so much :)

[@v1s1v]

Pretty cool. I've been using Kadoa's AI scraper, which works super fast out-of-the-box. But I'll try this too.

[@jovin3440]

It's a great tool, but I'm facing problem while extracting image in a site . The site use different url, it loads text from url 1 but it loads image from url 2 and uses css file to load the image. Could you please making tutorial for it. Thank you.

[@CodeWithBehram7497]

I do data entry job and web research i think this tool will be perfect for my web research job...

[@simon5582]

Im trying to scrape the easiest site, it wont let me select links on the page? How hard can this be ?

[@NotaMiamiBiker]

Hi, super cool extension! Do you have any examples on how to use it on Google maps? I'm only able to get the first result. Not sure if the problem is that I´m using the first action as Element Click. Many thanks!

[@zel6274]

Tutorial was very clear simple, thank you !

[@annakrivets6374]

Hi! It's a great video! I have an issue with links opening in the new tab I tried to use popup link selector but it seems it just opens a new tab and can't actually extract any data from there. Are there any tips? Thanks in advance!

[@willhunter2588]

is there a work around for if when parent goes away once selected?

[@user-dh8vn3oz2k]

Thank you for a useful tutorial VDO.

[@user-hj5xy4xi6k]

This is awesome. We don't need to code anymore!

[@philipdodson7870]

Nothing happens when I click select and click on the menus. I'm using the same test site.

[@abanksob1]

how do i add pagination link?

[@rodparker6130]

Installed the extension, then that's it. I do not have any options to do anything but learn how to use it, did that, still can't do anything.

[@Bill-fh5nu]

At 1:32 of the video we are told to select categories, but that's not possible. A grayed-out screen appears on my monitor and "Click here to enable hotkeys" appears. Also, when I attempt to hover my mouse over the grayed-out area, nothing happens. Looks like these instructions are no longer valid. Webscraper if you read this, please update your instructions. Thank you.

[@simon5582]

same waste of my time

[@awakenwithoutcoffee]

there is a check-box near the bottom that you need to click. I had the same problem but found it rather quickly. Strange design choice I admit. Better late than never ;)

[@harrywhelpton7420]

Hi, thanks for this. When I go to run the scrape, it launches the pop up but then closes and says 'no data scraped yet'. What have I done wrong?

[@patrickmccartney7544]

can this tool be used to scrape example sentences from an online searchable dictionary?

[@amitsharma-amt]

I have scrap data but my lappy has shutdown, that's why I have scraped half data, how to select remaining half data, while I have selected then its selected automatically all data. Please reply me asap. Thanks

[@Imprudente22]

how could i upload the information to a website?

[@BigBoss-gb4cx]

Is there any good way to make this automatic ? Or any desktop app (even paid)? Or any way to save website or category profiles?

[@billyjack2872]

how to scrape multi image from 1 product like from aliexpress if 1 product have 5 images src and i need group ini one cell separated with comma

[@user-lu7by9rz4j]

how about other i want make tutorial for elment click ant other things ?

[@TheWindsurfk59]

Selectors simply don't work, uninstall :( disapointing

[@vineetkumar-ij6fy]

update your browser

[@fiatkid]

@@vineetkumar-ij6fy Doesn't work weel on shopify stores

[@josedc7100]

Hello, i dont know why, but i can't make a click when i try yo webscrappe a page 😐

[@yohanessiswoko5758]

how to do scrap data that doesn't appear on the web right away, but instead has to fill in a kind of search field and the data will come out?

[@tutushism]

How does this scraper handle pagination? I have Primary categories (Multiple) with products in it (Page 1) and then it has all the rest of the products on next pages (page 2,3,4,etc)

[@TruongPLS]

I have the same issue, plz share if you have solution

[@TruongPLS]

What should we do with the long list? For example, Page 1, Page 2, ... The final Page?

[@jabircp]

😍 time saver

[@TheWaqaspuri]

how to actually do the things with drop down menu, if need the web scrapper to hover over the main menus and click (link) each sub-menu and move on..

[@tordthelord]

Do you have to re-scrape the website every time f. example prices and stock numbers change?

[@BigBoss-gb4cx]

Do I have to select one by one all the prodcuts?

[@Paltibenlaish]

hi thanks fo sharing in min 2:46 how do you select all the thumbail auomaticaly???? thanks

[@hongshan2993]

Select two same type elements, then all the other visible elements of the same type will be automatically selected.

[@thewookiee78]

Nice tool. The tutorials show how to scrape: (a) one page of products for multiple categories, OR (b) multiple pages of products for one category...HOWEVER.. How do we scrape multiple pages of products for multiple categories? As this would be the structure similar to the majority of ecommerce sites. I have tried a few approaches, however nothing works. Any tips? Thank you!

[@WebScraper]

Hi! Watch the intro tutorial. It shows exactly that. Basically you can use as many Link selectors as needed to navigate through multiple levels of categories and then use Link selector to go into product pages and text selectors to extract product data.

[@thewookiee78]

Here is the issue: The 'Intro Tutorial' doesn't discuss pagination, it shows how to scrape multiple categories (one page each). While the 'Pagination' tutorial sets the category as part of the initial 'Create Sitemap' step, thus there is no discussion about pagination for multiple categories. Please advise or feel free to correct me if I am wrong! :) For your reference, here is the start URL I am trying to scrape all pages from all sub-categories on this page: www.lazada.co.th/shop-makeup/

[@ashaanahmed9951]

@@thewookiee78 Did you manage to figure this out?

[@aayushhumagain7291]

Thanks a lot!!

[@Naiemaa]

does it work for more than 2 levels? (if there was sub sub-categories)

[@Just_Moh_it]

Yep...

[@vicolin77]

I hope understand this tools, will simplify my job too much

[@muawiyyaabubakar2532]

nice, but am getting the following error: Error: FAILED_TO_CONNECT_TO_CHROME_TAB {"message":"Could not establish connection. Receiving end does not exist."}

[@freshfast6197]

Please upload tutorial for sitemap

[@coachgeflores]

I loaded web scraper and rebooted my computer. It installed the extension but when I fo to developer tools and I do not get the sitemap.

[@mixbag322]

Seems to be a helpfull video, but it shows a message "Move developer tools to the bottom of your browser to start using Web Scraper" but it doesn't work wherever I move to tool, appreciate if anyone can help, thanks.

[@the_school_of_life8659]

you should click on the 3 points than choose to move the develepement menu to the bottom of the page

[@ashkaryilmaz1446]

Hi iam only able to return 50 data while downloading to csv, can u please advice

[@raski3872]

great video

[@khansaafifah3897]

how to get the star rating number?

[@reselliciousyoutube4328]

Keep getting the error "cookie sent in cross-site context will be blocked in future Chrome versions" when I press the scrape button. Would a cloud subscription get rid of this? It won't scrape anything due to this.

[@prcvl]

Is there any way to disable the selector snap bc its always including the search parameters

[@Just_Moh_it]

What do you mean?

[@aleksandars9254]

Amazing tool man thanks!

[@restyourmind8988]

Hi, I have more than 300 elements on the page but when I set up everything and click on scrape, it gets only 1 random element and stops

[@lisaledezma9826]

will this get me blocked from a website if I do it every day? (Not Amazon) but other websites

[@annoyed707]

I cannot find any 'web scraper tab' in developer tools.

[@HOLBAG]

i dont see new page web scraper when i when I click on scrape button, i see new pop page same name website en disappear immediately any one know please to help!!

[@lalach.com.7192]

how to get a contact number when its in element and you have to click first then it will show the contact numer. please advice. on the other hand its grttttttttttttttttttt app

[@lynju_]

i downloaded it and added as extension but dont see it under more tools. help me

[@Trfggdeggh]

My interface doesn't look like this 😓😓😓😓😓

[@nguyetluu8138]

Hi, I'm trying to scrape number of followers for every user who has posted using a specific hashtag on twitter. I got it to work however the number of users it scrapes is very small, I don't think it scrolls down automatically. Could pls tell me how to fix it? Thank you. Really appreciate your tool!!

[@nguyetluu8138]

i think it got smt to do with create a selector of Element Scroll Down but I can't figure out the structure of the sitemap yet

[@fragrancejewellery]

Great job! But what if there are Paginations? Thanks!

[@Just_Moh_it]

You can select all pagination tags and check select multiple. When it goes to the next page, the links automatically increase. So it will end up going to all pages.

[@valeriovarchi1508]

Adoro!

[@Iestynity]

Can I use this tool to download images somehow? I can get the links for the images but what do I do from there please?

[@user-fj3bq1mf2m]

How to scrape more than 1 images in the product?

[@shenzhenmega5050]

I'm getting this error Error: FAILED_TO_CONNECT_TO_CHROME_TAB {"message":"Could not establish connection. Receiving end does not exist."}

[@onojioboardwalk9748]

YOU ARE MAKING THINGS TOO-COMPLICATED for what people simply want, Good GOD man!

[@astroari]

I get this error after start scrapping? No data scraped yet. what to do

[@zvit]

The scraper doesn't show up on any Amazon page. Why?

[@joaoguimaraes2974]

O need to extract data from Google Play Store. Is it possible?

[@sinac.]

What if the link opens on a new page?

[@matthewolson699]

Under Selector make sure you hit the select button to the right of it.

[@umeraamir6483]

before use this extension I expend some money "I am right or not" plz tell me

[@jinyaolu829]

Hi, i realised this only managed to return 50 results at a time for me, how can i solve this?

[@ashkaryilmaz1446]

Yes the same issue happens with me while downloading to csv, can anyone advice on this

[@TheRushabhy2k]

now how you can do for zoominfo, can u pls upload video for zoominfo scrapping, and is it possible to do?

[@bkxornam]

Can't see anything

[@SleepyBoBos]

I want this guy to narate my life

[@VitorPinheiro-qu4fu]

What about Dynamic Content ? Dynamic Content is my Nemesis.

[@timosworld3390]

how to scrap all product reviews from a ecommerce website

[@HERRYARYANA]

thanks u so much... how to download and upload image. ?

[@WebScraper]

Here you can find image downloader script and a tutorial on how to use it github.com/webscraperio/image-downloader

[@ufopiloot]

could not get data from a table

[@theisy8928]

1 images? What images?

[@naeembabakheil]

nice tool .. i am new to scraping..

[@rodparker6130]

I can't even get table info from one page, for a product that is this expensive it should at least work, it works on your sample site but not many other sites, waste of time.

[@lalineaa]

I'm sorry guys, but this is difficult to follow.

[@Philson]

Doesn't work.

[@Mykilll]

Will this work on y.e.l.l?

[@Romanreigns-uz1gg]

what about Google maps

[@user-lu7by9rz4j]

yes and other site like that khsoosi.com/teachers ????

[@ahtiramqureshi7788]

Am getting error 200

[@lpernrfaliboy3077]

positive

[@apotato5435]

at 4:49 / 5:29 ,when i clicked refresh button.it still says no datascraped yet

[@WebScraper]

Watch the scraper window and wait for the scraper to visit at least some data pages. You probably hit the refresh button before the scraper went into a data page.

[@amin.h4020]

@@WebScraper I had the same problem, even after it says the scraper is done, still when I click on refresh it says no data scraped yet!!

[@amin.h4020]

@@WebScraper I guess it's maybe because when we go to other products pages to check if selectors work, when we click on data preview, everything is gone and it says "null" instead!!

[@davinci8283]

i can't find the web scrapper tab on my chrome developer tools any help

[@Tigrie5934]

Did you download the webscraper extension?

[@DavidBertossi]

This is the voice of @picturefit isnt it?

[@Korpenko]

It looked promising but unfortunately didn't work on a large dataset.

[@elizabeth_is_1111]

where is developer tools on windows

[@user-bj4lp3fr1o]

The text is so faint, I had trouble reading it.

[@maazahmad9756]

you should have zoomed in

[@Truth-qe6sf]

is this completely free?

[@rafaeldearaujorosa]

yes

[@NielsGx]

extracting a list of links is not scraping, wtf. It does not extract the html or any content........

[@tagatamenikimihanaku]

too fast for explanation......! but great extension!

[@angelg3986]

Isn't it illegal?

[@productdirector]

Good, but TOO complicated!