Awesome! I’m excited to try it out. Thank you for all the effort and time on a scraper that will actually SAVE me time. Cheers
@digicinematic4 ай бұрын
Wow. This is a nice project. Well done. I especially liked the Ollama implementation.
@smurththepocket28394 ай бұрын
Wow super impressive and well structured!
@johannes_812 ай бұрын
Does the scraper also work with SPA websites? Many pages must first be rendered by JavaScript before the data can be processed.
@nayandeepyadav87904 ай бұрын
does it send full html code to model, or first sends dom xml tree, then asks for xpath to get the texts, then asks to format data, a small video on how it works internally would be helpful either using power point on canva or whiteboard.
@ScrapeGraphAI4 ай бұрын
Sure! I will add it to the list ☺
@amhajiTV4 ай бұрын
This is excellent work
@adriangpuiu4 ай бұрын
a more indepth example of using open sourced model with ollama would be usefull for the entire comunity. use cases : scape from external file that has multiple URLS without having to embbed , etc
@tharunbhaskar67952 ай бұрын
This is interesting, thanks for the library
@actorjohanmatsfredkarlsson22933 ай бұрын
Cool. So this is a graph!? Is there en example how to use more complex edges for a scraper?
@madhudson13 ай бұрын
How does it fair iterating through multiple sites with SmartScraper and with slightly more complex queries?
@duncanmaina76174 ай бұрын
Is it possible to set the schema for our json output. similar to what you'd get from instructor?
@0xgenji8 күн бұрын
can this scrape information from ? thanks!
@thomasmortaro75972 ай бұрын
it will work on a website with login section?
@pokeytradetf25824 ай бұрын
Is it just 1 page? Can it go down a line of links from pages?
@abdulmanan25892 ай бұрын
sorry but yes, I tried
@barderino56734 ай бұрын
Italiani OWO
@CM-zl2jw4 ай бұрын
Darn … your knowledge and videos look potentially excellent but your accent make it impossible to understand. My grandfather had a thick accent when he immigrated and I recall him talking about how he practiced speaking English in a way that he got rid of his accent… these days you can probably just use ai but it’s up to you. If you want to grow your channel for English speaking people I would highly recommend you make yourself understandable. I hope you take this as constructive criticism because you have amazing potential. Thanks.
@SteveBryant-x6d4 ай бұрын
I am actually closing the video for the same reason, I just can't hear or understand.. I will be opening the github to see about possibly reading the docs. IF there was an AI to fix the audio level and change the accent it might be great info, but I don't know.
@CM-zl2jw4 ай бұрын
@@SteveBryant-x6d I think there are many options for using AI to clean up the audio. 11 labs comes to mind and I’m sure that there are others. It’s a simple speech to speech AI. So the person creating the video can either type in the audio or just talk and it will convert into a more understandable English. Hopefully this makes sense. Thanks.
@MrJohndoe8454 ай бұрын
His english speaking skills are just fine, but the audio quality is terrible. There is a high pitch tone throughout which is likely from a bad mic; it’s clear he didn’t bother to send the audio through any processing pipeline. My recommendation would be to use the “studio audio” feature in Descript.
@ScrapeGraphAI4 ай бұрын
Hei thanks for the criticism! Actually this video wasn't meant to be published on KZbin and we were asked to do it quickly. For sure there is a lot of room for improvements :)
@ronilevarez9014 ай бұрын
I'm not even a native English speaker and I understand everything perfectly so I'd say it's you who needs to improve his English to understand better other accents 😂 And it's very simple to prove: the automatically generated subtitles get most words right so the accent is just fine. However I did need to rise the volume to the maximum to hear clearly.