Scrape Any Website for FREE Using DeepSeek & Crawl4AI

[@HarshKumar-j2r5g]

was searching for this from a week thanks man

[@jrcoimbra]

Amazing content as usual!

[@adamgdev]

Great video per usual!

[@HenryPham92]

I have an issue when running main.py that always shows 'Invalid API Key,' but I double-checked that my API KEY is correct.

[@orlandoagostinho]

Amazing! You are a rock star!

[@JNET_Reloaded]

:/ I cant save your video to a playlist turn off option made for children / kids or w.e this prevents playlisting thats all it does! ty

[@bhancock_ai]

Hey! All of my videos are set to “not made for children” so I’m not sure why it’s giving you that issue 🤔

[@alexandraspalato]

Just what I need!

[@vladoesgrowth]

LGO! Do you know if it works with proxies and authenticated users ?

[@HarshKumar-j2r5g]

let me know if u found that

[@HarshKumar-j2r5g]

: Enables dynamic proxy rotation to avoid IP bans and enhance security during web crawling. found this

[@eraclee]

Expensive way of doing scraping

[@abbcc555]

It''s the css_selector which is typically the problematic part. I was kinda hoping this crawler would use AI to somehow magically deal with randomized class names etc. edit: I know there are things like scrapy shell but it's a bit tedious.

[@TauvicRitter]

It's weird to use AI and then it requires to specify a model. AI is intelligent. So why not just say: extract all relevant data and put that into a suitable format to the AI. If you have to specify the format then you could also take the extra steps and extract the data with some xpath statements. That will save the cost of using AI. I guess technology is not that mature yet.