I am able to see Selenium Grid interface at port 4444/ui but after a few minutes, the droplet stops responding and then I have recycle the droplet and run docker commands again. Can you please suggest any fix?
@potentpagesАй бұрын
That almost sounds like a memory issue. How much RAM do you have on your droplet and how many connections are you connecting to your instance?
@freeonlineserverАй бұрын
@potentpages it has 1GB ram, 25GB disk, and there is not load, I am just testing the script that you have provided on your website. The script produces timeout error. I am able to see the ui in the browser when I visit the IP on port 4444
@potentpagesАй бұрын
If it's still accessible on port 4444, but you're getting a timeout error, that sounds like a firewall issue. Are you running the script on the same droplet or a different computer?
@potentpagesАй бұрын
It's a RAM issue. I just ran through the entire setup/script process with your Droplet configuration. It doesn't work on the 1GB RAM droplet, but it does work on the 2GB RAM droplet.
@freeonlineserverАй бұрын
@@potentpages ok thank you, I can increase RAM and then try again. Thank you very much for your instant help :)🏩
@goracyarbuz94611 ай бұрын
Is it possible to bypass clooudfllare using php-webdriver?
@potentpages11 ай бұрын
The short answer is yes. Selenium/php-webdriver/Chromium will send the correct headers and enable Javascript to get past most Cloudflare blocking, since it usually shows up as a regular browser. The more complicated issue is that if you're using a commercial IP address (think a VPS) or a flagged IP, you'll still run into issues and need to use proxies. But it does a much better job than a simple curl request with Cloudflare.
@tienanhhoang52643 ай бұрын
@@potentpages Can you briefly guide how to use php-webdriver to bypass cloudflare?
@itsmestevieg81 Жыл бұрын
Nice video, ive never used this, handy to know as sometimes i do crawling in php too thanks