Selenium Browser Automation in Python

In this video, we learn how to automate website interaction using Selenium in Python.
◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾
📚 Programming Books & Merch 📚
🐍 The Python Bible Book: www.neuralnine...
💻 The Algorithm Bible Book: www.neuralnine...
👕 Programming Merch: www.neuralnine...
🌐 Social Media & Contact 🌐
📱 Website: www.neuralnine...
📷 Instagram: / neuralnine
🐦 Twitter: / neuralnine
🤵 LinkedIn: / neuralnine
📁 GitHub: github.com/Neu...
🎙 Discord: / discord
🎵 Outro Music From: www.bensound.com/

[@alex59292]

(pin this) you can use sellenium undetected driver since most websites detect normal selenium, this uses your normal chrome and not fresh private chrome

[@okrq]

How do you do that

[@coding1806]

@@okrq fcking go make research

[@krishlorend.sinevasan6945]

how?

[@tangoalpha1905]

I have been searching around trying to find a solution for this. Someone come and bless us with the knowledge!

[@ImTheRealCam]

You do know it’s so easy to search pip’s for python… btw the thing you 3 have been looking for is selenium_stealth.

[@DavidBacarella-v7z]

My compliments on you your video. It was focused, enabling, and well thought out. The only thing I want is "more" of these awesome vids. Thank you!

[@TH-nl1sb]

I always had a difficult time finding the right HTML elements by myself. I wish I had known you earlier. I will continue to watch all your videos. Thank you! You are a great teacher!

[@knalsgtes6684]

same here

[@suavisgiramata8802]

He is a very good teacher!!!

[@knalsgtes6684]

I have search so many tutorials on selenium as reference for our automation project,, and this is the best ever tutorial.

[@koupohroyandredavid2639]

the best ever

[@Delirium132231]

For selenium users: Action Chains is a nice discovery for those who didn't know before. Ofcource if FrontEnd developer was a nice guy

[@garyhottinger7384]

Excellent! Clear and concise. I just retired and can't wait to see if I can automate some of my hobby web work.

[@lamar2658]

Hey if you could do a video on XPATH and maybe the professional ways to load and sync tabs that would be great! Very helpful and useful video!! Going to use this for sure! Thanks

[@DavidBacarella-v7z]

My compliments on your video. It was focused, enabling, and well thought out. Thank you.

[@imanthiu]

I learned a great deal from this video. It didn't help me do what I was I looking for but I always like learning new things.

[@neatcomrade8537]

Dude! this video is exactly what i needed! thank you!

[@ibrahimib9020]

thanks man... it helped me a lot. I was starting to learn this but cannot find the right syntax to view the page. but this worked for me

[@mr_cupcakes1808]

bro's teaching is awesome thank you!

[@heyalejandro175]

So cool...thank you very much for this...Yes an XPATH video would be amazing! Thanks again!

[@codehokage1977]

Question when finding the "7 in 1" button why don't you just copy the xpath off the inspector tool?

[@ShahzadAli-zr4ro]

you are great teacher of this century on youtube please let me know if anything i can do for you

[@ucxanguyen2395]

What a great video. Super well explained, thanks! Any video in your channel on how to record yourself with soft soft? I'm under the

[@sonerkocak5058]

Thank you! I am your fan❤️🫣!

[@freecreator6426]

I applied one by one, but when clicking "run" it says that the module is not defined. Tried many times.

[@musicarroll]

I think your selenium tutorial became an XPath tutorial.

[@Relderf]

What a professional video, neat.

[@JacobJavor]

Thank you, was good introduction

[@ghefley]

Well done and thank you for sharing this.

[@mkhadka123]

This is nice to get a kick-off

[@pruzylo]

Perfect video length.

[@Vibeness1]

why use xpath to find the object names instead of e.g. EC.text_to_be_present_in_element ?

[@karlybyrd1551]

I apologize if this is a dumb question, but why would you not just search for the link you're trying to find instead of searching for the link inside the correct div? That seems like an extra unnecessary step that just led to finding the link anyway.

[@HAInett]

that is what I needed :)))) thank you so much

[@ToobaNaseem-pe7kn]

please guide us how can i automate the process of connect wallet(metamask). in my chrome browser i have installed metamask extension while in the process of automation, automated chrome driver do not have wallet extension. please guide us regarding this process.

[@MrAybebs]

why you dont search the elements with dev tools?

[@DKMRFCBrlz]

Amazing video!

[@GabrielAGilO]

do ahve you encounter this error before "NoSuchWindowException: Message: no such window: target window already closed from unknown error: web view not found" I have try to put many URLs but I keep getting the same error. i have looked only and I thought by adding the Service and Options would work but it did not, Any help

[@firstandlast4435]

I don't know. My browser just closes right after finishing script. I use from selenium.webdriver.chrome.options import Options chrome_options = Options() chrome_options.add_experimental_option("detach", True) browser = webdriver.Chrome(service=Service(ChromeDriverManager().install()), options=chrome_options) but it doesn't help at all

[@buzzark9133]

Same, and no matter what I do it always closes after whatever script i put down. If you find a solution please let me know.

[@buzzark9133]

Hey i just found a solution, let me know if you wanna hear it

[@firstandlast4435]

@@buzzark9133 it'd be nice)

[@firstandlast4435]

@79_22_16 M for now i found that you can place infinite loop after code, so your script won't be finished and browser won't close, but that's definitely awful decision)

[@buzzark9133]

@@firstandlast4435 ^ you too, check the reply above

[@xxjblexx]

I Hope You Do A Video On XPATH Asap... That is The Core in Selenium Library To Find And Search Elements

[@faridalijani1578]

are u running Chrome as administrator or user in ur machine? I open the browser but nothing is shown and it crashes after a while! I use conda btw

[@nabilpro1662]

The best as normal ❤

[@doudline2662]

Thank you sir.

[@szwyr8380]

Why don't you just click the element to get the copy of the xpath ?, i mean u just right click on the div tag or another tag and then copy the xpath... Or it would be a better way to just read on the inspect element ??? Because i new to this and didn't understand about this xpath things

[@mehdismaeili3743]

Excellent, thanks.

[@soumyaranjandash3597]

Thanks this is helpful 🔥

[@adisonfryman144]

OK why do you put the install in there, I just ran this code and got .....Downloading: 100%|██████████| 6.79M/6.79M [00:00

[@adisonfryman144]

also the window did notstay open

[@thefunnyvlogger8218]

Please can you tell me which framework we are using here?

[@bhasim4299]

Chrome driver didnt work, but firefox did. just saying

[@mpumi1024]

Awesome

[@fakhruddindahodwala6816]

How were you able to format the html elements in your output terminal window? i get all the characters showing up line by line

[@amerismartin2854]

How do I make selenium open default chrome profile? Or desired chrome profile?

[@ArneSchwarck]

Do you know why even if detach is true the chrome window will close if a KeyboardInterrupt is sent in the Terminal window?

[@petrokey]

Hello, can you please advise on classic web scripting on python? Any resource or link..

[@madalinam5418]

how can you deploy it and run recurrent on a server?

[@jamesmoisesllalleperez3079]

y si quisiera que guarde información en la misma página?

[@TestSubject-ik4oq]

For the site i am trying to do i get handshake failed

[@mrrl37]

Thank you

[@RocketLR]

Aah wish i found this earlier. Had a site that needed java script render for the tables to get populated with the data.. The online solutions did not work for some reason.. Got a bunch of chromium errors and stuff.

[@JontheRippa]

Wow thank you 👍

[@jamievercetti]

is there a more explanatory version of this video

[@sonerkocak5058]

Will there be an Instagram entry in the next video?

[@CanlDersler10SnfPrivate]

Selam

[@sonerkocak7392]

@@CanlDersler10SnfPrivate selam

[@hansilsepp]

Es scheint, dass es ein Problem mit dem Webdriver-Manager gibt, der versucht, eine nicht vorhandene Version des ChromeDrivers herunterzuladen. Ich habe Chrome 117.0.5938.92 gibt es da eine Lösung?

[@isro3085]

Hab auch das Problem, hast du es lösen können?

[@hansilsepp]

bin mir nicht ganz sicher, ob das die lösung war oder ob ich das problem nicht lösen konnte: man kann den webdriver auch sonst manuell ohne das managermodul von python instllieren (exe herunterladen), link der website weiss ich leider nicht mehr, allerdings muss man das nach ca. 1/2 Jahr immer wieder manuell update (neuer driver installieren)

[@swordart802]

i want to use in real browser not in chormedriver how can i when i tried it doesnt get the url after browser opened

[@hesam8845]

how can I scrape google map to get contact info in specific city?

[@your_butter_chicken]

Hi, how to capture Screenshot in this new selenium IDE? Pls help :)

[@aleterra]

is there any way to solve the captcha?

[@Zhacker0927]

I got error WebElement object is not iterable > help please!

[@kwameappiahkumi5833]

Does selenium work only on Google Chrome❓

[@mkhadka123]

no it has drivers for other popular browsers as well e.g. geckodriver for firefox

[@tulasisanjay]

How can I automate the process of claiming Binance Crypto Boxes on their webpage using code extracted from Telegram?

[@tulasisanjay]

Make video please 🙏

[@humpalestine]

It would be better if you share the python script you are describing.

[@66abady]

thanks man. I really wanna know if we can use this method when we don't have a browser installed. lets say if I was to deploy this script on a sever.

[@codaq4043]

Yup, you need to make it headless and host the script on aws

[@jw200]

thanks, subbed.

[@sever5859]

Interesting video

[@robertharrison1601]

As in QUORUM of NINE¿?

[@user-uw5qc5vq6w]

Which platform is that in which you are coding??

[@browserautomate]

PyCharm

[@UR-VK]

I get attribute error: none type object has no attribute split

[@browserautomate]

embed code

[@wėb3ĆryptO51]

Which code editor are you using?

[@awadecoco12]

pycharm

[@qutaibabs1]

which IDE you are using ?

[@santisanchez4413]

pycharm

[@waljoshamarsphost6820]

Why not simply copy the xpath of the element?

[@browserautomate]

ui vision is also easy

[@neatcomrade8537]

also how do i get past the captchas?

[@tinaperry8632]

I don't have a good answer to this. The only option I know of is to use a service that gets frelancers to solve the chptchas for you. But idk how to do that it also matters what type of captcha you get/are talking about plus since it's an arms race something that might work now might not in the future, atleast untill ai gets so powerful it can pass as a human in basically an situation if it does get to that point. The easiest capcha is the one you just click with no pictures or audio or math (yes i have seen a captcha that uses math) or anything else and it will accept or denie your request based on your browser activity and mouse movment.

[@BrickToTheHeadOfficial]

i installed selenium and its in my scripts folder for python and everything but i keep getting "ModuleNotFoundError: No module named 'selenium'"

[@UR-VK]

i have same issue

[@awadecoco12]

its because you are dowloading it in another interpreter

[@bilalsadiq6995]

what is the software name you run sofware

[@unveiling_visuals]

Pycharm I think

[@nikolinawillette9849]

I followed all the steps, but the browser still shut down 2 seconds later. What could be the problem?

[@nouhailafarajy6475]

hllo can we use selenium for downold file pdf from gmail and tnx in advance

[@browserautomate]

yes

[@joshuaoliverantony138]

ModuleNotFoundError: No module named 'webdriver_manager'

[@browserautomate]

its missing lib 'webdriver_manager' so just run before pip install webdriver_manager

[@aswathvanan3833]

make video on pupeteer

[@philtoa334]

Nice_very.Nice

[@truealpha718]

+1 subscriber____thanks a lot

[@browserautomate]

if anyone have issue with bot detection i can solve your issue

[@chickenrage940]

doesn't work anymore.

[@browserautomate]

specify your problem?

[@chickenrage940]

@@browserautomate thanks, but i worked it out. it still works, but I didn't have chrome installed. after i installed chrome, it works again.

[@notoriousfly9260]

13:00

[@NationalistsRuinAmerica]

Nacho?

[@guilherme5094]

👍

[@timothyo718]

Was German your first language? You don’t seem to have any accent whatsoever.

[@ultraracer]

hi

[@mohamedelhousany4960]

share the script

[@ultraracer]

damnn

[@abulfazhasanov2100]

Everything is ok. But why you talking like you have something in your mouth

[@poornachanduchalla5651]

I am getting this error "Message: unknown error: cannot find Chrome binary" Could u tell me what to for this @NeurallNine

[@browserautomate]

if anyone have issue with bot detection i can solve your issue

[@vemulapraneeth6975]

i need ur help

[@browserautomate]

@@vemulapraneeth6975 hi

[@vemulapraneeth6975]

@@browserautomate how to bypass bot detection

[@browserautomate]

@@vemulapraneeth6975 pic me about from my channel

[@browserautomate]

@@vemulapraneeth6975 hello