Selenium Browser Automation in Python

In this video, we learn how to automate website interaction using Selenium in Python.
◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾◾
📚 Programming Books & Merch 📚
🐍 The Python Bible Book: www.neuralnine.com/books/
💻 The Algorithm Bible Book: www.neuralnine.com/books/
👕 Programming Merch: www.neuralnine.com/shop
🌐 Social Media & Contact 🌐
📱 Website: www.neuralnine.com/
📷 Instagram: / neuralnine
🐦 Twitter: / neuralnine
🤵 LinkedIn: / neuralnine
📁 GitHub: github.com/NeuralNine
🎙 Discord: / discord
🎵 Outro Music From: www.bensound.com/

[@alex59292]

(pin this) you can use sellenium undetected driver since most websites detect normal selenium, this uses your normal chrome and not fresh private chrome

[@okrq]

How do you do that

[@coding1806]

@@okrq fcking go make research

[@krishlorend.sinevasan6945]

how?

[@tangoalpha1905]

I have been searching around trying to find a solution for this. Someone come and bless us with the knowledge!

[@ImTheRealCam]

You do know it’s so easy to search pip’s for python… btw the thing you 3 have been looking for is selenium_stealth.

[@garyhottinger7384]

Excellent! Clear and concise. I just retired and can't wait to see if I can automate some of my hobby web work.

[@DavidBacarella-v7z]

My compliments on you your video. It was focused, enabling, and well thought out. The only thing I want is "more" of these awesome vids. Thank you!

[@TH-nl1sb]

I always had a difficult time finding the right HTML elements by myself. I wish I had known you earlier. I will continue to watch all your videos. Thank you! You are a great teacher!

[@knalsgtes6684]

same here

[@suavisgiramata8802]

He is a very good teacher!!!

[@knalsgtes6684]

I have search so many tutorials on selenium as reference for our automation project,, and this is the best ever tutorial.

[@koupohroyandredavid2639]

the best ever

[@imanthiu]

I learned a great deal from this video. It didn't help me do what I was I looking for but I always like learning new things.

[@ibrahimib9020]

thanks man... it helped me a lot. I was starting to learn this but cannot find the right syntax to view the page. but this worked for me

[@lamar2658]

Hey if you could do a video on XPATH and maybe the professional ways to load and sync tabs that would be great! Very helpful and useful video!! Going to use this for sure! Thanks

[@neatcomrade8537]

Dude! this video is exactly what i needed! thank you!

[@mr_cupcakes1808]

bro's teaching is awesome thank you!

[@heyalejandro175]

So cool...thank you very much for this...Yes an XPATH video would be amazing! Thanks again!

[@Delirium132231]

For selenium users: Action Chains is a nice discovery for those who didn't know before. Ofcource if FrontEnd developer was a nice guy

[@ghefley]

Well done and thank you for sharing this.

[@DavidBacarella-v7z]

My compliments on your video. It was focused, enabling, and well thought out. Thank you.

[@ucxanguyen2395]

What a great video. Super well explained, thanks! Any video in your channel on how to record yourself with soft soft? I'm under the

[@Relderf]

What a professional video, neat.

[@HAInett]

that is what I needed :)))) thank you so much

[@codehokage1977]

Question when finding the "7 in 1" button why don't you just copy the xpath off the inspector tool?

[@nabilpro1662]

The best as normal ❤

[@mkhadka123]

This is nice to get a kick-off

[@fakhruddindahodwala6816]

How were you able to format the html elements in your output terminal window? i get all the characters showing up line by line

[@JacobJavor]

Thank you, was good introduction

[@mehdismaeili3743]

Excellent, thanks.

[@DKMRFCBrlz]

Amazing video!

[@sonerkocak5058]

Thank you! I am your fan❤️🫣!

[@pruzylo]

Perfect video length.

[@Vibeness1]

why use xpath to find the object names instead of e.g. EC.text_to_be_present_in_element ?

[@soumyaranjandash3597]

Thanks this is helpful 🔥

[@petrokey]

Hello, can you please advise on classic web scripting on python? Any resource or link..

[@xxjblexx]

I Hope You Do A Video On XPATH Asap... That is The Core in Selenium Library To Find And Search Elements

[@faridalijani1578]

are u running Chrome as administrator or user in ur machine? I open the browser but nothing is shown and it crashes after a while! I use conda btw

[@amerismartin2854]

How do I make selenium open default chrome profile? Or desired chrome profile?

[@thefunnyvlogger8218]

Please can you tell me which framework we are using here?

[@swordart802]

i want to use in real browser not in chormedriver how can i when i tried it doesnt get the url after browser opened

[@doudline2662]

Thank you sir.

[@ToobaNaseem-pe7kn]

please guide us how can i automate the process of connect wallet(metamask). in my chrome browser i have installed metamask extension while in the process of automation, automated chrome driver do not have wallet extension. please guide us regarding this process.

[@RocketLR]

Aah wish i found this earlier. Had a site that needed java script render for the tables to get populated with the data.. The online solutions did not work for some reason.. Got a bunch of chromium errors and stuff.

[@hesam8845]

how can I scrape google map to get contact info in specific city?

[@freecreator6426]

I applied one by one, but when clicking "run" it says that the module is not defined. Tried many times.

[@GabrielAGilO]

do ahve you encounter this error before "NoSuchWindowException: Message: no such window: target window already closed from unknown error: web view not found" I have try to put many URLs but I keep getting the same error. i have looked only and I thought by adding the Service and Options would work but it did not, Any help

[@jw200]

thanks, subbed.

[@JontheRippa]

Wow thank you 👍

[@karlybyrd1551]

I apologize if this is a dumb question, but why would you not just search for the link you're trying to find instead of searching for the link inside the correct div? That seems like an extra unnecessary step that just led to finding the link anyway.

[@sever5859]

Interesting video

[@ShahzadAli-zr4ro]

you are great teacher of this century on youtube please let me know if anything i can do for you

[@ArneSchwarck]

Do you know why even if detach is true the chrome window will close if a KeyboardInterrupt is sent in the Terminal window?

[@mrrl37]

Thank you

[@your_butter_chicken]

Hi, how to capture Screenshot in this new selenium IDE? Pls help :)

[@szwyr8380]

Why don't you just click the element to get the copy of the xpath ?, i mean u just right click on the div tag or another tag and then copy the xpath... Or it would be a better way to just read on the inspect element ??? Because i new to this and didn't understand about this xpath things

[@jamesmoisesllalleperez3079]

y si quisiera que guarde información en la misma página?

[@musicarroll]

I think your selenium tutorial became an XPath tutorial.

[@aleterra]

is there any way to solve the captcha?

[@jamievercetti]

is there a more explanatory version of this video

[@Zhacker0927]

I got error WebElement object is not iterable > help please!

[@madalinam5418]

how can you deploy it and run recurrent on a server?

[@TestSubject-ik4oq]

For the site i am trying to do i get handshake failed

[@66abady]

thanks man. I really wanna know if we can use this method when we don't have a browser installed. lets say if I was to deploy this script on a sever.

[@codaq4043]

Yup, you need to make it headless and host the script on aws

[@philtoa334]

Nice_very.Nice

[@robertharrison1601]

As in QUORUM of NINE¿?

[@hansilsepp]

Es scheint, dass es ein Problem mit dem Webdriver-Manager gibt, der versucht, eine nicht vorhandene Version des ChromeDrivers herunterzuladen. Ich habe Chrome 117.0.5938.92 gibt es da eine Lösung?

[@isro3085]

Hab auch das Problem, hast du es lösen können?

[@hansilsepp]

bin mir nicht ganz sicher, ob das die lösung war oder ob ich das problem nicht lösen konnte: man kann den webdriver auch sonst manuell ohne das managermodul von python instllieren (exe herunterladen), link der website weiss ich leider nicht mehr, allerdings muss man das nach ca. 1/2 Jahr immer wieder manuell update (neuer driver installieren)

[@tulasisanjay]

How can I automate the process of claiming Binance Crypto Boxes on their webpage using code extracted from Telegram?

[@tulasisanjay]

Make video please 🙏

[@adisonfryman144]

OK why do you put the install in there, I just ran this code and got .....Downloading: 100%|██████████| 6.79M/6.79M [00:00

[@adisonfryman144]

also the window did notstay open

[@BrickToTheHeadOfficial]

i installed selenium and its in my scripts folder for python and everything but i keep getting "ModuleNotFoundError: No module named 'selenium'"

[@Vkdride]

i have same issue

[@awadecoco12]

its because you are dowloading it in another interpreter

[@humpalestine]

It would be better if you share the python script you are describing.

[@neatcomrade8537]

also how do i get past the captchas?

[@tinaperry8632]

I don't have a good answer to this. The only option I know of is to use a service that gets frelancers to solve the chptchas for you. But idk how to do that it also matters what type of captcha you get/are talking about plus since it's an arms race something that might work now might not in the future, atleast untill ai gets so powerful it can pass as a human in basically an situation if it does get to that point. The easiest capcha is the one you just click with no pictures or audio or math (yes i have seen a captcha that uses math) or anything else and it will accept or denie your request based on your browser activity and mouse movment.

[@truealpha718]

+1 subscriber____thanks a lot

[@nouhailafarajy6475]

hllo can we use selenium for downold file pdf from gmail and tnx in advance

[@browserautomate]

yes

[@wėb3ĆryptO51]

Which code editor are you using?

[@awadecoco12]

pycharm

[@kwameappiahkumi5833]

Does selenium work only on Google Chrome❓

[@mkhadka123]

no it has drivers for other popular browsers as well e.g. geckodriver for firefox

[@guilherme5094]

👍

[@Vkdride]

I get attribute error: none type object has no attribute split

[@browserautomate]

embed code

[@bhasim4299]

Chrome driver didnt work, but firefox did. just saying

[@qutaibabs1]

which IDE you are using ?

[@santisanchez4413]

pycharm

[@user-uw5qc5vq6w]

Which platform is that in which you are coding??

[@browserautomate]

PyCharm

[@aswathvanan3833]

make video on pupeteer

[@notoriousfly9260]

13:00

[@nikolinawillette9849]

I followed all the steps, but the browser still shut down 2 seconds later. What could be the problem?

[@browserautomate]

if anyone have issue with bot detection i can solve your issue

[@waljoshamarsphost6820]

Why not simply copy the xpath of the element?

[@browserautomate]

ui vision is also easy

[@bilalsadiq6995]

what is the software name you run sofware

[@unveiling_visuals]

Pycharm I think

[@sonerkocak5058]

Will there be an Instagram entry in the next video?

[@CanlDersler10SnfPrivate]

Selam

[@sonerkocak7392]

@@CanlDersler10SnfPrivate selam

[@joshuaoliverantony138]

ModuleNotFoundError: No module named 'webdriver_manager'

[@browserautomate]

its missing lib 'webdriver_manager' so just run before pip install webdriver_manager

[@ultraracer]

damnn

[@NationalistsRuinAmerica]

Nacho?

[@ultraracer]

hi

[@mohamedelhousany4960]

share the script

[@chickenrage940]

doesn't work anymore.

[@browserautomate]

specify your problem?

[@chickenrage940]

@@browserautomate thanks, but i worked it out. it still works, but I didn't have chrome installed. after i installed chrome, it works again.

[@timothyo718]

Was German your first language? You don’t seem to have any accent whatsoever.

[@abulfazhasanov2100]

Everything is ok. But why you talking like you have something in your mouth

[@poornachanduchalla5651]

I am getting this error "Message: unknown error: cannot find Chrome binary" Could u tell me what to for this @NeurallNine

[@firstandlast4435]

I don't know. My browser just closes right after finishing script. I use from selenium.webdriver.chrome.options import Options chrome_options = Options() chrome_options.add_experimental_option("detach", True) browser = webdriver.Chrome(service=Service(ChromeDriverManager().install()), options=chrome_options) but it doesn't help at all

[@buzzark9133]

Same, and no matter what I do it always closes after whatever script i put down. If you find a solution please let me know.

[@buzzark9133]

Hey i just found a solution, let me know if you wanna hear it

[@firstandlast4435]

@@buzzark9133 it'd be nice)

[@firstandlast4435]

@79_22_16 M for now i found that you can place infinite loop after code, so your script won't be finished and browser won't close, but that's definitely awful decision)

[@buzzark9133]

@@firstandlast4435 ^ you too, check the reply above

[@browserautomate]

if anyone have issue with bot detection i can solve your issue

[@vemulapraneeth6975]

i need ur help

[@browserautomate]

@@vemulapraneeth6975 hi

[@vemulapraneeth6975]

@@browserautomate how to bypass bot detection

[@browserautomate]

@@vemulapraneeth6975 pic me about from my channel

[@browserautomate]

@@vemulapraneeth6975 hello