Selenium Course for Beginners - Web Scraping Bots, Browser Automation, Testing (Tutorial)

[@jimshapedcoding]

Third time is a charm! Thanks FCC, I am glad to share this with the best coding community. Hope everyone will have a great time learning Selenium! :)

[@NAEEM_MALIK]

Your work is *COMMENDABLE* I appreciate your *EFFORTS*

[@TheGreatMind55]

Congrats Jim🎉

[@__________________________6910]

@JimShapedCoding I already sub your channel from last 8months

[@landsfadern2]

sadly wont listen to 3 hour video! :(

[@victorwestmann]

You guys are doing history here by democratizing high quality education for free!! 🙏✅

[@arxoidwrld4766]

for those who don't know, the newer version of selenium has removed the driver.find_element_by_id and similar functions, the new way of writing the same is- driver.find_element("id" , "") hope that helps

[@yassinedghoughi9500]

Thank you for the help, I just want to ask you, where did you find this info? I can't find a new documentation for selenium.

[@nikitakuznetsov3418]

Thank you , really appreciate for this information! :3

[@Programlama101]

@@yassinedghoughi9500 python gives warning when you use old version of code.

[@Laizin]

How can we extract a word with a tag of yt- formatted -string And im scraping data by looping through 50 yt channels. Sometimes it stops looping with an error of unable to locate But when im executing them individually all 50 channels are able to scrape well. What might be wrong

[@NayyarAbbas-sh1vw]

its more like beautifulsoup now :D

[@akirablac]

use this for browser to not automatically closing: ` options = webdriver.ChromeOptions() options.add_experimental_option("detach", True) options.add_experimental_option('excludeSwitches', ['enable-logging']) driver = webdriver.Chrome(options=options) `

[@workoutinspirations9990]

Hey, how can I put it in code from "structure a bot project" (as a part of the booking module)?

[@DimaShvetsov]

Thanks a lot!

[@yangwilliam3137]

thanks you're amazing!

[@apxmvrc]

@@workoutinspirations9990 Have you found out the answer?? 😅

[@apxmvrc]

I am also stuck there

[@vaibhav31]

9:15 - r as the prefix to a string indicates a "raw string"; that is, character sequences like will be treated as literals and not as escaped control characters (as they normally are in a string.) It's useful when you expect your string to include backslashes, for instance Windows paths, or certain regex expressions.

[@riemanngalois7383]

Thanks you

[@mikepenprogrammer2652]

Many thanks for this amazing tutorial. Not only was it great intro to OOP, it also provided enough info to build my own app from scratch: Automated my timesheet entries at work. It now takes no more than 2 seconds to open browser, login, navigate to desired page, enter all work and time related values, and to pass the submit process with approval from management :) Feeling good while conscious of how much more there is to do and to learn :D

[@rstark]

God finallyyyy FCC uploaded selenium tutorial, not 1000th tutorial on react or HTML 😁 I'm very happy! Thank you lovely FreeCodeCamp ❤️ hope here will be more videos with test automation library's, such as playwright and selenium!

[@wakko3wb]

One of the best and most complete tutorials, thank you for this.

[@jimshapedcoding]

Glad to read this :)

[@sandglokta4699]

This is gold. Please more info about testing automation 🙏🙏🙏

[@zainali-pm1mn]

I am glad I chose this video to learn selenium scraping. I learned a lot from you!. You are really a great teacher. Hats off to you!

[@jatinvashisht4293]

After watching the tutorial: This is one of the best tutorial for beginners, after this you will be able to scrap easily and make your own bots and can understand the documentation easily. Thank You Jim and FCC for this amazing course 🙏

[@lbb2rfarangkiinok]

It's "scrape/scraping". "Scrapping" means something else. :)

[@switchi8663]

You guys have been dropping bangers

[@worthsalive]

Thank you so much for this video. I really find it very helpful and easy to follow along. I was able to build bot that is able to scrape huge data from multiple paged website and dumps the record to json while keeping track of records that has already been scraped incase the bot fails at any point it will be able to continue from where it stoped when you run it again and finally merge all dumped json files together and generate an excel sheet. But I got my basis from this video all thanks to you man. I deeply appreciate.

[@rishabhkhandelwal4627]

options = webdriver.ChromeOptions() options.add_experimental_option("detach",True) driver = webdriver.Chrome(options=options) Use this code if your chrome crash.

[@ДмитрийКальчев-ю7ю]

куда это писать во второй части, когда мы открываем booking?

[@kyawheinhtut3728]

Thank you so much guys, you guys are helping us to continue learning during these covid times. THANK YOU

[@geoffkelly262]

Just started using Selenium and this will save me a bunch of time trying to figure out all the methods, thanks!

[@Palmit_]

Almost all the tests links are dead AND the code is outdated. Selenium now uses find_elements() NOT find_by_id() or find_by_class_name() etc.

[@Vyzinn]

How does find_elements() work?

[@reklamsz3m3t]

@@Vyzinn class = .classname, id = #id etc.

[@Palmit_]

@@reklamsz3m3t a belated but sincere thank you to you :)

[@shivamgupta-hn2nf]

Can you please tell me How to find this attribute name losser-id = "name-of-loser" in selinium

[@sinbad2597]

@@shivamgupta-hn2nf self.find_element(By.CSS_SELECTOR,'tag[losser_id="name_of_loser]') Here for tag,you have to find which tag this stuff is located in . Like div or a or li. (if you aren't using classes , use driver instead of self )

[@srdjanst1]

Great content. One of the best explanations in a coding video that I've ever seen.

[@federicopalacio5349]

greaaaattttttttt, just finished valentin's postman crash course and willing to learn automatization for testing. gj

[@red_cape.]

Great video, to the point and explaining the details for those who are unfalmiliar with Python. !

[@crosshawk1944]

This is the best tutorial I have ever seen. Thank you very much!

[@checkbouncer]

how? it's literally outdated. there's no way you learned anything useful with this.

[@satyamraj17]

@@checkbouncer wow

[@barrientoscardenaslinofern4717]

This guy learn me Flask and Web Scraping with Bs4 for free. THANKS JIM PD. Your KZbin videos of your canal help me to my carrer

[@aryavihat7098]

They are doing really a great job.😘.We all should appreciate them sothat they always get inspired by this. 😘👍.Carry on guys .😊😊

[@dattran9665]

the first time I watch a excellent tutorial video. thank you very much from Vietnam. wish you all the best

[@Flo84swiss]

Your tutorial is amazing. One of the best coding video I ever saw on yt. There are some elements which changed in the meantime, but I could manage it by my own. It help me to build ezze a bot on another project. Thank you for that!

[@Stopinvadingmyhardware]

What?

[@thecryptoindia]

I am not able to send_keys, can u help?

[@xilllllix]

great tutorial! explains everything in a newbie-friendly way...

[@murtazaburhani4022]

I loved his beautiful soup tutorial too 👌

[@mahmoudsaghir8375]

one of the best teachers ever thanks for this amazing video

[@zenabmohammed1156]

Awesome Content thanks Jim shapedCoding channel we wish to introduce more series in this field of python in web scraping 🥺🌸+ thanks FCC for sharing this awesome content on web scraping with us 👏👏🌸

[@erikmedeiros6124]

hello, the video is very good, very intuitive, however in 2023, many of the examples used are invalidated, mainly due to the attributes of the elements of the sites, such as the booking one, they were changed which made it very difficult to scrape the website and follow the progress video was very difficult because of this.

[@bixuplayzofficial]

i am also stuck with that. I am unable to select currency in booking website. If you have solution for this let me know please.

[@maratin93]

Great tutorial. I find a lot of interesting features in this video, which I am going to use in my automation project. Thanks.

[@Interesantes91]

the SeleniumEasy links no longer work

[@aben6717]

Thanks for the great content. Just one thing : Regarding selenium links: the pages aren't found. Anyone could help? thanks!

[@littleshort95]

Hi, the seleniumeasy demo site is no longer working

[@manjunath7497]

😫guys please.. I beg u, really u are making much efforts. Giving all these for free is not a small task.

[@ideepakmathur]

Started listening salenium today, and this video tutorial is gem 💎. This guy is really awesome at teaching. #ThanksMuch

[@xinyuecao9130]

Help! the selenium easy links does not work! It said: "Page Not found"

[@KimKim-fu7zs]

Thanks to your coaching, now I feel more confident in my coding skill a bit, haha, thank you, Jim!

[@მეუფეზაური-ბ7დ]

Videos on this channel are just free gold mines, can’t believe you can get so much knowledge for free.

[@emmanuelace1979]

Finally...I have been waiting for this course all my life😂😂👍🏾

[@realbutters]

Was getting 'chromedriver' executable needs to be in PATH despite following along with the recommendations and I figured out the issue for both Mac and Win. First, I added a print statement right after the os.environ path setting piece: print(os.environ['PATH']) I noticed it was missing a ; in Windows (: in Mac). So, I modified driver_path append step to this and it worked: os.environ['PATH'] += os.pathsep + self.driver_path os.pathsep adds your OS specific path separator character.

[@realbutters]

There are other ways to do fix this problem, but this is what I did in a pinch to see what I could do to make it work like the teacher was doing it.

[@rejkee]

Thank you, it worked for me.

[@MiturGrunge]

Great solution! Thanks! I figured out that simply adding a ; in front of the driver path works as well, so my line looks like os.environ['PATH'] += r";C:/selenium_drivers"

[@bugrahanozcan8682]

@@MiturGrunge what is meaning of semi-colon?

[@adrianford468]

Can you share you your code at this part for an example

[@gurjot2318]

brilliant... been waiting for selenium tutorial for ages

[@mohammedbadi6938]

where was this 8 months ago Greatest channel ever

[@codesuki3005]

Please upload more of this tutorial and also teach automated data collection. Your style of teaching is nice

[@eugenekwaka]

Great tutorial Jim and the FCC team👌. I just have an issue with the links provided for the websites to test on. They seem to have been moved or are not working anymore. Please fix them for devs to use for learning.

[@alejandrodelriosalas3627]

+1

[@vanshjagyasi4004]

+1

[@et8175]

Anyone else have an issue with the os.environ['PATH']? I had to add a semicolon for it to work: r";C:/SeleniumDrivers". Anyone know why it doesn't add it automatically? Thanks.

[@et8175]

Are the seleniumeasy links working? They seem to be removed from the website.

[@Doom_C]

Wow, posted 1 day ago, and fixed my exact problem. No idea why this works.

[@emimartin7044]

Thanks for sharing this, i didnt know i should add semicolons there.

[@muhmmedarbee8014]

THANK YOU FOR THIS!!!!

[@Manikanta-ko7qy]

@@et8175 thanks man..I am searching for this..

[@judahnat6529]

Great tutorial and great and clear teaching

[@ilCvlto]

Jim is always a great teacher ✌🏻✌🏻

[@exspider64]

I needed to add ; before the driver path

[@ajayiabdulmalik9446]

pls where do people like jim learn that they become so good like this

[@martinsemakula2274]

seleniumeasy test web link no longer works. Is there any other alternative. Tutorial really looks informative so far

[@muntaface]

Another amazing tutorial. Thanks Jim

[@joaovitordutra9365]

Are the tests from seleniumeasy down? I've tried to enter to code along with the tutorial, with no success. Are there any alternative links? Thanks

[@muhammadshaharyar1]

It's also not working when I am selecting rating. So, I did it on my own. star_filteration_box = self.find_element_by_css_selector( 'div[data-filters-item="class:class=5"]' ) If you are stuck here, it will help you.

[@KimKim-fu7zs]

@@muhammadshaharyar1 star_filtration_box = self.driver.find_element_by_xpath( '//*[@id="searchboxInc"]/div[1]/div/div/div[1]/div[5]') I tried this way, it works.

[@zhanhongkang5897]

u may also find the Section 3 via the URL above as well. (since I'm not further to Section 3 yet)

[@ahmedqureshi4831]

Great Project! Loved the accent. However, there is one thing i would request for the next selenium tutorial, I am would like to learn more about multiple browser window handling and switching. Thank you for this amazing #CrashCourse

[@yorukama]

hey its this guy. Love this guy.

[@alejo5007]

Hi, i got an error specifying the path to the web driver like it's done in the video. Instead, i managed to make it work by adding the path like this: driver = webdriver.Chrome("path_to_webdriver") Is there any problem doing it like that? Thanks in advance and thanks for this course.

[@MyLoweLife]

This method worked for me as well so thanks for this

[@lc4355]

This also worked for me on macOS, thanks!

[@justme-ns1rm]

Hi, I'm getting an error both ways. Has anyone else had this problem?

[@lucasmate1582]

​@@justme-ns1rm if you use windows try to use semicolon before the C:..... like ;C:/SeleniumDriver/

[@FTCHLE]

@@lucasmate1582 work thx!!!

[@SkWebStudio]

Thanks for the video!

[@neillunavat]

Finally a tutorial I will surely watch.

[@neillunavat]

I have an issue called 'procrastiantion'. I just don't end up watching most of the vids I wanna watch...

[@sinbad2597]

You watched?

[@neillunavat]

@@sinbad2597 hell no 😂

[@saburiyusuf7451]

This is a great Selenium Tutorial.

[@Brocollipy]

Really helpful stuff, many thanks!

[@RobsonDev]

Amazing course! Thank you for share

[@rshraddha]

I was just thinking of studying selenium and this video pops on my notification. What sort of dark magic is this?

[@rishuyadav3551]

Exactly, Same

[@adejorodamilare1314]

Same

[@sayanjitdas7087]

for some of you concatenating the driver path string showed may not work specifically to windows user , for me I had to prepend ; to driver path to make it work like ";C:\seleniumDriver"

[@abdulazizabdullaev8931]

Thank u worked for me too

[@joyedet1363]

It doesn't work for me

[@shivakumarjadipalli6823]

Hi lex , Can you make your podcast live in youtube so that we could ask some questions too , obviously you can reupload it again with your editing , By this way the questions you are asking will be more public related

[@chandrachurmukherjeejucse5816]

Nice tutorial man

[@HerozTech]

I love this course ❣️

[@giorgishaoshvili89]

Hi i just started your tutorial and found out that seleniumeasy links that you provided are no longer available. any sudjestion?

[@jiaxinliu2763]

same here

[@vlads7774]

none of the links actually work , it says the page can’t be found . can you please try to fix that ?

[@hipockt4]

Nice code but the code does change when you have version 104. It is difficult to try to fix the code to match your tutorial. I say this as I am a novice

[@Rohan-bg8ci]

And as always thank you FCC

[@sampasomnathvloger7781]

Beautiful 🙏🏻

[@tahagoren7011]

Please keep continue this diamond tutorials thanks a lot

[@t1234-q5z]

yes we are using this for 'testing'

[@soyedafaria4672]

One of the best tutorials for beginners.

[@Nandhis]

Great tutorial! Thank you!💐🎂

[@mainbotpy]

It was a great one for sure

[@davidwang9827]

It's helpful for me. thank you very much.

[@KevinOgutu-cx8ix]

I really love the tutorial, I have been folloeing your tutorials always and thumbs up. I have an enquiry; suppose I want selenium to be refreshing a specific website at an interval of 2 seconds without stoppind, and if a certain link pop ups on that website, click on it. What is the procedure for that?

[@____kklw7148]

Thanks for teaching. I have learnt a lots

[@_mytube_]

Nicely explained man, thanks

[@engrkpt]

Hi all! The seleniumeasy links are not working anymore so can anyone suggest a URL like those for us just starting? Thanks!

[@maherhanna2432]

This is an amazing tutorial thank you very much

[@JoseLopez-or8xw]

Thank you!

[@TK-mf9dz]

rather not for the begginers even thought I am following the explanation rather ultra basic, without going into details, just 1 senctence as if you have a mission to squezze in 3 h with everything max. Great idea to work on Booking Thanks anyway

[@hmm7458]

i needed this😭

[@tawhidmubashwir6811]

the links of selenium easy is not working

[@grumpy653]

Amazing tutorial!

[@trido3815]

Thanks, Jim

[@cosmicheathen1955]

I will allow myself to like this video.

[@sheillaprosper7126]

i'm a newbie. What IDE are you using? how did you get here? I already installed selenium on the terminal, got that. But which IDE is this

[@Jane240938]

I'd recommend to use VSCode, it's pretty easy to use especially if you're newbie. On his video I think he is using PyCharm tho

[@atharvajoshi6404]

PYcharm

[@kamiln851]

This tutorial is great!

[@gklos1]

link is not working - selenium easy

[@kluchtube7042]

great video learn lot from you!

[@arthurpiotto9844]

for some reason most of the content covered doesn't work properly in my computer, is it happening to others?

[@zhanhongkang5897]

all works, before u start this lesson, set up environment first. watch the beginning of this video : kzbin.info/www/bejne/o2GvlX6QYtWlqtE&ab_channel=JimShapedCoding

[@bobeo56789]

Thank you for your video🎉

[@jeenitprajapati3449]

Wow! Thanks

[@AznBMan75]

Hi! Can you use Expected Condition to wait after I go through login page, and then after the next page to perform web scraping on the 3rd page? If yes, then I would have to refer to the 3rd page and methods in the Expected Condition?

[@22KIzo]

It seems the css selector for button is out of date. Maybe I can find it in a div tag under the button tag,?

[@castrombithi4135]

going through the same issue

[@aritra2116]

Same here, anyone's got any insight as to how to access those specific buttons now?

[@sunday-ucheawaji7966]

This is great!

[@mayurasandakalumsellapperu6778]

Thank you 😍🔥🔥

[@amanshaikh9900]

Thank you so much guys