what happened if the post is not an image? IG lets you upload videos.
@PythonSimplified3 жыл бұрын
Hi Johan 😀 You'll need to tackle this with a conditional statement, where videos would be saved under the ".mp4" extension and images under the ".png" extension mentioned in the end of the video. Let me know if you were able to figure it out! 😊if not - I can film a quick tutorial showing how to do it 😉
@TheJohanHalim3 жыл бұрын
@@PythonSimplified please do! Also, how many images should I expect in my folder? I get a TypeError on the last for loop. TypeError: cannot use a string pattern on a bytes-like object I'm guessing its because of video format.
@paulameneses23063 жыл бұрын
@@PythonSimplified Hi!! Congrats for the perfect content!! I've spent my day studying for a master data science project and you've been helping me a lot :) I had the same problem today with profiles with some specific photo types, videos and reels.. I couldn't save an image and I got the same error mentioned above.. Could you help us please? Thanks!! ;)
@PythonSimplified3 жыл бұрын
@@paulameneses2306 thank you so much dear! 😁 Sure, I'll look into it over the weekend and adjust the code to include a conditional statement for videos 😉 we'll be in touch!
@PythonSimplified3 жыл бұрын
@@TheJohanHalim Yes, you are absolutely correct Johan!😊 You get this type of error when trying to save a collection of images (video) as a single .png or .jpeg image, it's due to an incorrect format. The amount of images you should expect differs from one computer to another, depending on the size/scale of the display. The code in this tutorial would get you the number of images that results in a single scroll event. And as Instagram uses a dynamic language - the more you scroll, the more images are loaded to the page. If you'd like to include several scroll events - checkout my community post, where I include additional resources, a detailed article and code examples on how you can expend this bot: kzbin.infoUgwVQazZhNNqwdghhdh4AaABCQ I'll get back to you after the weekend with a solution to your video question 😉
@ankurgupta71023 жыл бұрын
I never imagined that python learning could have this much glamour.
@akilthangavel85003 жыл бұрын
hahaha
@AgriculturaDigital3 жыл бұрын
Very good comment
@johnames64303 жыл бұрын
it was either fake Gamer Girl, OnlyFans, or this. But there is a lot of competition in those other areas so she went with this.
@johnames64303 жыл бұрын
by the way the whole thing of her in the right side of the screen is planned out, she has her hair there to hide that she's wearing something hoping to appear nude so people will click and it will go viral or something 😂 Wish her the best of luck though! No hate! 😘
@timothyo7182 жыл бұрын
@@johnames6430 What a hater.
@sarthakpawar24073 жыл бұрын
Me saw the thumbnail and click it Me (after 10 mins) : ooh! It's a programming tutorial
@PythonSimplified3 жыл бұрын
hahahaha indeed! 🤣
@robinferizi90733 жыл бұрын
lol 😂
@makeithappen58462 жыл бұрын
I love your style of knowledge sharing. You made it simple enough to understand by someone like me who is just beginning to learn python. Thanks!
@juliam90903 жыл бұрын
Compliment from a fellow girl coder, this video was super informative and entertaining and you are obviously bright and talented!
@TimMattison3 жыл бұрын
This content is really great. Thank you for sharing it. Years ago I used to do web scraping back when there was a lot less JS and interactivity but haven't done it in a long time. This video got me back into it. Keep it up!
@PAuLXPlain3 жыл бұрын
*Lol , I Almost Forgot I came here to Learn Python! haha Stunning Looks!*
@PythonSimplified3 жыл бұрын
Thank you! 😆 I may have went a bit overboard on this video XD
@shaharrefaelshoshany94423 жыл бұрын
@@PythonSimplified Super hot supet smart :))
@robertmainville48813 жыл бұрын
@@PythonSimplified Well, I think you were overdressed...
@Scal3 жыл бұрын
Thank you so much for explaining and showing every basic steps in details ! Lots of beginners like me get stuck in setup steps that can seem obvious to experienced developpers. For exemple thank you for explaining and showing all the download and setup Chrome driver steps. Even on some big websites pass quickly these basics setup steps. I was stuck but thanks to you I made it ! Thanks again !!!
@d-rey1758 Жыл бұрын
Cool vid Maria! But on the days there isn't a "not now" button, the whole code grinds to a holt. To know how to add a function where if the "not now" button is present then code clicks on it and if it isn't present then the code skips to the step would be awesome!!
@tamzin1223 Жыл бұрын
Omg please!!🥹
@davidliu7246 Жыл бұрын
add a timeout to when waiting for "not now" to appear, and then put it in a try/catch block.
@d-rey1758 Жыл бұрын
@@davidliu7246 thanks, I found it a while ago using try and except. now i just need help creating a chatbot. At the moment using nlp, spacy, textblob and a ton of for-loops
@Thepathtoprofits3 жыл бұрын
Thank you for this tutorial!. I am currently learning python on datacamp and haven't learned or seen any real world applications. I am definitely going to try this out and add what I learned from this video to my skillset.!
@PrinceKumar-el7ob3 жыл бұрын
i don't know why i am watching it instead of listening to music but the way she teaches is real fun!!
@robertn2997 Жыл бұрын
You explained Selenium very clear. Can you also explain in a video on how to prevent to be detected as a bot? I read many post on stack overflow but Selenium still got detected as a bot, even on the first page load.
@illuminated2438 Жыл бұрын
Very difficult. She's a world-class beauty, yet providing world class teaching on a very important topic.
@xilllllix2 жыл бұрын
learned some good web scraping practices here like waiting for elements to be clickable, clearing the input boxes, etc. thanks!
@piriwo3 жыл бұрын
Great content! Very clear and useful. Btw you don't need to add the local path of the webdriver as long as you have it in your Environment PATH. It looks over there by default. Also, by the end of the video you can get rid of the counter variable if you use enumerate.
@PythonSimplified3 жыл бұрын
Wow, thank you Yaniv!! This is fantastic - we can save it there once and never worry about it again! !!👏👏👏 I'll just sit down in shame and be impressed with your super-efficient coding skills 😂😂 אגב!! אני ממש שמחה לראות שחברה׳ ישראלים מצטרפים לחגיגה, ועוד עם כאלה עצות נדירות!! תודה רבה יניב, שיחקת אותה! 😀
@piriwo3 жыл бұрын
@@PythonSimplified חחח ממש לא ציפיתי תשובה בעברית! אבל באמת תודה על הסרטון זה עזר לי להבין הרבה דברים. הPATH היה סתם משהו קטן. תמשיכי כך!
@PythonSimplified3 жыл бұрын
@@piriwo תודה רבה, will do! :)
@Minerbush3 жыл бұрын
חשבתי אני הישראלי היחיד פה😅
@HabibKhan-kj8um Жыл бұрын
OMG you're the best ! I was hitting my head on the wall. In reality you showed it in a way simple way. Thank you
@MariosMartiopoulos3 жыл бұрын
I thought I didn't know English but now I think I do. Incredible articulation!!!
@pranshubansal3553 жыл бұрын
Thanks for this info. I am able to download only 58 images at one go, is it possible to download all images around 2000 with this at one go ? Can you please advise.
@PythonSimplified3 жыл бұрын
Hi Pranshu! yes, you are able to download as many images as you need! 😀Just implement the scroll event inside a loop, just like this (scrolling 10 times to the bottom of the batch): for j in range(0,10): driver.execute_script("window.scrollTo(0, document.body.scrollHeight);") time.sleep(5) //wait 5 seconds The more you loop, the more images you scrape! I have a video premiering soon where I explain it in detail, check out "scroll to the bottom of the page" in the timestamps if you miss it 😉
@josecastellon91832 жыл бұрын
You are the most intelligent and beautiful teacher of all.
@guillermo._._3 жыл бұрын
Thank you for the video. Very clear and straight forward. Im having trouble with the searchbox.send_keys(Keys.ENTER) command. I tried ENTERing twice but still doesnt work. Any sugestions?
@PythonSimplified3 жыл бұрын
Thank you so much Luisgui 😁 Try the code I've just posted on my Github, you can solve it with time.sleep(seconds), it's in the "search keywords" section: github.com/MariyaSha/WebscrapingInstagram/blob/main/WebscrapingInstagram_completeNotebook.ipynb I actually just finished working on a Medium article about this where I explain everything in detail, I'm just waiting for my publication to approve it and then I'll send you a link 😉
@thebuttnakedpodcast30063 жыл бұрын
Thanks again, Mariya. Always the right lessons at the right time.
@PythonSimplified3 жыл бұрын
My pleasure! have fun! 😀
@J0hn4rt15t3 жыл бұрын
Very good tutorial. You could use in for loop, the enumerate to avoid the counter assignment. for counter, image in enumerate (images): save_as = os.[path.join(path, keyword[1:] + str(counter) + ‘.jpg’) wget.download(image, save_as)
@drnotebook2 ай бұрын
Great video. Thank you so much. Mariysha you are a very good teacher. I hope that you can learn the correct accent on the specific word ( `at-tri-bute ), emphasis on the first syllable, because it is so often when speaking about Python and objects. You routinely mistakenly swap or mispronounce the verb attribute ( at-`trib-ute ) and the noun attribute ( `at-tri-bute ). I understand that you are not a native English speaker, and please try to take note of this and improve the accent on this word. In Python a class or object `at-tri-bute is a noun, aka "method" or bound function. Great video. Keep cranking them out.
@bryanmurasira9682 Жыл бұрын
this and arjancodes are by far my favorite channels!
@romiolover68523 жыл бұрын
i started knowing why i am actually watching your video after the introduction :)
@amadoucoulibaly29162 жыл бұрын
Mariya, I love you. Thanks, you gave me what I was looking for since 3 days
@VikramKumar-yv8uu3 жыл бұрын
wow thats amazing Mariyasha, i like your way of teaching, its very helpful for me. Both are in same boat upcoming future data scientist
@PythonSimplified3 жыл бұрын
Thank you so much Vikram, I'm glad I could help! 😄
@KyotonoTori3 жыл бұрын
thank you soo much you just saved me! im gonna rock that interview
@PythonSimplified3 жыл бұрын
That's awesome to hear Arthur! Good luck on your interview! 😀
@chiranjeebroychowdhury77593 жыл бұрын
Perfect intro to Selenium! Very nice video! Thanks again Mariya!
@PythonSimplified3 жыл бұрын
Thank you Chiranjeeb! I told you you gonna like Selenium! 😁
@chiranjeebroychowdhury77593 жыл бұрын
@@PythonSimplified Yep! You were correct!
@techienomadiso89703 жыл бұрын
This gender is always so organized.!!! A good session it was with so much clarity.
@PythonSimplified3 жыл бұрын
Thank you, I'm glad you found it helpful! 😃
@faizmohammad80793 жыл бұрын
I was wandering why don't you make full series of Selenium. Your Teaching is like Perfect :) I literally enjoyed a lot. Thankyou so much .
@PythonSimplified3 жыл бұрын
Thank you so much Faizmohammad! 😁 I've just posted a brand new video on Selenium, this time webs craping Facebook: kzbin.info/www/bejne/iaS7lKylmtuejJI It's some sort of a series! just with a bunch videos on other subjects in between 😄
@ahmedshalaby185 Жыл бұрын
Hello ,I really like you work, just started to do some web scrapping and you tutorial was of a great help for me , you are organized, your explanation is perfect clear and easy to follow, just one thing I noticed and I already fixed but I wanna know if there is other way around. the problem is the search box don't appear if the chrome screen size is big so we just get the side bar with the search symbol which need to be pressed to open the search box, which I tried to figure out how to make it but couldn't. so I just added a screen size (driver.set_window_size(740,500)) to make sure the search box will appear automatically. If you know how to fix it the normal way that would be nice, Thank you
@voronow32 жыл бұрын
When I see and listen this girl I'm fell the happiness...
@manuelivanurbinamartinez45362 жыл бұрын
GENIUS!!!!! I really liked your video, you were able to solve the concerns I had and no one else could solve. THE BEST!!!
@henrylaw872 жыл бұрын
The most beautiful women in KZbin who teaches python. Can't concentrate 😂
@Arda19822 жыл бұрын
I thought the same :D
@smalirizvi80263 жыл бұрын
All boys' fav teacher!
@PythonSimplified3 жыл бұрын
99.9% of programmers are boys anyways! 😃
@smalirizvi80263 жыл бұрын
@@PythonSimplified so glad to hear back from you. I have a little query regarding scraping. And its getting horrendous. I want to scrape some details from the *info* section of the profiles in a group. Is it doable? Your response will be like a lifesaver
@PythonSimplified3 жыл бұрын
@@smalirizvi8026 the rule of thumb is - anything you can target with your mouse and keyboard - you can target with Selenium! 😃 Some platforms have more blockers than others, I suggest watching my Linkedin Bot tutorial where I show how to handle 3 very annoying blockers such as "click intercept" and hidden elements: kzbin.info/www/bejne/jpWphqN8iqmnbpo If you run into specific errors let me know, but as long as you're working closely with the Developer Tools and allow enough time for the elements to load with time.sleep() - the sky is the limit! 😁
@smalirizvi80263 жыл бұрын
@@PythonSimplified I watched your vid. It was far above my knowledge and expertise. Actually I am trying to extract every profile's information in some groups on *Facebook* for my Machine Learning work. So far, I think that I should watch your video of applying selenium on Facebook. And I will convert python code with java whenever I face some blockers there as well as use time.sleep(). Do u think that this should be fine?
@smalirizvi80263 жыл бұрын
You have literally earned my sub! 💎💎 Thank you so much for replying and taking notice of my problem. Looking forward to you as I am pretty much done with my attempts with it
@ishaankapoor9332 жыл бұрын
This channel is underrated, Change my mind!
@mohammadjavadhaji63963 жыл бұрын
Best video seen about web scraping and automation. But i really couldn't figure out this jupiter thing. What is jupiter?????
@PythonSimplified3 жыл бұрын
Jupyter Notebook is a very handy interface, where we can process our code cell by cell. It is very similar to Google Colab, and we can access it directly from our Anaconda terminal with a very basic command - "jupyter notebook". If you wanna find out more about this interface, please check out one of my first tutorials, where I explain all about it in detail: kzbin.info/www/bejne/oKHCZIGFgK2hb8U So generally, when you're using a traditional IDE, it runs all your code at once, while notebooks like Jupyter allow you to separate your program into sections and run each of these sections independently. I find it to be very handy when teaching/learning, and I highly recommend to give it a try 😉
@PythonSimplified3 жыл бұрын
And thank you!! 😁😁😁 (sorry, I should have started from this but I got carried away with the explanation hahahaha)
@matheus74053 жыл бұрын
OMG!!! your channel is perfect , thanks for this class !!!!
@PythonSimplified3 жыл бұрын
Thank you so much Matheus!! Glad you liked it! 😁
@thegrowthhackert42483 жыл бұрын
This channel has super easy tutorials on how to do it: kzbin.info/door/YvGiDV1JfJTpphxtKd7r_Afeatured
@J3rs3yM1k32 жыл бұрын
You should check if the "Not Now" prompts are even presented before assuming you will need to click that... twice.
@vijaykumarlokhande16073 жыл бұрын
WebDriverWait(driver, 10) What do we mean by 10. And is it constant or subject to our choice? How to decide it.
@PythonSimplified3 жыл бұрын
Hi Vijaykumar! 😃 to my understanding, the value 10 in the above example represents the timeout value (in seconds). Meaning - if this element was not detected within 10 seconds, you'll get a TimeoutException. You can definitely adjust it to any value you'd like! Selenium documentation keeps it at 10, but I've seen other examples with 5 and 15 seconds, it all depends on how long it takes the given page to load 😊
@nandkumarpawar72 жыл бұрын
She saved that "Purrrfect" for this moment.
@adamthedev3 жыл бұрын
Solid tutorial! You're great at teaching!! Thanks
@PythonSimplified3 жыл бұрын
Thank you Adam, glad you liked it! 😀
@thesouthsidedev18123 жыл бұрын
This is the coolest thing I have learnt today
@PythonSimplified3 жыл бұрын
Awesome! I'm glad I could help! 😁
@suiciniv763 жыл бұрын
I'd like to say that I loved it you're amazing and please keep on it, I'm happy too because English isn't my mother language and I understood you very well 😊.
@PythonSimplified3 жыл бұрын
Thank you Vinicius! I'm so happy to hear that! 😁😁😁 English isn't my first language either, so I'm always trying to use simple words whenever possible (the complicated words are also much harder to pronounce, I sound very Russian when I do this hahahaha) Thank again and Merry Christmas!! 😊
@suiciniv763 жыл бұрын
@@PythonSimplified no problem, where are you from? Could you please make a video explaining how to understand boxplot charts? Merry Christmas 🙂
@FilamEFX3 жыл бұрын
Love the tut, you're a smart lady, no need to use gimmicks for clicks.
@Waso463 жыл бұрын
I agree but if that's what she likes and It will give her subs I dont see why not.
@harsha40743 жыл бұрын
madam how to click on specific users indox box by his text - username in instagram
@PythonSimplified3 жыл бұрын
Try targeting the anchor element with the href of "/direct/inbox/": inbox_button = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "a[href='/direct/inbox/']"))).click() This would press the the "inbox" button on your individual account, let me know if I got you right :)
@harsha40743 жыл бұрын
@@PythonSimplified thank you so much mam your really so friendly replying stranger with out expecting anything I am amazed mam even my teachers won't repsond like you
@harsha40743 жыл бұрын
@@PythonSimplified import time from selenium import webdriver from selenium.webdriver.common.keys import Keys from selenium.webdriver.support import expected_conditions as EC from selenium.webdriver.common.by import By from selenium.webdriver.support.wait import WebDriverWait driver = webdriver.Chrome('C:/Users/91728/Desktop/python files/chromedriver') driver.get("www.instagram.com") username = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "input[name='username']"))) password = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "input[name='password']"))) username.send_keys("#username") password.send_keys("#password") button = WebDriverWait(driver, 2).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "button[type='submit']"))).click() not_now = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.XPATH, '//button[contains(text(), "Not Now")]'))).click() not_now_again = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.XPATH, '//button[contains(text(), "Not Now")]'))).click() inbox_open = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "a[class='xWeGp']"))).click() recent_message_open = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "a[class='-qQT3 rOtsg']"))).click() message_box = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.XPATH, "//textarea[@placeholder='Message...']"))) message_box.clear() time.sleep(5) message_box.send_keys("hi") message_box.send_keys(Keys.ENTER) #instead of recent_message_open I want to select the element using Username by adding an input field at first .mam please Kindly contact me on +917285906544 mam this is my whatsapp or I messaged you on instagram mam Please rey me I'll show you the image.
@PythonSimplified3 жыл бұрын
@@harsha4074 You cannot select a CSS class by class='-qQT3 rOtsg' it is a temporary class, you need something a bit more constant to rely on. Try the 'href' attribute of the anchor instead. So everywhere where you've targeted the 'class' property you'll need to change it to a different property that doesn't have any weird letters in it. If it still doesn't fix it - try sending me the error code you got.
@mattmovesmountains14433 жыл бұрын
Tutorial was very helpful, but I did run into that same issue you mentioned about having to hit enter more than once in the search bar. Even with multiple instances of the send_keys / ENTER command, that part wouldn't work. What I decided to do was call time.sleep(2) a couple of times between hitting ENTER, and it took a total of three instances of hitting ENTER to get by. Even then, the file grab was happening too quickly, and it took the thumbnails of the people in my Instagram stories... so I called for one more time.sleep to give the next page time to load, and it worked! Your tutorials are great - I just found them and appreciate the concise, helpful videos!
@PythonSimplified3 жыл бұрын
Hi Matt, thank you so much for your amazing feedback! 😁 You totally nailed it with the time.sleep() command! I actually just published a tutorial on Medium that tackles it, as many people were running into the exact same issue with the ENTER command (and would be very irresponsible of me to ignore that hahaha): medium.com/analytics-vidhya/web-scraping-instagram-with-selenium-b6b1f27b885 Or you can skip the detailed explanations and just check out the source code on GitHub (I will update it in the description of the video shortly): github.com/MariyaSha/WebscrapingInstagram/blob/main/WebscrapingInstagram_completeNotebook.ipynb So my solution was quite similar, however, I've done this through 2 ENTER presses and 3 time.sleep(5) waits, so maybe try to extend the wait for a bit more than 2 seconds and then you can get rid of the third ENTER command :) Thank again and have a fantastic week!
@mattmovesmountains14433 жыл бұрын
@@PythonSimplified that's actually really exciting that I came to the same conclusion you did. Even better still that you found a way to cut down on clicks. Thanks again for the tutorials!
@yavuzkaravelioglu57543 жыл бұрын
You explain each step very clearly, thanks for your effort
@Naveedkhan-sz3dd3 жыл бұрын
You are so glamourous and after that the way you teach.
@emeine87593 жыл бұрын
i want to be your student 😆 you are the best teacher i have ever seen
@andrespineiroc3 жыл бұрын
This video is great thanks but i haven't been able to do the first step of opening chrome and Instagram. Maria, can you please do a video explaining what you do before, with Selenium. The parts of importing etc.... I downloaded selenium but still get a traceback.
@PythonSimplified3 жыл бұрын
Hi Andres! :) I find that "pip install" doesn't always work, so I install everything with "conda install" when possible. If you are also using Anaconda, try: "conda install -c conda-forge selenium" If you are using another command line software let me know what it is and what kind of traceback are you getting and we can go from there 😉
@andrespineiroc3 жыл бұрын
@@PythonSimplified Thanks for your help! I am still struggling. I am using Selenium and here I detailed everything and still no solution www.reddit.com/r/learnpython/comments/kfn0wm/a_unique_no_module_named_selenium_problem_its_not/
@freelancervideoeditor Жыл бұрын
with yours videos I`ve been deployed my first flask app
@alaaaljadani66042 жыл бұрын
this is an amazing video! I would like to know if we can get a list of users who liked a post? thanks
@Onlinefreelancingacademy2 жыл бұрын
AttributeError: 'WebDriver' object has no attribute 'find_elements_by_tag_name' am getting this error whats the solution
@siddhantjohal9379 Жыл бұрын
Selenium removed the methods in the newer versions, you can try using an older version
@tamato27 Жыл бұрын
very nice tutorial I must say its easy to follow and thanks for all your hard work showing all of us, Just a question could you use a mixture of selenium and beutifullsoup to automate the login and parse the html? just a thought because it all works but the page loads takes forever
@parthgohil43602 жыл бұрын
Incredibly great explanations 🔥🔥. loved the video.
@sarangkkl2142 жыл бұрын
studying with you is a excitement
@Webisyen2 жыл бұрын
You are amazing in every way! Thank you for this useful tutorial.
@AminulislamSakib3 жыл бұрын
This tutorial is so sweet like you. Thank you so much Mariya ❤️
@PythonSimplified3 жыл бұрын
Thank you so much Saqib! 😀 I have a new Selenium tutorial premiering in 35 minutes: kzbin.info/www/bejne/ionHmIChm56ahpI We're expanding the Linkedin messaging bot to seem much more human than it should be, I highly recommend to check it out! 😁
@simurgh3143 жыл бұрын
Попав на эту страницу, я сперва подумал что ошибся... Умные девушки восхитительны!
@PythonSimplified3 жыл бұрын
Спасибочки Симург! 😃 А я просто в восторге, от кудо все знают что я по-русски говору?? Наверно наши наших везде узнают! 🤣
@simurgh3143 жыл бұрын
@@PythonSimplified Да!, это магия xD
@alexandramikhaylova80333 жыл бұрын
Mariya, thank you so much for the tutorial! What would you suggest to those who actually needs to delve deeper and get the data from each post (likes, reposts, account name and so on)?
@PythonSimplified3 жыл бұрын
Hi Alexandra! you're welcome! 😁 First of all, the most important suggestion is creating a "dummie account" (one that is not associated with your actual account). Since you're about to scrape so much information - it's best to avoid being detected as a bot (which sometimes may result in your account being deleted). Second, check out my community post regarding the new and improved resources for Instagram scraping (a commenting bot is included there, so this will save you lots of time): kzbin.infoUgwVQazZhNNqwdghhdh4AaABCQ Third, you'll need to understand the common blockers you'll be facing when traversing the DOM. I have 3 of the main and most annoying blockers apprehended in my Linkedin automation tutorial, so have a quick look before you spend hours trying to interact with hidden elements or dealing with "click intercept" exceptions: kzbin.info/www/bejne/jpWphqN8iqmnbpo Lastly - work very closely with the developer tools! The rule of thumb is - if you can do something with your keyboard and mouse - you can do it with Selenium as well! No matter which exceptions you're facing, you can always bypass them as long as you can perform the same action manually! Good luck and let me know if it helped! 😀
@alexandramikhaylova80333 жыл бұрын
@@PythonSimplified it helped a bit! Thank you :)
@maebbcow3 жыл бұрын
gurl this saved my life
@namangupta16023 жыл бұрын
I don't know my Keys.ENTER command is not working. I have wrote it 2 times too but still it didn't work
@PythonSimplified3 жыл бұрын
Hi Naman! 😀 Did you have a chance to see my recent community post on the updated code + article? You can find it here: kzbin.info/door/KQdc0-Targ4nDIAUrlfKiAcommunity?lb=UgwVQazZhNNqwdghhdh4AaABCQ There are a few ways to solve this, as double ENTER doesn't work anymore even on my end. Checkout the resources above and see what works best for you. Good luck, and let me know if it worked! 😁
@namangupta16023 жыл бұрын
@@PythonSimplified It did work!! you saved me I literally stuck in this for so long. Thank you so much! :)
@anglerfish613 жыл бұрын
What I mostly learned is a very good workflow to get info and use it. tnx :D
@mr.objector4682 Жыл бұрын
I need help When i tried to run the program, there's an error: SessionNotCreatedException: session not created: This version of ChromeDriver only supports Chrome version 110 Current browser version is 114.0.5735.111 with binary path C:\Program Files\Google\Chrome\Application\chrome.exe What should I do?
@Dynamite_mohit3 жыл бұрын
loved your style of teaching and Accent.
@vatsalsingh13842 жыл бұрын
How can we extract the trending images with links of the instagram post with its trending score of it.
@d-rey1758 Жыл бұрын
Any reason why the search box cell won't be working? doesn't seem to like the placeholder method
@uzairmughal93837 ай бұрын
how can we get the key numbers of insta posts through this technique? like the number of comments, likes, shares? can I see the posts performance data of some specific users through selenium?
@Ihsan_almohsin3 жыл бұрын
simply amazing, big thanks. love you
@PythonSimplified3 жыл бұрын
Thank you so much my friend! 😁
@geoffrygeorgemathew35052 жыл бұрын
Great video! Just a query, will this go against the current terms and conditions of Instagram which might lead to your personal account getting banned for obvious reasons?
@PythonSimplified2 жыл бұрын
Hi Geoffey, check out this vlog of mine, I talk about this in detail: kzbin.info/www/bejne/nGGlZ4Wai6yWg5o Always scrape from a dummy account! Not your personal one! :)
@noworriesmate_2 жыл бұрын
Puurrrrfect pun (probably not intended) at 22:40 😆
@MrAlb3rtazzo3 жыл бұрын
you are amazing, best python tutor ever :)
@stephenellis47777 ай бұрын
I'm getting a value error when trying to download the images ValueError: not enough values to unpack (expected 2, got 1) I copy/pasted your code and it still doesn't work.
@CERB9112 күн бұрын
Great video. it's possible to get all the comments of a post??
@temkipasse3 жыл бұрын
Crystal clear and good pedagogy !
@syedmuhammadbilalarshad12472 жыл бұрын
Thank you very much, this tutorial was very helpful and very very easy to understand, Cheers!! 🚀
@ru29793 жыл бұрын
Waao.Very helpful 🙏🙏❤️More videos like these please 😊
@youssefsaad79193 жыл бұрын
u dont need to scrap data u actually scrapped my heart
@shrikantnande82023 жыл бұрын
Hello thank you so much this helps me a lot, while following this code I had one error, instead of writing ENTER you can use RETURN so it will work properly. This solve my error.
@axvex5953 жыл бұрын
Doesn't insta have some protocol to deal with web scrappers?
@PythonSimplified3 жыл бұрын
Web scraping is perfectly legal, and many companies are actually using it to promote their business. With that said, each major website/webservice has a certain layer of protection from bots but it's not that difficult to outsmart it, even when captchas come into play. I personaly find that Facebook has far more layers of protection than Instagram and I'm suspecting it also has the ability to dynamically adjust it's code to prevent you from scraping time and again using the same script. For example, my code for scraping all the images from a certain user's account became obsolete after 2 days, during which I've scraped over 650+ images several times in a row. I had to turn the code into something more general, rather than targeting a very specific single element with "Xpath" & "starts-with" - I had to fetch all the elements of the same kind on the page and only then narrow down the list to only include the single element I wanted to target. So I know first hand that Facebook is reacting to scraping and it's reacting quite fast. With Instagram however, the same code that worked for me 3 months ago - is still relevant and works like a charm (please checkout the article on medium to see the upgraded version of the code I presented in the video): medium.com/analytics-vidhya/web-scraping-instagram-with-selenium-b6b1f27b885 I don't think you should be worried about scraping Instagram, that's for sure 😉
@axvex5953 жыл бұрын
@@PythonSimplified wow more of a reply than I expected, thanks a million!
@leonardobastos51403 жыл бұрын
Hello Mariya. Congratulation for video, I liked very much. A question: why you used .clear()?
@PythonSimplified3 жыл бұрын
Thank you Leonardo! 😀 I used my_input.clear() to make sure the input is empty before we type anything in, it's not a necessary step with Instagram but it's very handy when sending your keys to an input which already has text in it 😊 It will remove the existing text and only include the string of your following send_keys command
@leonardobastos51403 жыл бұрын
@@PythonSimplified Tanks Mariya.
@KhalilYasser3 жыл бұрын
Thanks a lot for all these gifts from you.
@PythonSimplified3 жыл бұрын
You're welcome, enjoy! 😀
@littlehearts7039 Жыл бұрын
you are the best Maria Sha .LOL
@kalaipradeep275311 ай бұрын
username and password value input.... This show TimeoutException error...😢
@huynhthichung9497 Жыл бұрын
I love your video so much! How do we scrape instgram influencers using this method?
@frantoimil14992 жыл бұрын
Great tutorial, I always learn something new, thanks for sharing
@hanaizdihar43683 жыл бұрын
hi, thanks it really helps, but do you have any video on how to get all the post information?
@dinalabiba12683 жыл бұрын
Hi, Thank you so much for the video. But can we save the images in form of CSV? not download it all and save it to our computer?
@PythonSimplified3 жыл бұрын
Hi Dina, you sure can! 😀 Checkout this thread on Stack Overflow, they explain how to do it: stackoverflow.com/questions/49070242/converting-images-to-csv-file-in-python Let me know if it works! 😊
@FAPfunchannel3 жыл бұрын
i took serveral days to learn crawl until i see your video, how to say how much i love this video and your teaching skills, many many tks for this, love u. can you make video to show how to automate periodly crawl coupons from ecomercel then insert to mysql database?
@zakariachender94283 жыл бұрын
funny smart cute and canada , to be honest i forget python ,selenium ,linux ,problems , networking , lol you are talented good luck
@juliushamilton36563 жыл бұрын
Wish I had known about this tool earlier, sounds very useful
@ashishjadhav14542 жыл бұрын
Not able send enter event in search box . tried to place Keys.ENTER multiple times but not executing correctly . do we have any alternative for this ?
@user-nv6ke5eh2w Жыл бұрын
now instagram layout is changed so XPATH plaaceholder is not working what should i can do now ??
@pierre25982 жыл бұрын
great stuff, as always, question: it`s difficult to choose with wich to start my first scraping (mechanical soup, butifull soup, selenium ...) goal is to automate txt messaging using a service that is behind my personnal account on internet and behind user:password authentification. Suggestion ?
@PythonSimplified2 жыл бұрын
Personally, I'd always go for Selenium! Beautiful and Mechanical Soup are only good for very simple XML sites... we rarely seem to encounter these in recent years 😉
@bruhlickd Жыл бұрын
Please, I can't scrap the airbnb site. How can I scrap it and take all the prices and location and rate of houses in a country? I'v tried in all ways, but couldn't.
@yaghiyahbrenner89023 жыл бұрын
Cypress rocks, you should try it.
@nikhilsrivastava91203 жыл бұрын
you can make web-scrapping look and sound fun
@johnyelachkar81552 жыл бұрын
Thanks for the video ... super nice ... i am struggling scraping comments from instagram using selenium ... any video on that ?