Web Scraping Instagram with Selenium

[@TheJohanHalim]

what happened if the post is not an image? IG lets you upload videos.

[@PythonSimplified]

Hi Johan 😀 You'll need to tackle this with a conditional statement, where videos would be saved under the ".mp4" extension and images under the ".png" extension mentioned in the end of the video. Let me know if you were able to figure it out! 😊if not - I can film a quick tutorial showing how to do it 😉

[@TheJohanHalim]

@@PythonSimplified please do! Also, how many images should I expect in my folder? I get a TypeError on the last for loop. TypeError: cannot use a string pattern on a bytes-like object I'm guessing its because of video format.

[@paulameneses2306]

​@@PythonSimplified Hi!! Congrats for the perfect content!! I've spent my day studying for a master data science project and you've been helping me a lot :) I had the same problem today with profiles with some specific photo types, videos and reels.. I couldn't save an image and I got the same error mentioned above.. Could you help us please? Thanks!! ;)

[@PythonSimplified]

@@paulameneses2306 thank you so much dear! 😁 Sure, I'll look into it over the weekend and adjust the code to include a conditional statement for videos 😉 we'll be in touch!

[@PythonSimplified]

​@@TheJohanHalim Yes, you are absolutely correct Johan!😊 You get this type of error when trying to save a collection of images (video) as a single .png or .jpeg image, it's due to an incorrect format. The amount of images you should expect differs from one computer to another, depending on the size/scale of the display. The code in this tutorial would get you the number of images that results in a single scroll event. And as Instagram uses a dynamic language - the more you scroll, the more images are loaded to the page. If you'd like to include several scroll events - checkout my community post, where I include additional resources, a detailed article and code examples on how you can expend this bot: kzbin.infoUgwVQazZhNNqwdghhdh4AaABCQ I'll get back to you after the weekend with a solution to your video question 😉

[@ankurgupta7102]

I never imagined that python learning could have this much glamour.

[@akilthangavel8500]

hahaha

[@AgriculturaDigital]

Very good comment

[@johnames6430]

it was either fake Gamer Girl, OnlyFans, or this. But there is a lot of competition in those other areas so she went with this.

[@johnames6430]

by the way the whole thing of her in the right side of the screen is planned out, she has her hair there to hide that she's wearing something hoping to appear nude so people will click and it will go viral or something 😂 Wish her the best of luck though! No hate! 😘

[@timothyo718]

@@johnames6430 What a hater.

[@sarthakpawar2407]

Me saw the thumbnail and click it Me (after 10 mins) : ooh! It's a programming tutorial

[@PythonSimplified]

hahahaha indeed! 🤣

[@robinferizi9073]

lol 😂

[@makeithappen5846]

I love your style of knowledge sharing. You made it simple enough to understand by someone like me who is just beginning to learn python. Thanks!

[@juliam9090]

Compliment from a fellow girl coder, this video was super informative and entertaining and you are obviously bright and talented!

[@TimMattison]

This content is really great. Thank you for sharing it. Years ago I used to do web scraping back when there was a lot less JS and interactivity but haven't done it in a long time. This video got me back into it. Keep it up!

[@PAuLXPlain]

*Lol , I Almost Forgot I came here to Learn Python! haha Stunning Looks!*

[@PythonSimplified]

Thank you! 😆 I may have went a bit overboard on this video XD

[@shaharrefaelshoshany9442]

@@PythonSimplified Super hot supet smart :))

[@robertmainville4881]

@@PythonSimplified Well, I think you were overdressed...

[@Scal]

Thank you so much for explaining and showing every basic steps in details ! Lots of beginners like me get stuck in setup steps that can seem obvious to experienced developpers. For exemple thank you for explaining and showing all the download and setup Chrome driver steps. Even on some big websites pass quickly these basics setup steps. I was stuck but thanks to you I made it ! Thanks again !!!

[@d-rey1758]

Cool vid Maria! But on the days there isn't a "not now" button, the whole code grinds to a holt. To know how to add a function where if the "not now" button is present then code clicks on it and if it isn't present then the code skips to the step would be awesome!!

[@tamzin1223]

Omg please!!🥹

[@davidliu7246]

add a timeout to when waiting for "not now" to appear, and then put it in a try/catch block.

[@d-rey1758]

@@davidliu7246 thanks, I found it a while ago using try and except. now i just need help creating a chatbot. At the moment using nlp, spacy, textblob and a ton of for-loops

[@Thepathtoprofits]

Thank you for this tutorial!. I am currently learning python on datacamp and haven't learned or seen any real world applications. I am definitely going to try this out and add what I learned from this video to my skillset.!

[@PrinceKumar-el7ob]

i don't know why i am watching it instead of listening to music but the way she teaches is real fun!!

[@robertn2997]

You explained Selenium very clear. Can you also explain in a video on how to prevent to be detected as a bot? I read many post on stack overflow but Selenium still got detected as a bot, even on the first page load.

[@illuminated2438]

Very difficult. She's a world-class beauty, yet providing world class teaching on a very important topic.

[@xilllllix]

learned some good web scraping practices here like waiting for elements to be clickable, clearing the input boxes, etc. thanks!

[@piriwo]

Great content! Very clear and useful. Btw you don't need to add the local path of the webdriver as long as you have it in your Environment PATH. It looks over there by default. Also, by the end of the video you can get rid of the counter variable if you use enumerate.

[@PythonSimplified]

Wow, thank you Yaniv!! This is fantastic - we can save it there once and never worry about it again! !!👏👏👏 I'll just sit down in shame and be impressed with your super-efficient coding skills 😂😂 אגב!! אני ממש שמחה לראות שחברה׳ ישראלים מצטרפים לחגיגה, ועוד עם כאלה עצות נדירות!! תודה רבה יניב, שיחקת אותה! 😀

[@piriwo]

@@PythonSimplified חחח ממש לא ציפיתי תשובה בעברית! אבל באמת תודה על הסרטון זה עזר לי להבין הרבה דברים. הPATH היה סתם משהו קטן. תמשיכי כך!

[@PythonSimplified]

@@piriwo תודה רבה, will do! :)

[@Minerbush]

חשבתי אני הישראלי היחיד פה😅

[@HabibKhan-kj8um]

OMG you're the best ! I was hitting my head on the wall. In reality you showed it in a way simple way. Thank you

[@MariosMartiopoulos]

I thought I didn't know English but now I think I do. Incredible articulation!!!

[@pranshubansal355]

Thanks for this info. I am able to download only 58 images at one go, is it possible to download all images around 2000 with this at one go ? Can you please advise.

[@PythonSimplified]

Hi Pranshu! yes, you are able to download as many images as you need! 😀Just implement the scroll event inside a loop, just like this (scrolling 10 times to the bottom of the batch): for j in range(0,10): driver.execute_script("window.scrollTo(0, document.body.scrollHeight);") time.sleep(5) //wait 5 seconds The more you loop, the more images you scrape! I have a video premiering soon where I explain it in detail, check out "scroll to the bottom of the page" in the timestamps if you miss it 😉

[@josecastellon9183]

You are the most intelligent and beautiful teacher of all.

[@guillermo._._]

Thank you for the video. Very clear and straight forward. Im having trouble with the searchbox.send_keys(Keys.ENTER) command. I tried ENTERing twice but still doesnt work. Any sugestions?

[@PythonSimplified]

Thank you so much Luisgui 😁 Try the code I've just posted on my Github, you can solve it with time.sleep(seconds), it's in the "search keywords" section: github.com/MariyaSha/WebscrapingInstagram/blob/main/WebscrapingInstagram_completeNotebook.ipynb I actually just finished working on a Medium article about this where I explain everything in detail, I'm just waiting for my publication to approve it and then I'll send you a link 😉

[@thebuttnakedpodcast3006]

Thanks again, Mariya. Always the right lessons at the right time.

[@PythonSimplified]

My pleasure! have fun! 😀

[@J0hn4rt15t]

Very good tutorial. You could use in for loop, the enumerate to avoid the counter assignment. for counter, image in enumerate (images): save_as = os.[path.join(path, keyword[1:] + str(counter) + ‘.jpg’) wget.download(image, save_as)

[@drnotebook]

Great video. Thank you so much. Mariysha you are a very good teacher. I hope that you can learn the correct accent on the specific word ( `at-tri-bute ), emphasis on the first syllable, because it is so often when speaking about Python and objects. You routinely mistakenly swap or mispronounce the verb attribute ( at-`trib-ute ) and the noun attribute ( `at-tri-bute ). I understand that you are not a native English speaker, and please try to take note of this and improve the accent on this word. In Python a class or object `at-tri-bute is a noun, aka "method" or bound function. Great video. Keep cranking them out.

[@bryanmurasira9682]

this and arjancodes are by far my favorite channels!

[@romiolover6852]

i started knowing why i am actually watching your video after the introduction :)

[@amadoucoulibaly2916]

Mariya, I love you. Thanks, you gave me what I was looking for since 3 days

[@VikramKumar-yv8uu]

wow thats amazing Mariyasha, i like your way of teaching, its very helpful for me. Both are in same boat upcoming future data scientist

[@PythonSimplified]

Thank you so much Vikram, I'm glad I could help! 😄

[@KyotonoTori]

thank you soo much you just saved me! im gonna rock that interview

[@PythonSimplified]

That's awesome to hear Arthur! Good luck on your interview! 😀

[@chiranjeebroychowdhury7759]

Perfect intro to Selenium! Very nice video! Thanks again Mariya!

[@PythonSimplified]

Thank you Chiranjeeb! I told you you gonna like Selenium! 😁

[@chiranjeebroychowdhury7759]

@@PythonSimplified Yep! You were correct!

[@techienomadiso8970]

This gender is always so organized.!!! A good session it was with so much clarity.

[@PythonSimplified]

Thank you, I'm glad you found it helpful! 😃

[@faizmohammad8079]

I was wandering why don't you make full series of Selenium. Your Teaching is like Perfect :) I literally enjoyed a lot. Thankyou so much .

[@PythonSimplified]

Thank you so much Faizmohammad! 😁 I've just posted a brand new video on Selenium, this time webs craping Facebook: kzbin.info/www/bejne/iaS7lKylmtuejJI It's some sort of a series! just with a bunch videos on other subjects in between 😄

[@ahmedshalaby185]

Hello ,I really like you work, just started to do some web scrapping and you tutorial was of a great help for me , you are organized, your explanation is perfect clear and easy to follow, just one thing I noticed and I already fixed but I wanna know if there is other way around. the problem is the search box don't appear if the chrome screen size is big so we just get the side bar with the search symbol which need to be pressed to open the search box, which I tried to figure out how to make it but couldn't. so I just added a screen size (driver.set_window_size(740,500)) to make sure the search box will appear automatically. If you know how to fix it the normal way that would be nice, Thank you

[@voronow3]

When I see and listen this girl I'm fell the happiness...

[@manuelivanurbinamartinez4536]

GENIUS!!!!! I really liked your video, you were able to solve the concerns I had and no one else could solve. THE BEST!!!

[@henrylaw87]

The most beautiful women in KZbin who teaches python. Can't concentrate 😂

[@Arda1982]

I thought the same :D

[@smalirizvi8026]

All boys' fav teacher!

[@PythonSimplified]

99.9% of programmers are boys anyways! 😃

[@smalirizvi8026]

@@PythonSimplified so glad to hear back from you. I have a little query regarding scraping. And its getting horrendous. I want to scrape some details from the *info* section of the profiles in a group. Is it doable? Your response will be like a lifesaver

[@PythonSimplified]

​@@smalirizvi8026 the rule of thumb is - anything you can target with your mouse and keyboard - you can target with Selenium! 😃 Some platforms have more blockers than others, I suggest watching my Linkedin Bot tutorial where I show how to handle 3 very annoying blockers such as "click intercept" and hidden elements: kzbin.info/www/bejne/jpWphqN8iqmnbpo If you run into specific errors let me know, but as long as you're working closely with the Developer Tools and allow enough time for the elements to load with time.sleep() - the sky is the limit! 😁

[@smalirizvi8026]

@@PythonSimplified I watched your vid. It was far above my knowledge and expertise. Actually I am trying to extract every profile's information in some groups on *Facebook* for my Machine Learning work. So far, I think that I should watch your video of applying selenium on Facebook. And I will convert python code with java whenever I face some blockers there as well as use time.sleep(). Do u think that this should be fine?

[@smalirizvi8026]

You have literally earned my sub! 💎💎 Thank you so much for replying and taking notice of my problem. Looking forward to you as I am pretty much done with my attempts with it

[@ishaankapoor933]

This channel is underrated, Change my mind!

[@mohammadjavadhaji6396]

Best video seen about web scraping and automation. But i really couldn't figure out this jupiter thing. What is jupiter?????

[@PythonSimplified]

Jupyter Notebook is a very handy interface, where we can process our code cell by cell. It is very similar to Google Colab, and we can access it directly from our Anaconda terminal with a very basic command - "jupyter notebook". If you wanna find out more about this interface, please check out one of my first tutorials, where I explain all about it in detail: kzbin.info/www/bejne/oKHCZIGFgK2hb8U So generally, when you're using a traditional IDE, it runs all your code at once, while notebooks like Jupyter allow you to separate your program into sections and run each of these sections independently. I find it to be very handy when teaching/learning, and I highly recommend to give it a try 😉

[@PythonSimplified]

And thank you!! 😁😁😁 (sorry, I should have started from this but I got carried away with the explanation hahahaha)

[@matheus7405]

OMG!!! your channel is perfect , thanks for this class !!!!

[@PythonSimplified]

Thank you so much Matheus!! Glad you liked it! 😁

[@thegrowthhackert4248]

This channel has super easy tutorials on how to do it: kzbin.info/door/YvGiDV1JfJTpphxtKd7r_Afeatured

[@J3rs3yM1k3]

You should check if the "Not Now" prompts are even presented before assuming you will need to click that... twice.

[@vijaykumarlokhande1607]

WebDriverWait(driver, 10) What do we mean by 10. And is it constant or subject to our choice? How to decide it.

[@PythonSimplified]

Hi Vijaykumar! 😃 to my understanding, the value 10 in the above example represents the timeout value (in seconds). Meaning - if this element was not detected within 10 seconds, you'll get a TimeoutException. You can definitely adjust it to any value you'd like! Selenium documentation keeps it at 10, but I've seen other examples with 5 and 15 seconds, it all depends on how long it takes the given page to load 😊

[@nandkumarpawar7]

She saved that "Purrrfect" for this moment.

[@adamthedev]

Solid tutorial! You're great at teaching!! Thanks

[@PythonSimplified]

Thank you Adam, glad you liked it! 😀

[@thesouthsidedev1812]

This is the coolest thing I have learnt today

[@PythonSimplified]

Awesome! I'm glad I could help! 😁

[@suiciniv76]

I'd like to say that I loved it you're amazing and please keep on it, I'm happy too because English isn't my mother language and I understood you very well 😊.

[@PythonSimplified]

Thank you Vinicius! I'm so happy to hear that! 😁😁😁 English isn't my first language either, so I'm always trying to use simple words whenever possible (the complicated words are also much harder to pronounce, I sound very Russian when I do this hahahaha) Thank again and Merry Christmas!! 😊

[@suiciniv76]

@@PythonSimplified no problem, where are you from? Could you please make a video explaining how to understand boxplot charts? Merry Christmas 🙂

[@FilamEFX]

Love the tut, you're a smart lady, no need to use gimmicks for clicks.

[@Waso46]

I agree but if that's what she likes and It will give her subs I dont see why not.

[@harsha4074]

madam how to click on specific users indox box by his text - username in instagram

[@PythonSimplified]

Try targeting the anchor element with the href of "/direct/inbox/": inbox_button = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "a[href='/direct/inbox/']"))).click() This would press the the "inbox" button on your individual account, let me know if I got you right :)

[@harsha4074]

@@PythonSimplified thank you so much mam your really so friendly replying stranger with out expecting anything I am amazed mam even my teachers won't repsond like you

[@harsha4074]

@@PythonSimplified import time from selenium import webdriver from selenium.webdriver.common.keys import Keys from selenium.webdriver.support import expected_conditions as EC from selenium.webdriver.common.by import By from selenium.webdriver.support.wait import WebDriverWait driver = webdriver.Chrome('C:/Users/91728/Desktop/python files/chromedriver') driver.get("www.instagram.com") username = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "input[name='username']"))) password = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "input[name='password']"))) username.send_keys("#username") password.send_keys("#password") button = WebDriverWait(driver, 2).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "button[type='submit']"))).click() not_now = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.XPATH, '//button[contains(text(), "Not Now")]'))).click() not_now_again = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.XPATH, '//button[contains(text(), "Not Now")]'))).click() inbox_open = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "a[class='xWeGp']"))).click() recent_message_open = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.CSS_SELECTOR, "a[class='-qQT3 rOtsg']"))).click() message_box = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.XPATH, "//textarea[@placeholder='Message...']"))) message_box.clear() time.sleep(5) message_box.send_keys("hi") message_box.send_keys(Keys.ENTER) #instead of recent_message_open I want to select the element using Username by adding an input field at first .mam please Kindly contact me on [phone] mam this is my whatsapp or I messaged you on instagram mam Please rey me I'll show you the image.

[@PythonSimplified]

​@@harsha4074 You cannot select a CSS class by class='-qQT3 rOtsg' it is a temporary class, you need something a bit more constant to rely on. Try the 'href' attribute of the anchor instead. So everywhere where you've targeted the 'class' property you'll need to change it to a different property that doesn't have any weird letters in it. If it still doesn't fix it - try sending me the error code you got.

[@mattmovesmountains1443]

Tutorial was very helpful, but I did run into that same issue you mentioned about having to hit enter more than once in the search bar. Even with multiple instances of the send_keys / ENTER command, that part wouldn't work. What I decided to do was call time.sleep(2) a couple of times between hitting ENTER, and it took a total of three instances of hitting ENTER to get by. Even then, the file grab was happening too quickly, and it took the thumbnails of the people in my Instagram stories... so I called for one more time.sleep to give the next page time to load, and it worked! Your tutorials are great - I just found them and appreciate the concise, helpful videos!

[@PythonSimplified]

Hi Matt, thank you so much for your amazing feedback! 😁 You totally nailed it with the time.sleep() command! I actually just published a tutorial on Medium that tackles it, as many people were running into the exact same issue with the ENTER command (and would be very irresponsible of me to ignore that hahaha): medium.com/analytics-vidhya/web-scraping-instagram-with-selenium-b6b1f27b885 Or you can skip the detailed explanations and just check out the source code on GitHub (I will update it in the description of the video shortly): github.com/MariyaSha/WebscrapingInstagram/blob/main/WebscrapingInstagram_completeNotebook.ipynb So my solution was quite similar, however, I've done this through 2 ENTER presses and 3 time.sleep(5) waits, so maybe try to extend the wait for a bit more than 2 seconds and then you can get rid of the third ENTER command :) Thank again and have a fantastic week!

[@mattmovesmountains1443]

@@PythonSimplified that's actually really exciting that I came to the same conclusion you did. Even better still that you found a way to cut down on clicks. Thanks again for the tutorials!

[@yavuzkaravelioglu5754]

You explain each step very clearly, thanks for your effort

[@Naveedkhan-sz3dd]

You are so glamourous and after that the way you teach.

[@emeine8759]

i want to be your student 😆 you are the best teacher i have ever seen

[@andrespineiroc]

This video is great thanks but i haven't been able to do the first step of opening chrome and Instagram. Maria, can you please do a video explaining what you do before, with Selenium. The parts of importing etc.... I downloaded selenium but still get a traceback.

[@PythonSimplified]

Hi Andres! :) I find that "pip install" doesn't always work, so I install everything with "conda install" when possible. If you are also using Anaconda, try: "conda install -c conda-forge selenium" If you are using another command line software let me know what it is and what kind of traceback are you getting and we can go from there 😉

[@andrespineiroc]

@@PythonSimplified Thanks for your help! I am still struggling. I am using Selenium and here I detailed everything and still no solution www.reddit.com/r/learnpython/comments/kfn0wm/a_unique_no_module_named_selenium_problem_its_not/

[@freelancervideoeditor]

with yours videos I`ve been deployed my first flask app

[@alaaaljadani6604]

this is an amazing video! I would like to know if we can get a list of users who liked a post? thanks

[@Onlinefreelancingacademy]

AttributeError: 'WebDriver' object has no attribute 'find_elements_by_tag_name' am getting this error whats the solution

[@siddhantjohal9379]

Selenium removed the methods in the newer versions, you can try using an older version

[@tamato27]

very nice tutorial I must say its easy to follow and thanks for all your hard work showing all of us, Just a question could you use a mixture of selenium and beutifullsoup to automate the login and parse the html? just a thought because it all works but the page loads takes forever

[@parthgohil4360]

Incredibly great explanations 🔥🔥. loved the video.

[@sarangkkl214]

studying with you is a excitement

[@Webisyen]

You are amazing in every way! Thank you for this useful tutorial.

[@AminulislamSakib]

This tutorial is so sweet like you. Thank you so much Mariya ❤️

[@PythonSimplified]

Thank you so much Saqib! 😀 I have a new Selenium tutorial premiering in 35 minutes: kzbin.info/www/bejne/ionHmIChm56ahpI We're expanding the Linkedin messaging bot to seem much more human than it should be, I highly recommend to check it out! 😁

[@simurgh314]

Попав на эту страницу, я сперва подумал что ошибся... Умные девушки восхитительны!

[@PythonSimplified]

Спасибочки Симург! 😃 А я просто в восторге, от кудо все знают что я по-русски говору?? Наверно наши наших везде узнают! 🤣

[@simurgh314]

@@PythonSimplified Да!, это магия xD

[@alexandramikhaylova8033]

Mariya, thank you so much for the tutorial! What would you suggest to those who actually needs to delve deeper and get the data from each post (likes, reposts, account name and so on)?

[@PythonSimplified]

Hi Alexandra! you're welcome! 😁 First of all, the most important suggestion is creating a "dummie account" (one that is not associated with your actual account). Since you're about to scrape so much information - it's best to avoid being detected as a bot (which sometimes may result in your account being deleted). Second, check out my community post regarding the new and improved resources for Instagram scraping (a commenting bot is included there, so this will save you lots of time): kzbin.infoUgwVQazZhNNqwdghhdh4AaABCQ Third, you'll need to understand the common blockers you'll be facing when traversing the DOM. I have 3 of the main and most annoying blockers apprehended in my Linkedin automation tutorial, so have a quick look before you spend hours trying to interact with hidden elements or dealing with "click intercept" exceptions: kzbin.info/www/bejne/jpWphqN8iqmnbpo Lastly - work very closely with the developer tools! The rule of thumb is - if you can do something with your keyboard and mouse - you can do it with Selenium as well! No matter which exceptions you're facing, you can always bypass them as long as you can perform the same action manually! Good luck and let me know if it helped! 😀

[@alexandramikhaylova8033]

@@PythonSimplified it helped a bit! Thank you :)

[@maebbcow]

gurl this saved my life

[@namangupta1602]

I don't know my Keys.ENTER command is not working. I have wrote it 2 times too but still it didn't work

[@PythonSimplified]

Hi Naman! 😀 Did you have a chance to see my recent community post on the updated code + article? You can find it here: kzbin.info/door/KQdc0-Targ4nDIAUrlfKiAcommunity?lb=UgwVQazZhNNqwdghhdh4AaABCQ There are a few ways to solve this, as double ENTER doesn't work anymore even on my end. Checkout the resources above and see what works best for you. Good luck, and let me know if it worked! 😁

[@namangupta1602]

@@PythonSimplified It did work!! you saved me I literally stuck in this for so long. Thank you so much! :)

[@anglerfish61]

What I mostly learned is a very good workflow to get info and use it. tnx :D

[@mr.objector4682]

I need help When i tried to run the program, there's an error: SessionNotCreatedException: session not created: This version of ChromeDriver only supports Chrome version 110 Current browser version is 114.0.5735.111 with binary path C:\Program Files\Google\Chrome\Application\chrome.exe What should I do?

[@Dynamite_mohit]

loved your style of teaching and Accent.

[@vatsalsingh1384]

How can we extract the trending images with links of the instagram post with its trending score of it.

[@d-rey1758]

Any reason why the search box cell won't be working? doesn't seem to like the placeholder method

[@uzairmughal9383]

how can we get the key numbers of insta posts through this technique? like the number of comments, likes, shares? can I see the posts performance data of some specific users through selenium?

[@Ihsan_almohsin]

simply amazing, big thanks. love you

[@PythonSimplified]

Thank you so much my friend! 😁

[@geoffrygeorgemathew3505]

Great video! Just a query, will this go against the current terms and conditions of Instagram which might lead to your personal account getting banned for obvious reasons?

[@PythonSimplified]

Hi Geoffey, check out this vlog of mine, I talk about this in detail: kzbin.info/www/bejne/nGGlZ4Wai6yWg5o Always scrape from a dummy account! Not your personal one! :)

[@noworriesmate_]

Puurrrrfect pun (probably not intended) at 22:40 😆

[@MrAlb3rtazzo]

you are amazing, best python tutor ever :)

[@stephenellis4777]

I'm getting a value error when trying to download the images ValueError: not enough values to unpack (expected 2, got 1) I copy/pasted your code and it still doesn't work.

[@CERB91]

Great video. it's possible to get all the comments of a post??

[@temkipasse]

Crystal clear and good pedagogy !

[@syedmuhammadbilalarshad1247]

Thank you very much, this tutorial was very helpful and very very easy to understand, Cheers!! 🚀

[@ru2979]

Waao.Very helpful 🙏🙏❤️More videos like these please 😊

[@youssefsaad7919]

u dont need to scrap data u actually scrapped my heart

[@shrikantnande8202]

Hello thank you so much this helps me a lot, while following this code I had one error, instead of writing ENTER you can use RETURN so it will work properly. This solve my error.

[@axvex595]

Doesn't insta have some protocol to deal with web scrappers?

[@PythonSimplified]

Web scraping is perfectly legal, and many companies are actually using it to promote their business. With that said, each major website/webservice has a certain layer of protection from bots but it's not that difficult to outsmart it, even when captchas come into play. I personaly find that Facebook has far more layers of protection than Instagram and I'm suspecting it also has the ability to dynamically adjust it's code to prevent you from scraping time and again using the same script. For example, my code for scraping all the images from a certain user's account became obsolete after 2 days, during which I've scraped over 650+ images several times in a row. I had to turn the code into something more general, rather than targeting a very specific single element with "Xpath" & "starts-with" - I had to fetch all the elements of the same kind on the page and only then narrow down the list to only include the single element I wanted to target. So I know first hand that Facebook is reacting to scraping and it's reacting quite fast. With Instagram however, the same code that worked for me 3 months ago - is still relevant and works like a charm (please checkout the article on medium to see the upgraded version of the code I presented in the video): medium.com/analytics-vidhya/web-scraping-instagram-with-selenium-b6b1f27b885 I don't think you should be worried about scraping Instagram, that's for sure 😉

[@axvex595]

@@PythonSimplified wow more of a reply than I expected, thanks a million!

[@leonardobastos5140]

Hello Mariya. Congratulation for video, I liked very much. A question: why you used .clear()?

[@PythonSimplified]

Thank you Leonardo! 😀 I used my_input.clear() to make sure the input is empty before we type anything in, it's not a necessary step with Instagram but it's very handy when sending your keys to an input which already has text in it 😊 It will remove the existing text and only include the string of your following send_keys command

[@leonardobastos5140]

@@PythonSimplified Tanks Mariya.

[@KhalilYasser]

Thanks a lot for all these gifts from you.

[@PythonSimplified]

You're welcome, enjoy! 😀

[@littlehearts7039]

you are the best Maria Sha .LOL

[@kalaipradeep2753]

username and password value input.... This show TimeoutException error...😢

[@huynhthichung9497]

I love your video so much! How do we scrape instgram influencers using this method?

[@frantoimil1499]

Great tutorial, I always learn something new, thanks for sharing

[@hanaizdihar4368]

hi, thanks it really helps, but do you have any video on how to get all the post information?

[@dinalabiba1268]

Hi, Thank you so much for the video. But can we save the images in form of CSV? not download it all and save it to our computer?

[@PythonSimplified]

Hi Dina, you sure can! 😀 Checkout this thread on Stack Overflow, they explain how to do it: stackoverflow.com/questions/49070242/converting-images-to-csv-file-in-python Let me know if it works! 😊

[@FAPfunchannel]

i took serveral days to learn crawl until i see your video, how to say how much i love this video and your teaching skills, many many tks for this, love u. can you make video to show how to automate periodly crawl coupons from ecomercel then insert to mysql database?

[@zakariachender9428]

funny smart cute and canada , to be honest i forget python ,selenium ,linux ,problems , networking , lol you are talented good luck

[@juliushamilton3656]

Wish I had known about this tool earlier, sounds very useful

[@ashishjadhav1454]

Not able send enter event in search box . tried to place Keys.ENTER multiple times but not executing correctly . do we have any alternative for this ?

[@user-nv6ke5eh2w]

now instagram layout is changed so XPATH plaaceholder is not working what should i can do now ??

[@pierre2598]

great stuff, as always, question: it`s difficult to choose with wich to start my first scraping (mechanical soup, butifull soup, selenium ...) goal is to automate txt messaging using a service that is behind my personnal account on internet and behind user:password authentification. Suggestion ?

[@PythonSimplified]

Personally, I'd always go for Selenium! Beautiful and Mechanical Soup are only good for very simple XML sites... we rarely seem to encounter these in recent years 😉

[@bruhlickd]

Please, I can't scrap the airbnb site. How can I scrap it and take all the prices and location and rate of houses in a country? I'v tried in all ways, but couldn't.

[@yaghiyahbrenner8902]

Cypress rocks, you should try it.

[@nikhilsrivastava9120]

you can make web-scrapping look and sound fun

[@johnyelachkar8155]

Thanks for the video ... super nice ... i am struggling scraping comments from instagram using selenium ... any video on that ?