PyAutoGUI - Locate anything on your screen | Simple Pyautogui project

[@coding101withsteve8]

Hello All 🙋🏻‍♂️ If you have any kind of customized tool or app request. You can reach out to me on Instagram or email. I can create tools or apps for you. instagram.com/stevegen1907 OR [e-mail] Thank You

[@lukkaskkjk]

Thanks for the tutorial Steve, can you do a tutorial teaching us how to create a bot that detects if the image is appearing on the screen or not?

[@olisamping5339]

IDK why but Indians is the best techno teacher. Your explanation is so clear. Thank you

[@coding101withsteve8]

Thank you for your feedback ❤❤

[@macavitymacavity126]

Steve, I really went far in a personal project after watching your stuff. You are a really good teacher, you not only give great content and information, you show the mindset of how to take on each task and problem. Thx a lot.

[@coding101withsteve8]

Thank you so much. I'm glad to know it helped you to go far in your project ❤ All the best

[@Tinyjb0]

Thanks for the quick and easy to understand tutorial!

[@coding101withsteve8]

You're most welcome

[@eanlakins1754]

The pyautogui locateonscreen feature gives me the failed to read, file is missing, has improper permissions, or is an unsupported or invalid format. Any suggestions to fix this??

[@buildsrike791]

Same as me

[@24-Card]

Is the png saved locally (to the location of the executable)?

[@zerschmetterling6840]

Which OS ?

[@Enthralpy]

Loved the video! Feels like I can do a LOT more now than I could before. Also, you can combine moveTo() and click() with click(x = (enter X coordinates), y = (enter Y coordinates)). And I ran into an issue where my brower took too long to load the page before it could find the Search bar, so I made a function that makes your program wait before trying to find an image incase your browser loads too slowly: import pyautogui as pag def find(img): while True: try: x, y = pag.locateCenterOnScreen(img, confidence=0.9) print("Found") return (x, y) except TypeError: sleep(1) print("Waiting") pass You would use it like this: xy = find("image.png") click(xy)

[@CadaverTheGhoul]

if im using pyautogui and i have 10 different instances running and when they handle errors they need to use pyautogui to handle them but whichever tab is the active one on my screen ie whichever instance launced last ends up getting messed with when it is another one buried behind it that is having an error, how do i switch to the tab of python/selenium code that is having the error?

[@ff_0xx266]

Thank you, this helped me so much! I love the demonstration, you explained it perfectly!

[@coding101withsteve8]

Glad it was helpful! Thank you for the feedback 😇

[@arthursullivan7393]

Image not found problem: multi monitors PyAutoGui only supports the primary monitor, test your code on the primary and it will work fine.

[@bagumandal]

I love your vlogs! They are so entertaining and informative.

[@picofa]

Thanks, this was a great start for me, I automated some task using try and except, and a while that cicles every second and search if one of the images show on the screen, if the locateonscreen function doesn't find it, it shows an error and doesn't continue inside the try function. If the images is found there is no error and a code of a macro can be executed. I would add to this video that the cheat sheet of the pyautogui library is very useful, can be found on Google. The functions pyautogui.position() (print mouse position) and pyautogui.moveTo(x=1857, y=1944, duration = 0.2) (where x and y are positions on screen) can be used to click on something else that is not the center of the image, and is very useful for automation purposes. A code example of what I did: import pyautogui import cv2, numpy import time pyautogui.position() # find mouse position for developing while(True): time.sleep(1) # wait 1 second before another cicle try: x, y= pyautogui.locateCenterOnScreen(r"image_path.png", confidence = 0.9) pyautogui.moveTo(x=1873, y=1634, duration = 0.2) pyautogui.leftClick() time.sleep(1) pyautogui.moveTo(x=1857, y=1944, duration = 0.2) pyautogui.leftClick() time.sleep(1) except: None Also, you need to install "pip install opencv-python", it is required too. To exit the cicle I stop it from the terminal, there is also a funcion on pyautogui to exit a program, it is pyautogui.FailSafeException. I hope this comment can help someone.

[@coding101withsteve8]

That's great!!!

[@gabrielt3578]

Clear code, nice video! Thank you bro

[@coding101withsteve8]

You're welcome!

[@d8822d]

Great channel, Upload more!

[@coding101withsteve8]

Thank you. That's the plan.

[@d8822d]

@@coding101withsteve8 Yes, if you do it 3 times a week, your channel will have 100k subs in few month mark my words.just keep making content about python only

[@Rainquiller]

question. where did you save the image file? should it be in the python directory or anywhere in pc?

[@donaldtrunp4597]

You can save it anywhere in the PC and copy its location. But for me I would prefer creating a python directory for your photos so that it would be pretty much easier to find and organized.

[@dominusdone5023]

I had persmission problems so I put it in the same folder as my code

[@arbangsg]

Thx so much you are the best teacher for me

[@coding101withsteve8]

Thank you 😇 Glad you learnt something

[@oxydripgen]

great tutorial. I still have a question, when i run the same code as you did in 2:07 it says "OSError: Failed to read image.png because this file is missing, has improper permissions, or is an unsupported or invalid format"... i have saved the file in the same directory as my program as an png file. I also tried with other files. do you maybe know the issue?

[@coding101withsteve8]

Hello. Thank you for your comment. It could be possible that the image file was of another format before and you just changed the extension. Eg. If it was image.jpg... You changed it nto image.png. then this error can come. Secondly you can try renaming the file. Thanks you. Hope that helps 😇

[@oxydripgen]

@@coding101withsteve8 thank you for the answer aswell, i already fixed my issue, i am new to python and did not have my folder open, so my program couldn't recognize the images in the folder

[@coding101withsteve8]

@@oxydripgen Glad you solved it on your own. ☺

[@tuvelout]

@@oxydripgen having the folder with the file ".png" open or close shouldn't make any difference, only if it was there you obtained the croped image, program was searching for.

[@pluderr3947]

@@tuvelout Hey man, it doesn't work for me. I have it saved as a PNG file but it still doesn't work. Do you know what the issue would be?

[@palap9506]

thanks brother, this is very good, it worked for me. i gained so much knowledge. because you i will try progrmaming

[@Machiuka]

Awesome tutorial. I've learned a lot from it.

[@coding101withsteve8]

Thank you so much, Glad you learnt 😇

[@Michael-hs2wh]

That tool is so increadibly helpful

[@xilllllix]

needed this tutorial today, thanks!

[@KauaLopes-xz4uf]

thanks friend you are a friend, I needed to know how to use the image function thanks, I just found the way you use write but I'm a newbie in automo so I need to learn more.

[@meraklmuskulpesent8313]

Hi, for some reason, locateOnScreen function always returns None, despite both the code and the image are located in the same folder. Thank you.

[@nors1056]

did you fix it?

[@Harishkumar-tt1nd]

Hello steve, any solution for searching a text on window and click on it without using images for searching

[@malcomivan]

brother can help me how can i do this: i have 3 pic (jpg) number 1,2,3 in my screen i must choose the correct, how i say to python click in number 2 knowing is number 2, the number 2 is in the middle for example. thanks, i have screeenshot saved of numbers, but after?

[@coding101withsteve8]

Check my other video on Pyautogui. There you'll learn the basic commands. It would be better to use coordinates for clicking particular image among 3 images.

[@martineschle9149]

Danke!

[@coding101withsteve8]

Thank you so much ❤

[@pibruks]

love this tutorial man Thank you. Hello from Ecuador

[@coding101withsteve8]

Hello. Thank you so much

[@yippykayyay]

hmm, @2:04 I can't run the program unless I kill the arrow key in the upper right. Typing python pyautogui_imp.py does nothing. new to coding, would love to understand why that is happening

[@stupid_idiot_69420]

also its good to provide errors when you're asking for help so i would recommend you do that next time :)

[@stupid_idiot_69420]

my comments didnt go through lol

[@test-s8c3n]

Hi. I tried Auto IT tool for windows automation. It is so simple and easy to use.

[@amz_news]

if you use this method to subscribe to multiple channels can youtube detect this and cancel the subscriptions?

[@freetorunfree]

thank you for your explanation very helpful! Just one question that you did not call any browser in the code does pyautogui understands that it has to pull up a browser.

[@coding101withsteve8]

No it doesn't. It just looks for the image on the screen, and performs the click or key press operations. It's more like a human eye. What is seen on the screen. If there is an app open behind an already opened app. Pyautogui won't see it.

[@ashrafulalam6881]

where i can get the code to run, test and learn

[@bananenpflanzer6516]

Hey this was a really good video i subscribed, thank you so much

[@yajnalgibno6536]

To the folks who encountering this error message "PyAutoGUI was unable to import pyscreeze. (This is likely because you're running a version of Python that Pillow (which pyscreeze depends on) doesn't support currently.) Please install this module to enable the function you tried to call." Try running this in terminal: pip install --upgrade pillow

[@DEMONGAMESYT]

W bro ty

[@Simpletips55]

🎉great video you saved my time😊

[@rushikeshpachpute99]

year. I want to get into making soft on desktop because it offers more features but I have just been preferring the softow of mobile apps

[@keremmert1986]

Hello Steve, i am appreciate you made very usefull videos, thank you. I have a different problem with automating. I want to able using muose while automate clicking typing etc. on my other screen. Will it be possible with vscode or power automate? I will be so happy if you help me in this problem. Good day sir.

[@GrantNaylor-b8l]

A good working example 👍

[@jonathanacuna]

So incredibly helpful!!!!

[@coding101withsteve8]

Thank you Jonathan. Glad it helped You 😇

[@a-b-c]

Thanks bro, That was great tutorial, it made me realise the value of AutoHotKey scripts I write for the very purpose, they are very short and intuitive, I mean I can subscribe any channel with those scripts without inputting their logo. There's nothing we could really do, python needs to evolve.

[@HKRajnish]

If I have two same images on screen how to locate the second one? Urgent please

[@AshuKumar-lo5vt]

Please tell me, how can I read live data from running applications?

[@michellenijman9878]

You are the boss bro!!! Thank you a lot!

[@coding101withsteve8]

Not a boss, but You're welcome!

[@MassimoCLI]

Hi Steve, this video is even better than previous one regarding pyautogui. Double thumbs up. I'm Italian and I'd like to prepare a video summarizing the beauty of Python, may I link and suggest your videos. Thanks 👍

[@coding101withsteve8]

Thank you ❤ Sure you can

[@MassimoCLI]

@@coding101withsteve8 Great, many thanks 👍

[@AbhisheKumar45]

How to click 3 buttons at the same time like create a new folder using Ctrl+Shift+N plz explain

[@coding101withsteve8]

Try this -> pyautogui.hotkey('ctrl', 'shift', 'n')

[@AlexanderWeurding]

Thanks from NL!

[@AlexanderWeurding]

Can you add the donate button. Thanks.

[@coding101withsteve8]

It's added, thank you so much 😇❤

[@nicolassuarez2933]

Outstanding! Do we have a newer alternative? Thanks

[@jacktapping]

Great video this is going to help a lot on a machine vision project I'm working on

[@coding101withsteve8]

Great to hear! All the best 👍💯

[@JaySMeena]

How can convert this project into .exe format... Like other software?

[@chineseelectricbatman]

Is theri a display resolution limitation that pyautogui will work with? My data looks like garbage and is nowhere near the image. I've also had to drop the confidence down quite low for it to even detect anything (which might be why I'm getting garbage).

[@WanuLopes]

Sry to be late, but your problem was problably because u were trying to locate something on your second minitor, that is to the left of ypur first, making it have negative coordinates, and... Long story short, it cant handle negative coordinates

[@Beeater-i2c]

I have a simple bot for a website that I use, but it stopped working(site update). It’s a typescript and follows a selenium-based script that uses a very simple algorithm. Do you think you can help me identify the problem? Thank you very much for your time and effort!!!!

[@coding101withsteve8]

You can share the selenium code and error you're facing along with the website url on my mail. I'll try and check. 😇

[@Beeater-i2c]

@@coding101withsteve8 ok great, what is your email?

[@Beeater-i2c]

@@coding101withsteve8 ok where do i send it?

[@daaduindustries]

I have a project to automate my PC. Can you take it up ? Please let know

[@coding101withsteve8]

Let me know!

[@daaduindustries]

@@coding101withsteve8 how can i get in touch ? Some mail id ?

[@coding101withsteve8]

@@daaduindustries you can check my video on utube views bot in that it's mentioned. At 5:30 Can't send in the comments.

[@ayushagrawal9916]

pysceeze is not working in latest python versions

[@afnanahmad4266]

Bro what if i want to click under an image that has random location on the screen everytime page refreshes. i want it to click on all the pixels in certain area under the image

[@coding101withsteve8]

You can find the location of the image and then to click below the image you can use the moveRel and click functions. In my other video you'll find how to use moveRel function.

[@afnanahmad4266]

@@coding101withsteve8 Yeah I understood now!💗 thanks!

[@Maliksmm786]

bro please make a complete python course. Because you teching method is very simple and attractive.

[@InstaSnips]

hello im confused on what to do because the terminal is telling me this. Failed to read youtube_search.png because file is missing, has improper permissions, or is an unsupported or invalid format. what do you suggest doing?

[@coding101withsteve8]

Hello, Check if the file is in the same folder as your python file.

[@InstaSnips]

thank you i fixed it and its working now!@@coding101withsteve8

[@okelaquocan2485]

Can the pyautogui locateonscreen auto click VPN unlimited App?Can you help me?😢

[@miguelvallejos5868]

Em....when we finished to compose how to get it out ?

[@persons2480]

Hello, I was wondering how I could locate a certain color pixels then have my mouse follow those pixels, all in pyautogui.

[@arcticfox3840]

What happens if I two same things in my screen?

[@gameplaysc7644]

How search pixel in inactive windows ? And if not error level , send anyone key??

[@AllenHorn0507]

OK, I absolutely loved your videos and I have a question… Has this been updated? I am visually impaired, and I’m trying to automate some processes at work. 😊

[@AllenHorn0507]

Also, can I install those libraries on a thumb drive so I don’t have to install them on my computer at work?

[@sumairahashmi7825]

Thanks bud! great video and instructions.

[@drizzersilverberg]

anyone know how to deploy pyautogui script in remote server and execute it via ssh? because I got display error.

[@extrememike]

Pretty cool!

[@RC-qi6hs]

can websites detect that we are using some kind of automation using pyautogui ? ( except captchas)

[@coding101withsteve8]

No, website can't detect the automation done by pyautogui since, pyautogui automates your mouse and keyboard. It's like you typing or clicking by yourself. So technically it can't be detected that way. But if the websites detect the speed, it can assume it as some bot activity. So you can just control the speed in pyautogui.

[@RC-qi6hs]

@@coding101withsteve8 thanks for clarifying. Awesome video btw.

[@adamstewarton]

Hi , there is an easier way to get the XY cords from your screen. You can write a small script in python: import pyautogui as pag pag.displayMousePosition() if you run it, it will display the cords of your mouse at any time

[@NatureIsAmazing208]

maybe im stupid but it just gives me like 150 errors

[@aaquibtayyabi]

@@NatureIsAmazing208 150 ? lol dk about that but check if you have installed the pillow package through pip and try debugging again

[@higiniofuentes2551]

Thank you for this very useful video!

[@lessonsthehardway]

great video except I tried screenshotting the edit button like you and it kept saying image not found, i did it like 5 times, and one of them worked randomly, there was no difference. And now again, its not reading any of them anymore, how do u fix?

[@coding101withsteve8]

Try using the confidence attribute. Check my other pyautogui video too 😇

[@sudgamer4639]

Ima download it thanks for sharing!!

[@zHeavy]

@coding 101 with Steve - How can I locate some images in a window that's overlaid by other window my screen, example of that situacion, i want to locate the youtube icon, but i need the excel in max size on screen

[@zHeavy]

like, the other screen is in the background. (english is not my first language, i hope you understood)

[@coding101withsteve8]

Thank you for your question. Actually it's not possible to locate because it locates whatever is seen. To put it simple, it locates whatever you can see 😁. However you can do somthing to minimize the excel and then locate.

[@zHeavy]

@@coding101withsteve8 ok, so do it with pyautogui is not possible, but there is another library that can do this? Unfortunaly, minimize is not an option, because i need to find/read other application and click in the application thats on my screen. Thanks for the attencion

[@LukeeRPA-AI]

@@zHeavy you can move the mouse to click the task bar or using hotkey function of pyautogui press keys to change window, like 'alt' and 'tab'

[@bubblebath2892]

Brilliant Video bro

[@nenjuvalitamilreview7512]

very interesting concept ! thanks mate

[@torque6389]

Amazing!

[@animevietsub_ne]

I want to ask 1 question Can I copy, print and delete in PyAutoGUI function? (delete the part I just entered) Hope you can reply me!

[@rigvedakoranne7865]

Do we have to have the .png file in our PC, what if I want to convert the .py to .exe and run that file in someone else's PC? Is there a way to use PyautoGUI without having images saved in PC?

[@a-b-c]

Yes, you can convert.py files to .exe

[@rishikesh5783]

Hi What to do when screen size changes then the co-ordinate will also change how to handle this?

[@prepareyourself7448]

Same question i have my script is working on 1st screen and not on 2nd screen

[@edinetgrunhed6000]

thanks for this , can you make video but this time to monitor a when use click "EDIT" button or any custom button (using snippet) and print to screen

[@alexeymatveev9031]

pure gold!

[@Mashtainment]

amazing!

[@danielkovacs3664]

hi thanks the video why I get this error: in = pyautogui.locateOnScreen("fullscreen.png") ^^ SyntaxError: invalid syntax (Expected expressionPylance)

[@stupid_idiot_69420]

"in" is already in python so try renaming it to something else.

[@tuvelout]

2:09 alr, got error related with this line "res = pyautogui.locateOnScreen("image.png")" afterwards some more error related with this directory "C:\Users\PC\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.9_qbz5n2kfra8p0\LocalCache\local-packages\Python39\site-packages\pyautogui\__init__.py" I'll be solving it now, but so far I believe the problem is related with package/modules I have to import. edit. fixed detects the pic on the screen but it is not perfect at it, some pics work some others don't still to figure out

[@cheetahsflame1279]

doesnt work when i try it it just says "no such file or directory: 'edit.png'

[@coding101withsteve8]

Hello, this error usually comes when the image file is not in the same folder as your python file or if you change the original extension of the image file.

[@saadkhan883]

What is error pyautogui.ImageNotFound

[@akashthorat7044]

Try this 👇 import cv2 import numpy as np from PIL import ImageGrab # Load the template image template = cv2.imread('settings.png', 0) # Take a screenshot of the screen screenshot = np.array(ImageGrab.grab()) # Convert the screenshot to grayscale gray_screenshot = cv2.cvtColor(screenshot, cv2.COLOR_BGR2GRAY) # Use template matching to find the location of the template image result = cv2.matchTemplate(gray_screenshot, template, cv2.TM_CCOEFF_NORMED) min_val, max_val, min_loc, max_loc = cv2.minMaxLoc(result) # Get the center coordinates of the template image w, h = template.shape[::-1] center_x = max_loc[0] + w // 2 center_y = max_loc[1] + h // 2 print("Image found at:", (center_x, center_y))

[@Kirito_explainer]

Sir I am getting errors import pyautogui res = pyautogui.locateOnScreen("file.png") print (res) Error: Can't open File 'file name ':[Error 2] No such file or directory What will I do

[@af94248]

try the full path (r'C:\blabla\folder1\file.png')

[@ojoaopedror]

Hey dude! Thanks a lot for your great tutorial. I only have one problem, when pyautogui opens the app I need to automate, the code stops giving commands. Can you help me?

[@aditokta8842]

when i move the window, it becomes defocused

[@aivannecabrera3523]

I've always wanted to make soft but every ti I download software to do so, I just look at the 5,000 buttons/settings, cry for a few

[@gouranga1876]

It's very helpful

[@GeekyNerd14]

cant we simply use the pyautogui.position to locate the URL ?

[@KeyboardJammer.]

In mine its showing sleep is not defined I am frustrated

[@coding101withsteve8]

You need to import the inbuilt time library.. from time import sleep

[@mandeepyadav7253]

NICE VIDEO SIR

[@gabilondo2k268]

Where i need to store the png file?

[@coding101withsteve8]

Hello! You can store it anywhere and then mention the full path in the code or you can store it where your code is and just mention the name of the png file. 😇

[@AmDsus2Fmaj7Am]

This is brilliant

[@coding101withsteve8]

Thank you 😇

[@AyaAya-fh2wx]

Thank you so much!!!!!

[@Beeater-i2c]

Helllo,, where can i send my bot script? to which email? Thank you!

[@coding101withsteve8]

[e-mail]

[@Ditebogomojapelo]

😀😀woooooow no ways!!!

[@Ditebogomojapelo]

Hello sir, what file formatter extension can I use for my code to have the same colors are yours? I have Prettier installed but I just learnt that prettier does not support Python. My goal is for the colors on my code in VScode to look like yours.

[@vivianpaul2078]

subscribed ur channel using this method :)

[@coding101withsteve8]

Great! you learnt and thank You for the subscription ❤

[@METE_GUN1010]

bro it says it cant find the file of the image

[@METE_GUN1010]

FileNotFoundError: [Errno 2] No such file or directory: 'testing.png'

[@b44mbie]

@@METE_GUN1010 you have to click run and debug (hope this help)

[@dari0073]

Hey i am really new to Python and and i a very paranoid person so i dont really like installing anything. So my question is: How do i know if its safe to install any Libary? I want to install one called ..pyautogui.. and dont know how to check if its safe. Thx for any answer and Great Video

[@coding101withsteve8]

Hey, I found a very nice article here. You can check it out 😇 www.codethink.co.uk/articles/2023/pypi-safety/#:~:text=You%20can%20use%20a%20tool%20such%20as%20pip%20audit%20to,Python%20dependencies%20have%20known%20vulnerabilities.

[@HungryK]

Thank you!