Automate your job with Python

[@JosejuanBlanco10]

This is exactly, and i mean EXACTLY what i’ve been looking for!!! I can’t thank you enough.

[@54tomcat]

That was cool! In my first weeks right now studying and learning Python. Wanted to see some live coding, and that was so interesting 🤩. Thanks for sharing!!!

[@bmccollum]

Can't tell you how very much I enjoy your Python-related videos. I always watch them and walk away having learned something new or at least having learned how to do something I already know in a better way. 🙂

[@JohnWatsonRooney]

thanks great! thank you you are very kind

[@dundy96]

This is going to make inputing student grades SO much easier.

[@rumble1925]

I'm a programmer but I run my own business. I can't believe I never thought of automating admin tasks. I hate doing admin and I put it off to the last possible moment.

[@johndavidwoodcock4528]

I also run a business, just to help we with some ideas what kind of admin work do you have in mind?

[@3g0e]

What tasks are you referencing?

[@HaggisMuncher-69-420]

@@johndavidwoodcock4528 The guy isn't a programmer, if he was, he'd know to automate tasks.

[@nico2006t]

Me too i am not a programer but i understand how it should work, so spend 2 days talking with chat gpt to automate my admin ( statement client, invoice, save invoice as pdf send in the appropriate folder, send e mail with invoice and statement) took me so much time before. Now i also made a VbA just to click a button and it is done. I actually feel bored now lol.

[@rumble1925]

@@nico2006t nice work!

[@vrk4y]

Thanks for such useful content, John. I used the library a few times before, but I hadn't known about the codegen. It'll definitely make my new project development easier

[@JohnWatsonRooney]

Glad it was helpful!

[@michalb5380]

Playwright codegen. I love you man.

[@theshubhagrwl]

I clicked on this video thinking this to be a yet another python video where we automate excel or pdf something but NO, this was a whole different thing and super helpful 🙌

[@yagizjackson9500]

excel has it is own automation system "Macro" also , you can use python which is "pyautogui"

[@nuall4165]

I needed this 2 years ago lol Thanks for the video!

[@waellerbe]

Today you have a **new** Subscriber to your channel. I am totally impressed with the value of Playwright powered by Python. Thank you for sharing this tutorial with us. Automating our jobs will boost our efficiency to a high degree. Ready to keep on learning along the way.

[@training7574]

Very inspiring, thanks! Amazing that it should be so simple.

[@irfanshaikh262]

See. When i sit dow to count my blessings, i count "finding this channel and John" in particular probably a million times. Thanks john for being there for me.

[@JohnWatsonRooney]

that is very kind, thank you for watching

[@mkledits3679]

Super super super helpful!!! Thank you so much for sharing this!!!

[@jordiwang]

my man, thanks a lot. This is actually what I was looking for and I am sure this is a MUST skill that everyone should have. So good. Love you

[@davidl3383]

This record fonction is incredible ! thank you John !

[@Metalmatt900]

This is what I’ve been looking for. Thank you so much.

[@pkavenger9990]

wow this is so much better than selinium, I mean you don't even have to code just perform things on browser and it will convert it into code and you can then use it to automate stuff. Amazing

[@dominusdone5023]

It’s better but Id just stuff such as selenium and pyautogui just because you control more

[@aetheon9906]

Class. Explained well, concise, with example. Love it!

[@bierkaa0007]

You deserve me a subscriber on your channel ❤ thanks man

[@JohnWatsonRooney]

Thanks

[@swhitt4367]

Subscribed, if this was a series of examples and queries and question answering I would say you would have a keen audience! Subscribed

[@PeterThornton]

This is fantastic, i need to do repeated tests on a newly developed webpage, this is perfect. I have subscribed and check out your other videos. Thank you

[@graczew]

Good stuff as always. Thanx for sharing your knowledge and time.

[@JohnWatsonRooney]

thanks mate hope all is good with you!

[@sepehrsarjami]

Absolutely enjoyed it. Nicely done.

[@quintonrichards4805]

Earned my sub 🏅 Thanks for the video!

[@danlee1027]

Very helpful. I didnt know about code gen recording.

[@LucasMartins-op7oq]

Wow, this is awesome! Thanks for sharing.

[@prajwalaughade1210]

bro thank you so much for this and i can't hank you more im sure this is the best thing i have ever learned while learning python😇❤

[@tlrehmke]

You just made me another 50k over the next year. Thank you for the solution I've been agonizing over for the last 4 weeks!😊

[@amogu_07]

this is one of the coolest thing ive watched tnkuu

[@Emre-yx6vw]

I couldn't stop laughing from happiness. Thank you man, thank you!

[@tamiresronchini3355]

this looks a lot like vba macros which is exactly what I was looking for. I love your videos btw :)

[@bcavalcante]

Tragam um Oscar para esse cara!

[@jw200]

Thanks so much for showing Playwright. Its excellent. Makes stuff so much easier.

[@TurokAgi]

I accidentally entered the smart side of KZbin. My brain hurts 😖

[@isekaijoucho4812]

a casual dig into learning python led me here? to this crazy advanced automation? should've done python long ago

[@RoyZennet]

as VERY VERY NEW AND INNOCENT to programming

[@spookimiiki5891]

simple yet effective, the python way! nice video!

[@oussaber]

Thanks man. Never knew playwright had a codegen until now.

[@sagedoescode]

simple and straighforward, good stuff mate

[@JohnWatsonRooney]

thanks

[@carlos-ferreira]

Thank you for tutorials like this. I recently used another one of your videos to fix the code a previous employee had created.

[@JohnWatsonRooney]

Great to hear!

[@badrakhariunchimeg1031]

Those data base have info of product if so can camera search on data and give relavant result

[@victoraguirre7486]

I liked the video, unliked it and re-liked it again so I could like it more. Thanks man!!

[@Millennial_Stacker]

I'm going to try using this method to clock in and out of work each day!

[@quangminhnguyen5681]

very cool very useful. thanks man

[@isagive]

Its awesome! lets conenct this to a database and create some schemas... +10 for making such a tutorial.

[@re1n751]

Dude thankyou so much❤

[@JohnWatsonRooney]

No problem 👍

[@valuetraveler2026]

next level scraping here- will check it out

[@devkhare5691]

That recording part looks like the universal recorder from Automation Anywhere 360.

[@rico5424]

That’s awesome! So you would just have to change the numbers and run the script and let it do it for you. That’s cool

[@justsh0t]

lol this codegen looks amazing :O

[@AMindInOverdrive]

This is great! Thanks

[@michaelmuolokwu5039]

Thank you for this!

[@JohnWatsonRooney]

thanks for watching!

[@luffytaro689]

Holy shit new programmers have it so fucking easy. I remember when we had to use selenium and find each and every HTML path for each click.

[@arofhoof]

This is wild that would have save me hours of mindless admin in my previous job!

[@nssdesigns]

Great stuff... is there a way to read .xlms or csv data and loop through each row to automate web form entry data?

[@Eamo-21]

Very cool John

[@JohnWatsonRooney]

Thanks I appreciate it

[@aminehadjmeliani72]

Thanks John for the great content, my I suggest you to make video about scraping thousands of websites asynchronously using scrapy

[@JohnWatsonRooney]

good idea, big task - i can certainly look at something that would help

[@Alex-uo5xp]

Is there something like this for inside software? For example so it knows where to click in Excel or other software I use for work?

[@Cu-da]

First of all thanks for the useful video. I've already learned python basics and now trying to get into automation and web scraping world and while i'm searching on youtube i found your useful channel but i found many playlists and i hope if you can tell me which playlist i should start with as a begginer in this world.

[@kerbalette156]

What’s your preference for this kind of work? Still Playwright or something like Selenium?

[@JohnWatsonRooney]

I lean towards playwright still for this sort but selenium works just as well and since v4 is just as user friendly

[@kerbalette156]

@@JohnWatsonRooney does Selenium have a codegen like this?

[@Septumsempra8818]

Playwright never ceases to surprise

[@JohnWatsonRooney]

Yeah you can do a lot just by controlling a browser

[@andrewlimmmmm]

thank you bro you are the best

[@robertwallace5498]

I wish my job had more of these tasks so I could automate them

[@HopeUnveiled]

playwright install never works. it didn't detect the installation of playwright i think. But i just installed python, so maybe after i restart. Im on a linux machine.

[@DeadlyDwarf]

What is the python programm you use?

[@josephreagan9545]

You should use playwright to automate clicking the "I am a human" button!

[@jeS77791]

Thank you, as always John!

[@JohnWatsonRooney]

thanks for watching!

[@ouassildahimene4635]

Thanks a lot john, can you make a video about scraping linkedin jobs with playwright ?

[@JohnWatsonRooney]

Thanks for watching - you can apply the same principles here but linked in has more bot protection to get around. I’m moving away from specific site scraping videos but the methods will be adaptable to the sites you want to scrape

[@arleendo]

My company doesn't allow access to PATH editing, so the command playwright install does not work. How do I initialize playwright from the command line manually? Thanks!

[@arsalan0561]

is this possible with selenium ? as i use scrapy-playwright which doesn't work on windows..

[@JohnWatsonRooney]

Yes very possible with selenium, I started with selenium but moved on to Playwright as i preferred the API

[@Chip_Unlimited]

I am getting the error 'command 'python.execSelectionInTerminal' not found' when trying to run my code; any ideas?

[@jasperbaumgarten3612]

Are you able to make it change the date to one day later every time you run it? Also are you able to make it repeat so it completes this entire task say 5 times?

[@JohnWatsonRooney]

Yes both of those are possible and relatively simple to implement

[@N1246-c2f]

is there code that can automate an excel sheet that needs checking and updating based off latest available data from a number of other spreadsheets? e.g. there is an item code which can be used to lookup different types of information from other sheets, the item code will be present in each other sheet so all that it needs to do is lookup that item code and then input the latest data for that code into my desired spreadsheet. There is also a cell that needs to return a list of "countries" that item code is available in, im unsure where to start or how to go about this

[@tsay214]

You'll want to look into Excel macros. Otherwise if you're on Windows, Microsoft Power Automate is a low-code option.

[@walterclements7968]

wow. crazy how easy it is

[@Nostrada-mus]

Playwright runs on private nav. Managed to make it work on guest but can't get it to run on any of my chrome's profile. Any idea how to fix this?

[@oregonfelder1]

How can you build in random pauses intervals or “mouse movements” to avoid triggering scrape detection? This is definitely a tool I would like to incorporate because I cannot get an API to some sites, but pull 18 reports in a month basis that I would love to just automate. I just don’t want to trigger anything by “navigating” the site quicker than a fast human.

[@willrefling6395]

time. sleep()`

[@matthewj6026]

I love how the thumbnail of this video has some text reading "work smarter" with an arrow pointing to a screen of code on it. It's just brilliant.

[@matthewj6026]

Oh I forgot the "automate" bit- genius! Then the video starts with a man talking into a big microphone stuck right in his face, a must have for the KZbin podcaster or today. Also, the look of contemplation on his face as he's talking through his techniques

[@tr0wb3d3r5]

​@@matthewj6026HAHAHAHAAH hi gpt4

[@moler512]

huh?

[@mortazabaqeri1838]

Hahaha what is bro saying?

[@daesagelmar]

Hello, I think playwright has some pre-installation dependecies. I could not execute codegen generated code in VSCode due to library dependency problems. When i dig into stackover flow lot of questions raised to handle this library properly. Could you tell us how do you handle this issues? i mean "playwright.sync_api" could not resolved.

[@zenayush1]

how your terminal looking like this? it is amazing and easy to understand Pls tell how you did it?

[@JohnWatsonRooney]

hey the code editor is vs code but my terminal is the standard ubuntu terminal with zsh on top, then one of the default zsh themes

[@zenayush1]

@@JohnWatsonRooney i also got it now with the help of oh my posh.

[@JohnWatsonRooney]

@@zenayush1 cool, i've not tried that one but i have heard of it

[@johnlenoob6951]

Hi SIr, what is your coding environment ? YOu recommend use of conda or miniconda ? Working on windaube and don t want to destroy my poor system ;) Thanks for your work and knowkledge wharing

[@JohnWatsonRooney]

I just use Python and venv - no need for anaconda unless you are a data scientist in my opinion

[@johnlenoob6951]

Thanks sir @@JohnWatsonRooney

[@Prol0l]

As testautomation engineer thats been using PW since release, never use codegen, its locators are pure trash and should never be used.

[@고낙연-g7c]

So, is there an alternative solution for PW codegen?

[@bidet1098]

Given your expertise, could you provide us some good alternatives that we can use for automation?

[@0596sami]

What if my job description is literally about automating stuff, how would I then automate the automation job?

[@JohnWatsonRooney]

Write scripts to run your automation scripts, then scripts to run those…

[@zachhalliwell553]

Do you have to run it from the script window? Or could I save the script and run it while I'm in a browser at the page I want to run the script on?

[@JohnWatsonRooney]

You can do it that way - you can connect to an open chrome browser using the CDP protocol. It’s relatively straight forward to figure out

[@yagizjackson9500]

I am having a tiny issue. everything is working well, but when i download excel file, 1 )i can not see as excel, 2) it can not be opened or shown in the file. Anyone experience that?

[@EnzoAuditore]

Thanks mate

[@LeoCB]

Thanks, great video... if you want to get some content and save it in a txt file or something like that... ¿it possible?

[@JohnWatsonRooney]

yes absolutely - you can pull text from the elements use playwright

[@sweetlulu4306]

Thank you, I really enjoy how you explain and walk through the steps. I am curious about the password part tho. Is there a better security method for the username password part? I would hate to have this script to be sitting there on my desktop at work. Just wondering what’s the best security practice for that 😊

[@JohnWatsonRooney]

Hey thanks- you could add user input at the start of the script, asking for the user to input the password required then stopping you having it saved

[@duyduy5595]

Does we have to create some delays every time we input something to make it human like? Will the website manager know that we are using Python/Playwright on their site and block our IP?

[@JohnWatsonRooney]

It depends. I think a lot of cases no, you will be fine. I have read about others though where people have had to mimic real mouse movements and time delays

[@williammendes7664]

John, what's the name of program on the left side?

[@JohnWatsonRooney]

its part of playwright - when you run codegen it loads up both

[@bakasenpaidesu]

Hmmm .... Did you watched the video?

[@inputname000]

Does this work with interactions outside of the website (like when prompted where to save files, or copy and paste to another website tab or apps). If not, please make another tutorials too. Sorry I am watching this on my bed so I cannot test for myself. Thanks a lot!

[@5gef]

This is a superb tutorial. Thanks for that! However is it possible for the script to refer the data from an excel table? From your example I have to change the data manually in the script, but what if I'm working with hundreds of data?

[@yuanyowwu]

You’ll prob need to load the data and then (for example) loop through each row of data into some piece of playwright code. But very likely possible (at least that what it seems)

[@makie1467]

Hey there, thank you so much for your great videos. How can i connect google sheets with playwright? Everytime I try to access google it says it is unsafe and I cant login.

[@JohnWatsonRooney]

If you are trying to get data from google sheet with python there is a google api you can use and a Python package to help - it’s a much better way and it allows you to read and write data to a sheet programmatically. It’s called gsheets I believe

[@alexdin1565]

Thanks Jhon please can you make a video on how we can use selenium or playwright on cpanel to make it run 24/24?

[@keifer7813]

This looks cool but idk if it'll work for my job. I work on excel files stored on our sharepoint. I tried sending a GET request to the url but I got a 'No authorised access' error. How do I bypass this because i really need to automate this job, its so repetitive lol

[@JohnWatsonRooney]

Yeah it’s bit more difficult that way! You’d have to login and then search for the file and download. It’s a bit more involved

[@keifer7813]

@@JohnWatsonRooney Took a lot of work but I managed to do it. I am now the king of the office haha

[@browserautomate]

I understand your problem that's your are trying to access your google sheet by python so if you try automa which is chrome extension then You can aciehve its easily. I hope you're understand.

[@malwaredev33]

Good content as always, Thanks for that fantastic knowledge base videos, bro. I learn many things from your videos about scraping with python, Now I'm learning API web scraping. Make or suggest some good videos about web scraping through API. using python or making a video with complete detail. Thank You, John

[@JohnWatsonRooney]

thanks for watching, and great video suggestions thank you!

[@malwaredev33]

@@JohnWatsonRooney Don't worry I'm also a python lover so I know how much hard it take to make this type of content.

[@monicadesai7928]

Can you please make video for scraping job roles from individual company career web pages, so we only have to once add those web pages url, rest will be done by script and then automate the modification of job description into resume by removing some words. Please make videos on it.

[@AmodeusR]

Is the automatically generated code of good quality? And does such worry matters?

[@JohnWatsonRooney]

What it generates is usually good enough, but will need some sense checking

[@jed2606]

if things change it will fail, does that mean you cant add conditional for loops and stuff with this library?

[@loicleray]

Interesting, as always. Thanks 😊

[@maziarzarea2540]

never thought of using this to automate tasks in wordpress.... how many million clicks has it been....