Python Automation | Part 12 : Deploy Selenium on Heroku | Python Selenium Web Automation

  Рет қаралды 10,830

Code Band

Code Band

Күн бұрын

Пікірлер: 75
@prashanthkumar7349
@prashanthkumar7349 Жыл бұрын
OMG you have everything I need.
@mfsdrawings8600
@mfsdrawings8600 4 жыл бұрын
Fantastic 🤩🤩😍
@CodeBand
@CodeBand 4 жыл бұрын
😊😊
@infomiruz
@infomiruz 3 жыл бұрын
thank you very much bro !
@CodeBand
@CodeBand 3 жыл бұрын
Glad to hear that😊
@leongkenny
@leongkenny 3 жыл бұрын
Hi Jasim, thank you very much for your python web automation tutorials. Very good videos. Really love them. You explained everything so well. :) I wanted to watch you tutorials again, but part 7 is missing / was deleted from the playlist. Can you upload it again? Your subscriber from Hong Kong.
@CodeBand
@CodeBand 3 жыл бұрын
Very glad to hear that... Part 7 was removed by KZbin followed by a Community Guidelines Strike (I don't know why that happens)... Anyways, I will try to re-upload the video soon...😊
@omidamiran9211
@omidamiran9211 3 жыл бұрын
very good
@CodeBand
@CodeBand 3 жыл бұрын
Thanks
@ashandesilva7802
@ashandesilva7802 4 жыл бұрын
Love it man
@CodeBand
@CodeBand 4 жыл бұрын
Thanks a lot❤️
@marcusmerc615
@marcusmerc615 4 жыл бұрын
Hi sir. My app scrapes news site, extract urls and writes to .txt file. Next, scrapes again and if will find new urls write to .txt file again (add new urls to txt file, save and close). But app works incorrectly in Heroku. My txt file every time empty, I know, Heroku doesn't have a file system. App in every scrape show same urls. Disappear each time. Can I use your method? For example, app scrspes site, extract urls and sends to external db, next check stes urls and external db urls, if will find new urls add to external db? Or it doesn't work? Please, help me!
@CodeBand
@CodeBand 4 жыл бұрын
As you are aware of, in Heroku, files will not persist. And what you mentioned is correct and one of the preferred way to do this. Use Database. 😊
@luckyalexander9263
@luckyalexander9263 3 жыл бұрын
Pls is it possible to make a web application that that automates loging and Click s?
@georgiosionas9842
@georgiosionas9842 4 жыл бұрын
Many Thanks for the Chromedriver Tutorial on Heroku I was wondering how we could add extensions to chrome on heroku?
@CodeBand
@CodeBand 4 жыл бұрын
Thanks a lot...and about extensions..do a quick research..keep going😊
@VictorSilalahi
@VictorSilalahi 2 жыл бұрын
Hi Jasim, if we have python console script like you did in this video and already deployed in heroku, how can we make this app visible to another person so he/she can execute this app from his/her laptop?
@BarziniNwa
@BarziniNwa 2 жыл бұрын
Hi Victor, how were you able to deploy? I'm still having issues with this as the code from this video has been deprecated. Can I see your github please? Thanks
@CodeBand
@CodeBand 2 жыл бұрын
Hi there, for exposing it to public, you can make a simple Web App with frameworks like Flask/Django and invoke the code, for example on a button click.
@CodeBand
@CodeBand 2 жыл бұрын
Can you elaborate which parts of the code are deprecated ?
@BarziniNwa
@BarziniNwa 2 жыл бұрын
@@CodeBand options = Options() options.add_argument("start-maximized") options.add_argument("--headless") options.add_argument("--disable-dev-shm-usage") options.add_argument("--no-sandbox") self.driver = webdriver.Chrome(service=Service(ChromeDriverManager().install()), options=options)
@BarziniNwa
@BarziniNwa 2 жыл бұрын
@@CodeBand I had to change the code and add the service parameter to make it work. Still when I deploy on heroku, my app doesn't work. Can I reach you on Telegram to help with this? Thanks for your response!
@rangabharath4253
@rangabharath4253 4 жыл бұрын
awesome bro. Please create a video on creating schedules in heroku in certain time intervals.
@CodeBand
@CodeBand 4 жыл бұрын
Will try to do that in future bro...
@ataimebenson
@ataimebenson 3 жыл бұрын
Can I close my Command prompt while it is running ? Since the app is meant to be running on the Heroku cloud and not on my machine
@CodeBand
@CodeBand 3 жыл бұрын
Which terminal are you talking about...? You don't have to open any kind of terminal...
@ameenkp3284
@ameenkp3284 3 жыл бұрын
Bro enik oru error varunnu noelementexception....but normal running work aakunnund
@CodeBand
@CodeBand 3 жыл бұрын
What's the update?
@ShovonMallick41
@ShovonMallick41 3 жыл бұрын
is there any easy way to create requiremens.txt file? I am having several issues here. 1) WARNING: Could not generate requirement for distribution -illow 5.4.1 (c:\users\svn41\anaconda3\lib\site-packages): Parse error at "'-illow=='": Expected W:(abcd...) 2) inside the requirements.txt file I have so many lines 3) if I use this requirements.txt file, lot of requirements remains not satisfied while deploying on heroku
@CodeBand
@CodeBand 3 жыл бұрын
The first warning seems to be raised from a typo... You might've meant Pillow, but there it is illow Requirements.txt would generally suffice in most of the cases... And if you're facing any issue, please also try pipenv, which at the end will have pipfile, which is also supported by Heroku...
@leelee-s7w
@leelee-s7w 4 жыл бұрын
Hello Code Band, thank you for the video. I wonder if I can pop up the selenium browser on Heroku. I don't want to use "--headless" option.
@CodeBand
@CodeBand 4 жыл бұрын
Thanks a lot😊 and as far as the browser GUI, it's not possible, you might end up using --headless option.
@user-bk6ry9ln6u
@user-bk6ry9ln6u 3 жыл бұрын
​@@CodeBand Hi bro, your video is quietly awesome !! I have a question that similar to that guy @이호용 , I've created some Django app + selenium, but the problem is selenium won't return value if use chromeoptions (--headless). I've tried to figure it out and the result is it will return value if not using --headless , and it will not return value if using --headless. Do I have a chance to deploy it without --headless on the Heroku server ??
@Rana-yc6yt
@Rana-yc6yt 3 жыл бұрын
have you tried with user-profile ?
@CodeBand
@CodeBand 3 жыл бұрын
I haven't actually.
@MichielDeSnuyter
@MichielDeSnuyter 3 жыл бұрын
Why did youtube remove part 7?
@CodeBand
@CodeBand 3 жыл бұрын
As they said the video didn't follow their community guidelines, very sorry about that video. I didn't know where it violates the guidelines😢
@MichielDeSnuyter
@MichielDeSnuyter 3 жыл бұрын
@@CodeBand Haven't you received a notification from youtube? If it's copyright related, there's a high likelyhood that you can counter their claim and have the video restored.Cosidering you run an educational channel there's such a thing as fair use.
@MichielDeSnuyter
@MichielDeSnuyter 3 жыл бұрын
@@CodeBand If you like, I'd be able to help with writing an email to youtube.
@CodeBand
@CodeBand 3 жыл бұрын
@@MichielDeSnuyter I have given an appeal, but they rejected. There's still the Malayalam(native language) video of the same part 7, you might not get what I say in that video, but definitely you can see how I implement the stuff. kzbin.info/www/bejne/ZpuwnH6EaZxseK8 Thanks a lot for the support ya😊
@CodeBand
@CodeBand 3 жыл бұрын
@@MichielDeSnuyter I have appealed for a claim...but was rejected whatsoever.😢
@harshdeshmukh2580
@harshdeshmukh2580 7 ай бұрын
Does this create a link, which other people can open to use my application?
@Mr_Amazigh
@Mr_Amazigh 4 жыл бұрын
Thanks for this tutorial . I’m wondering if I can set up selenium test in Ruby Rail app . Thank
@CodeBand
@CodeBand 4 жыл бұрын
Welcome... Ruby Selenium : help.crossbrowsertesting.com/selenium-testing/tutorials/getting-started-with-ruby-and-selenium/
@Mr_Amazigh
@Mr_Amazigh 4 жыл бұрын
Thanks so much !! So this can be set up in the CI/CD Heroku , right ?
@CodeBand
@CodeBand 4 жыл бұрын
@@Mr_Amazigh Although I haven't personally tried, CI/CD pipeline would work fine with this one😊
@moladomola
@moladomola 4 жыл бұрын
I want to know how to code headless selenium params [params = {'behavior': 'allow', 'downloadPath': r'/home/osh/Downloads/'} ], as I want to save data to DB(e.x. ClearDB in HEROKU) directly. Is it possible?
@CodeBand
@CodeBand 4 жыл бұрын
Saving data to DB is possible...you might want to do a DB configuration in the script and that's it, you can interact with your DB. Here's a simple Python MySQL Tutorial : realpython.com/python-mysql/
@mylaramvenkatesh9796
@mylaramvenkatesh9796 3 жыл бұрын
I am getting error due to different version of chrome and chrome drive, how to solve??
@CodeBand
@CodeBand 3 жыл бұрын
You might need to update chromedriver according to the chrome version.... OR You can use webdriver-manager package to automatically manage drivers pypi.org/project/webdriver-manager/
@mylaramvenkatesh9796
@mylaramvenkatesh9796 3 жыл бұрын
@@CodeBand thanks, I solved it
@CodeBand
@CodeBand 3 жыл бұрын
@@mylaramvenkatesh9796 Keep going👍🏻
@mahatvagarg5077
@mahatvagarg5077 Жыл бұрын
now heroku has stopped free service can you please make video on some alternate cloud provider..
@178lec
@178lec 3 жыл бұрын
great tutorial, but how can I run / send collected script to my web page?
@CodeBand
@CodeBand 3 жыл бұрын
That's pretty much easy, you can send the collected script in the body of the request to your website, remember to handle that request accordingly in your website.
@abhikkumarde1053
@abhikkumarde1053 3 жыл бұрын
Will this work with whatsapp automation also ?
@CodeBand
@CodeBand 3 жыл бұрын
For WhatsApp authentication, there are some issues / problems we have to deal with before hosting....
@naveen1000
@naveen1000 2 жыл бұрын
@@CodeBand Can you please tell how can we acheive that without scanning QR code in heroku server
@guuhfx
@guuhfx 4 жыл бұрын
I'm having a error that selenium can't find an element, but I tested on my computer and works perfectly... Do you know how to solve this?
@CodeBand
@CodeBand 4 жыл бұрын
That might be an issue with timings...As the server will be very fast in its execution, our code might look for an item before it gets loaded. You can deal this one with waits, either implicit or explicit. Please refer this docs : selenium-python.readthedocs.io/waits.html
@ismailtosuntnyl
@ismailtosuntnyl 3 жыл бұрын
​ @Code Band hey bro did you solve your problem because ı have same problem. I tried to add wait command codes work perfect on my computer also on heroku can print page html but cant find element
@CodeBand
@CodeBand 3 жыл бұрын
@@ismailtosuntnyl Hm...that's something need to research on... albeit, it works here...
@ramizquliyev394
@ramizquliyev394 3 жыл бұрын
Hey Man, I have liked this problem : I want to open my default browser using selenium. In this way I will not need any verification for whatsapp, tiktok etc... Could you just make a video about it if it is interted for you. or If you have any recommendations to deal with this problem let men know pls :)
@CodeBand
@CodeBand 3 жыл бұрын
Please check this video out : kzbin.info/www/bejne/fmnNiGufl8ytiKs
@just_me_rinz
@just_me_rinz 3 жыл бұрын
Hi malayali
@CodeBand
@CodeBand 3 жыл бұрын
Yeah... mallu ❤️
@just_me_rinz
@just_me_rinz 3 жыл бұрын
@@CodeBand bro oru error undu fix cheyaan help cheyyo
@CodeBand
@CodeBand 3 жыл бұрын
Sorry for the late reply brother... parayu bro...
@just_me_rinz
@just_me_rinz 3 жыл бұрын
@@CodeBand bro fix ayi 😉
@mashoodkkkarbala3739
@mashoodkkkarbala3739 2 жыл бұрын
ഈ tutorial മുഴുവനും പഠിച്ചാൽ ജോലി സാധ്യത ഉണ്ടോ....
@CodeBand
@CodeBand 2 жыл бұрын
Ee videos more real-life, problem solving oriented aan... jobs aan focus enkil, ith cheriya oru base aakkaam... Automation Tester pole ulla jobs in selenium high priority aan... but you need to learn more on this before you can apply for a job...
Beautifulsoup vs Selenium vs Scrapy - Which Tool for Web Scraping?
6:54
John Watson Rooney
Рет қаралды 78 М.
Instagram Bot Python Automation With Selenium - Deploy To PythonAnywhere
16:58
Гениальное изобретение из обычного стаканчика!
00:31
Лютая физика | Олимпиадная физика
Рет қаралды 4,8 МЛН
The evil clown plays a prank on the angel
00:39
超人夫妇
Рет қаралды 53 МЛН
Start Automating Your Life Using Python! (File Management with Python Tutorial)
13:07
How to Web Scrape in the Cloud (Easy Way)
15:37
SATSifaction
Рет қаралды 15 М.
Web Scraping Instagram with Selenium
22:56
Python Simplified
Рет қаралды 226 М.
Running ChromeDriver with Python Selenium on Heroku
6:25
Andres Sevilla
Рет қаралды 35 М.
Hidden APIs with Scrapy - easy JSON data extraction
9:59
John Watson Rooney
Рет қаралды 44 М.
Гениальное изобретение из обычного стаканчика!
00:31
Лютая физика | Олимпиадная физика
Рет қаралды 4,8 МЛН