How To Handle Captcha In Selenium Using Tesseract OCR

[@m.g.satheeshkumar4221]

Thank you so much Mukesh.I followed all your videos, learned selenium and very happy news is i get selected in infosys for automation testing profile. Without you and your teaching, it is not possible. I owe you. Again thank you so much.

[@SarangHoley]

Thank you very much for covering this Tess4j API, by simple and precise manner.👍😊

[@cortes_da_direita]

I knew very little about Java, coding, eclipse and etc, but I was able to reproduce everything. Thanks for your time.

[@JitendraKumar-lr3vq]

Thanks mukesh ..i was able to read pdf files through tesseract jar file..its an wesome api..it has solved one of the most promising problem of reading pdf files through selenium..

[@Mukeshotwani]

Thanks Jitendra.. I am glad to hear from you. I found one more library for pdf will upload video soon.

[@ramkumariyer8282]

This is useful only for capturing simple captchas where there is less background noise. For distorted captcha images it never reads everything . Always shows as blank , All the tutorials in the web are showing simple captchas which can be easily done but no body is showing real practical examples

[@Mukeshotwani]

Hi Ram you can DBC services for complex captcha www.deathbycaptcha.com/ note- it is paid service.

[@RaviThaker-q6j]

This is correct buddy, I have been looking at here & there to find out that how can I bypass the distorted captchas

[@Kumarkumar-gf3kk]

Appreciate Mukesh for your prompt responses to guys!

[@Mukeshotwani]

Thanks Kiran 🙏

[@NishantRanjan2811]

Wow. One of the most awaited tutorial. Thanks.

[@amitvibes76]

Mukesh how to catch and print a toast message which goes after 6seconds saying that you will be logged out after 6 seconds.. then 5 seconds.. 4 then 3.. 2 and 1 then vanish. Please help me out with this.

[@laerciosantannaf]

Amazing tutorial. Congrats!

[@Mukeshotwani]

Thanks Mate 😃

[@manotk213]

HI Mukesh, When i try to take a screenshot in selenium ,it captures the whole divsion/class(not the individual element).[not the captcha,instead of the whole screen]. Whats is the cause for this,Could you please assist.. Code as below : File screenshot=driver.findElement(By.cssSelector("img[id =\"captchaImg\"]")).getScreenshotAs((OutputType.FILE)); File screenshot_location =new File("C:\\Users\\manoj.png"); FileHandler.copy(screenshot,screenshot_location);

[@Mukeshotwani]

Hi Mano, Are you using Selenium 4?

[@srinivaskassa62]

Hi Mukesh, Can you please provide steps to setup environment variable and what all require to install . I am getting error as "Please make sure the TESSDATA_PREFIX environment variable is set to the parent directory of your "tessdata" directory" thanks in advance, Srinivas Kassa

[@Mukeshotwani]

Hi Srinivas try keeping trained data in project home directory and try again.

[@srinathsomeshi258]

Hi Mukesh, I am trying to automate the Google captcha V3 which shows text to be entered. I am trying to take a captcha image and read the text out of it. But every time some characters are missed. How will I be able to proceed with automation.

[@Mukeshotwani]

I have not tried V3 captcha so far.

[@suprikaputhran8087]

In captcha v3 version there is allow list option , ask the dev for more info.

[@bhavanadornadula2243]

ERROR net.sourceforge.tess4j.Tesseract - Unsupported image format. May need to install JAI Image I/O package, getting this error, pls advise

[@Mukeshotwani]

Hi Bhavana which kind of image you are using? please use same version of tools which I used in Video.

[@anujkogata7247]

Very good explanation. What is the accuracy percentage of capturing correct text.

[@Mukeshotwani]

for me anuj 90 %

[@anujkogata7247]

@@Mukeshotwani thanks

[@ParamBramhaOM]

Hi Mukesh, I have successfully read the text from image Captcha, but after login to the page error message is showing on the screen. It's successfully login to the page but next test cases are not executing and the error message is showing : org.openqa.selenium.NoSuchElementException: no such element: Unable to locate element. Kindly help to fix this issue, Thank you

[@Mukeshotwani]

Hi Deepak, please check locators and sync issue here

[@chithientran9520]

I use Eclipse on Mac OS and get an error like this: "Please make sure the TESSDATA_PREFIX environment variable is set to your" tessdata "directory. Failed loading language 'eng' ". Hope you can help me fix this error

[@Mukeshotwani]

Hey Chi please follow video again because I have explained how to load language.

[@manonmission2010]

try adding: image.setDatapath(System.getProperty("user.dir")+"/tessdata/"); image.setLanguage("eng");

[@rohitlohia2128]

Great video, can you provide some insight on how to create CAPTCHA that can be implemented on any web framework.

[@Mukeshotwani]

Hi Rohit, We have capctha lib which you can implement in any web application. Do check CAPTCHA lib framework . This video covers how to capture text from CAPTCHA.

[@forall1980]

Hi Mukesh, I tried doing this code, it runs successfully but it does not capture the text written in captcha. Shows error in docr. It does trys to read the text and shows in separate box but does not capture so that it can enter in nlpAnswer field. Can you guide where it may be going wrong. Many thanks in advance

[@Mukeshotwani]

Hi Mate, if captcha has some lines or some overlapped char then it will not capture.

[@forall1980]

@@Mukeshotwani thank for your response,much appreciated. I tried same website as you have for practice. But it cannot find the input path and that's where it fails to capture the image despite highlights the text. Not sure why it's not capturing image. Please guide Thank you

[@kunalgaurful]

By the use of this technique,digits in captcha are copying in the form of ASCII characters in the textbox like "95da2f" is copied as "95da’z" as it is displaying correct in the saved image.Please reply.I need your help.Please reply to my problem.

[@ramareddybheemanagoud2331]

When I am trying to add tess4j to the pom. xml(maven project) , my project got corrupted. Please give solution so i can do it

[@Mukeshotwani]

Hi Rama, try changing the version.

[@ramareddybheemanagoud2331]

Thank u for reply sir, I tried with different version it is working fine.But I am getting Exception in thread "main" java.lang.Error: Invalid memory access

[@natashakedia981]

Thank you for this video Mukesh. Can you please tell me how to automate "I'm not a robot" checkbox captcha using selenium?

[@sathisha4456]

Hi mukesh , I have used selenium version 3.141 , get captcha text from image is working or not in this selenium version. because I try it with your write code. Captcha Image was got. But not reading the captcha value. I got error -: Exception in thread "main" java.lang.UnsatisfiedLinkError: The specified module could not be found.

[@anshumanmaharaj3254]

Same Here

[@sathishgr3556]

Hi Mukesh, can you help me, how to achieve in java project.How to load eng trained language in java project rather than using maven project.

[@Mukeshotwani]

Hey Sathish you need to download all jars and then add in the same project.

[@sahanik28]

@Mukesh: Thanks for the video. But this is not able to read numbers. Can you help how to read numbers?

[@ganesamuruganmuthiah1019]

Hi Mukesh How to handle the image captcha such as by clicking traffic light from the images section?

[@maheshvemula9551]

Hi Mukesh, I've tried with the code you mentioned, Its not getting accurate image text everytime. Could you please provide me the solution

[@shubhamforeverything]

Hi Mukesh, Thank you for nice video and It is very helpful video if it is sum up with preparation of framework.

[@rajendramahapatra3293]

How are you using Selenium 4 if it has not been released officially?

[@Mukeshotwani]

Beta version you can also use I have given link in video description

[@AhmedRaza-js5rj]

For my case i want to solve Visual Captcha same like google captcha but too much easier almost 28 images to analyze n solve its just like this 5 Boxes will be given And on top command say click on desk or bottle and the objects under boxes are always in a same picture not different what should we do for this kind of captcha friend ?

[@Mukeshotwani]

Sorry Ahmed I dont think we can automate google captchas. if you find any solution then do share with me.

[@AnkitSingh-bk6vt]

Ahmed raza

[@bireswaradhikary2757]

"TESTDATA_PREFIX environment variable is set to your testdata directory" This eroor is coming again and again Please help me how to resolve the issue

[@dineshreddy2324]

Hi @Mukesh, Now it is not reading captcha properly on IRCTC login page

[@Mukeshotwani]

Yes Dinesh seems they changed captcha type

[@AnkitSingh-bk6vt]

Hello mukesh ji

[@nagasaisatyaram3956]

How can I automate aws certificate validation instead of manually typing numbers and verify?

[@praveenmichael3358]

Very nice! Is it possible to automate mathematics captacha? Like 58+2 kind of things?

[@balaajiph8946]

i believe it can be done by splitting the string and performing the respective calculation in the program itself

[@spareaccount6389]

yes

[@sunilchand7521]

Hi mukesh .iam getting java.lang.Error: Invalid memory access error . I able get screenshot but unable to covert into text .plz help me

[@Mukeshotwani]

Hey Sunil, this seems some Java issue which version of Java you are using?

[@sonalisundaray1052]

Hi Mukesh, I tried doing this code,it runs successful but it doesn't capture the text written in captcha..

[@sadariyainternational4806]

Sir I need this for python if you have any video of python so please share me or if you don't have then plz tell how can I do in python

[@Mukeshotwani]

Hey Sudarya this is for python www.pyimagesearch.com/2017/07/10/using-tesseract-ocr-python/

[@akhilsyed4284]

Hi...where to find Tosca video tutorials and how to learn Tosca automation tool plz

[@rajeshkannan77]

Hi Mukesh, I am trying to break Gmail captcha. I've even taken the screenshot of that captcha element itself and then trying to convert it to text using Tesseract as u shown. But it's just returning few characters instead of returning the captcha text.. What could be the issue? Will u pls help me?

[@abraham2961]

One question sometime captcha is like some zebra crossing image etc how to handle that

[@JitendraKumar-lr3vq]

can we read pdf file using tesseract api ..pdf file reading is one of the main issue we face while trying to read the pdf file using automation..

[@comedybuzz6629]

sir please make this whole proccess in python and explain sir and share code please. loved the way of your explaination sir

[@Mukeshotwani]

Yes mate soon coming full Python and JS series.

[@comedybuzz6629]

@@Mukeshotwani sir how can i contact you . can you share your mail

[@allaboutindia6369]

ITesseract image = new Tesseract This line give error .i was import all 4 lines of top still this line also show error plzz help sir

[@Mukeshotwani]

Hi Akshay it means dependency are not downloaded properly.

[@preethithiyagarajan678]

Where can I find the trained data file for numeric values

[@vijayshankar8957]

Hi Mukesh... Could you plz help how to automate otp on personal mobile number in mobile automation (appium).

[@Mukeshotwani]

Hi Vijay, I dont have any video on that, I will try to record and will upload soon.

[@desuteja502]

By using Twillio API URL:www.twilio.com/docs/usage/api

[@SantoshKumar-dy3pr]

Hi sir where to get the path file which is just above the pom.xml

[@Mukeshotwani]

Hi Santosh here is the link github.com/tesseract-ocr/tesseract

[@anandyadav3919]

Can you help me also on how to get the path folder, I tried it from the below link but no luck

[@sudhirkhaire]

It is fine, please tell me, How to automate recaptcha v3?

[@Mukeshotwani]

No solution for that as such

[@sudhirkhaire]

We automate the recaptcha v3 locally, can this ( same selenium script) work for live?

[@tajindersingh6519]

Nice one Mukesh..

[@VishalKumar-lj7xs]

Very useful video..Thank You sir.

[@RanjeetKumar-dx7bb]

Hi Mukesh Thank you for this nice video. Can you please make a video on mocha, chai framework. Thanks in advanced Ranjeet Kumar

[@Mukeshotwani]

Sure Ranjeet, I will record video on mocha and chai soon.

[@ekankgamer2681]

I m trying to automate this captcha, i tried with tesseract to automate but its giving wrong text it will be really appreciateif any one help me in this.

[@Mukeshotwani]

What wrong text? Which site you referred?

[@vishaltiwari3757]

@@Mukeshotwani : Hey Mukesh I have shared you Code snippet sent email from [e-mail] for your valuable response.

[@MrPanirajasrikanth]

Thank you for great video sir.

[@whataluckdydx7094]

Hi, do you know how to bypass CloudFlare detection in Selenium? I have been stuck for days now. Thank you in advanced!

[@chandankumarmalhotra1127]

Very Informative!

[@ragusri86]

Hi Mukesh, Is there any possibility of handling Google Captcha?

[@Mukeshotwani]

No Ragu, I dont think so but never tried with google captcha.

[@ragusri86]

Mukesh otwani ok thanks Mukesh

[@ankitsharma-et6pq]

Hello Mukesh, Do you have any idea about HP ALM with Selenium Integration, Please suggest. Thanks, Ankit Sharma

[@srikanthakula810]

Using bumble b

[@usrinivas5328]

I ran scrpit by following this video but cannot automate captcha

[@abraham2961]

Thanks Mukesh for this video

[@ShivaPrasad-ku5qn]

I need it for python please

[@Mukeshotwani]

Here is the link Shiva pypi.org/project/pytesseract/

[@ramareddybheemanagoud2331]

I am getting Error opening data file. eng.traineddata Please make sure the TESSDATA_PREFIX environment variable is set to your "test data "directory. Failed loading language 'eng' Tesseract couldn't load any language!

[@Mukeshotwani]

Hi Rama, keep trained data in home directory as well and then try.

[@amiraliansari9887]

@@Mukeshotwani Hi Mukesh, I have kept the trained data in home directory but still i am getting the same error. Pls help

[@amitmishra3031]

Can we automate captcha having cross all around the pattern

[@Kumarkumar-gf3kk]

amit mishra boss captcha is related to security

[@Kumarkumar-gf3kk]

Loll screen shot will be dynamic and no company includes automating screen shot.This is impossible to automate captcha . If so it’s a security breach First one should know what is Captcha a program or system intended to distinguish human from machine input, typically as a way of thwarting spam and automated extraction of data from websites. If some one want to automate this then it is consider as pure lack of good automation strategy

[@Kumarkumar-gf3kk]

amit mishra what u want to automate captcha ?

[@thebrjsoflife7353]

is this working for meg tipeer?

[@Adam-fu6sr]

is it posible to do funcaptcha?

[@Mukeshotwani]

Sorry Adam not sure about funcaptcha

[@Brinierdrip]

Is this work with headless mode ?

[@Mukeshotwani]

I haven't tried but I guess it should work.

[@ShivaKumar-vc3nk]

Hey Mukesh, Can I capture bold text from image using OCR? quick reply would be appriciated. :)

[@Mukeshotwani]

Yes Shiva

[@NiketPatil280890]

This only works for only on 32bit JAVA version. it doesn't work 64bit.

[@Yaddalapudi]

i am getting some error , can u try to help me mukesh

[@Mukeshotwani]

Hi Krishana what error you are getting?

[@Yaddalapudi]

@@Mukeshotwani I already I mailed you

[@Yaddalapudi]

@@Mukeshotwani Tesseract null

[@maheshoza3882]

Sir give step by step installation step, with link code give in video, so make it like that one can test with this code and with all requirements like selenium 4 etc Thanks

[@mouneshwarbadiger9277]

Thanks Mukesh it is good to know that we gonna handle some kind of captcha using selenium. Thanks again for the session 👍

[@leoeden2602]

sorry to be so off topic but does someone know of a trick to get back into an Instagram account..? I somehow lost the password. I love any tricks you can give me.

[@hassanalijah8636]

@Leo Eden instablaster :)

[@leoeden2602]

@Hassan Alijah thanks so much for your reply. I got to the site thru google and im trying it out atm. Looks like it's gonna take a while so I will get back to you later when my account password hopefully is recovered.

[@manishthakur1205]

Hello mukesh sir i want to read OTP from gmail how can do that please help

[@paruldang952]

Use gmail api.

[@manishthakur1205]

@@paruldang952 i am able to get otp but it is not taking new one means it is not refresh inbox automaticaly thats why it taking old otp Any solution for it. ?

[@Dr.ashwath]

Thank you soo much.

[@Mukeshotwani]

Most welcome sir

[@ll2131]

Please make this video in katalon studio version, thanks for advance

[@pythona3993]

How to handle captcha in TestProject

[@sathvikkrishna2210]

I need for python

[@vikramdasaram5267]

Can we do it by using testproject

[@logtoadityaraj]

No, You can't.

[@HamzaKhan-om8gi]

Hello brother . I have captcha code h3b73bd When the user copy this I want to replace them in user clipboard through malware . Is that possible or not ?

[@Mukeshotwani]

Sorry I did not get your requirement.

[@HamzaKhan-om8gi]

@@Mukeshotwani I want to encode some text into image . Then I will send that image to user . When the user click on the image the virus will install and spread in his operating system . Work of this virus will do the following functions . After the installation of virus . The user clipboard will be paste the code that we have encoded in image as a string .. Now do you got it .

[@Mukeshotwani]

@@HamzaKhan-om8gi sorry Hamza no idea on this.

[@umakantaacharya6726]

Hi , Mukesh Can we automate Numerical captcha Like ( Pl)

[@umakantaacharya6726]

LIke (21+3 or 18-8)

[@Mukeshotwani]

Hi Umakanta I have not tried but you can pass the trained data set and you will be able to read the same.

[@bozhang11]

Nice!!

[@radsogandhinagar4462]

Is there same in python script anywhere?

[@Mukeshotwani]

pypi.org/project/pytesseract/

[@Disha_CuteStar]

Hi Am getting NoclassDefFoundError: com/sun/jna/Pointer

[@soumyahavaldar9404]

Hi Shraddha , may I know hw did u solve this issue?

[@ShivaPrasad-ku5qn]

Super

[@Mukeshotwani]

Thanks Shiva

[@vineetkumar9903]

sir can u solve the captcha of irctc generated at 10:00 AM and 11:00PM

[@kennethgomes4727]

please make a video with python

[@bnayak822]

Hello sir how to handle captch selenium with python ,if you have any videos please share me.

[@Mukeshotwani]

Hi Biswaranjan, I will make video for python too. In the meanwhile please visit below link pypi.org/project/pytesseract/

[@MsErwin19]

can you solve google captcha?

[@Mukeshotwani]

No mate , above solution works for text based captcha or images based

[@indiaonlineproducts2381]

sir i send u a email pls see and reply me

[@ruchikakarki9800]

Hello Mukesh, I am following your video and try the same capture but I got an error. Please help me in this how can I solved this as I am totally beginner in this. INFO: Found CDP implementation for version 99 of 97 Error opening data file ./eng.traineddata Please make sure the TESSDATA_PREFIX environment variable is set to your "tessdata" directory. Failed loading language 'eng' Tesseract couldn't load any languages! Warning: Invalid resolution 0 dpi. Using 70 instead. [Utils] Attempting to create E:\Softwares\Project\Amazonproject\test-output\Default suite\Default test.xml [Utils] Directory E:\Softwares\Project\Amazonproject\test-output\Default suite exists: true FAILED CONFIGURATION: @BeforeMethod login

[@restihariyati]

I got this error Reason: java.lang.NoSuchMethodError: com.sun.jna.Native.load anyone can help, please ?? Thank You