How to use Selenium with Sikuli (Automate Flash Objects)

Integration of Sikuli with Selenium WebDriver:
Now, no need to take the headache of XPath, CSS, ID and Name.
+Sikuli is an image-based open source tool to automate the GUI and can be used on any platform like Windows/Linux/Mac/Mobile.
+Sikuli uses a technique called image recognition to identify and control GUI components.
====================================================
• Automate using images
• No API to launch Browser and URL - need to use selenium
• Can automate flash objects - KZbin video
• Desktop application automation
====================================================
Subscribe to this channel, and press bell icon to get some interesting videos on Selenium and Automation:
www.youtube.co...
Follow me on my Facebook Page:
/ naveenqtpexpert
~-~~-~~~-~~-~
Follow my Site/Blog: www.naveenautom...
========================================================
Please watch: "Selenium & Automation Interview Preparation - By Naveen AutomationLabs"
• Selenium & Automation ...
~-~~-~~~-~~-~ Subscribe to this channel, and press bell icon to get some interesting videos on Selenium and Automation:
www.youtube.co...
Follow me on my Facebook Page:
/ naveenqtpexpert
Let's join our Automation community for some amazing knowledge sharing and group discussion on Telegram:
t.me/joinchat/...
Paid courses (Recorded) videos:
Java & Selenium Course: www.naveenautom...
API Course: www.naveenautom... ➡️Get Our Courses✔️
📗 Get My Paid Courses at
Paid courses (Recorded) videos:
Java & Selenium Course: www.naveenautom...
API Course: www.naveenautom...
-------------------------------
✔️SOCIAL NETWORKS
Facebook: / naveenqtpexpert
Twitter: / naveenkhunteta
Blog: www.naveenautom...
--------------------------------
Support My Channel✔️Or Buy Me A Coffee
Paypal: paypal.me/nave...
Google Pay: [e-mail]
--------------------------------
✔️Thanks for watching!
देखने के लिए धन्यवाद
Благодаря за гледането
感谢您观看
Merci d'avoir regardé
Grazie per la visione
Gracias por ver
شكرا للمشاهدة

[@mariabajwa8632]

Finally i did felx application automation task...thank you...you are just blessings for SQA's.

[@omkarpotdar2763]

Thanks a lot Naveen. Another interesting and useful topic you have covered. Keep it up Naveen😊

[@yashwantbeeram8543]

Hi Naveen. I am really thankful for all ur videos. I am watching all and practicing regularly. Its really happy to see if videos. You always give brother like suggestions everytime in between.Actually prior to this video may be Jenkin or Testng small introduction video need to be there.it will be really helpful for new learners otherwise may be it need to be after testng and maven.

[@naveenkumarprasad932]

Hi Naveen, Everything is fine in lecture but I am bit confuse for two line of code. You had written these line of coded Screen s = new Screen(); Pattern pauseImg = new Pattern("YT_pause.img"); s.click(); How those s.click method know that we need to click on "pauseImg" even though there is no connection between Screen object s and Pattern object pauseImg? should it not be like this: s.click(pauseImg); Actually both worked for me. your code will fail in case someone writ like this. Screen s = new Screen(); Pattern pauseImg = new Pattern("YT_play.png"); Pattern PlayImg = new Pattern(") s.click(); Now click will click on PlayImg object, not on pauseImg. Please correct me if I am wrong

[@mathewgeorge1247]

Hi Naveen, is usage of Sikuli needed for KZbin now? I was able to click all the control buttons and Cog (Setting) button using Xpath itself. //button[@class='ytp-play-button ytp-button ytp-play-button-playlist'] for Play button //button[@aria-label='Settings' and @title='Settings'] for Settings button //div[@class='ytp-menuitem-label' and contains(text(),'Quality')] for changing video quality Did KZbin stop using flash or something?

[@NPRBEST]

Learned an important concept. Thank you very much for simple explanation.

[@sapnajoshi725]

is sikulixapi is working for you? Because i am getting this error java.base/jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to java.base/java.net.URLClassLoader .Please help me out .

[@mariabajwa8632]

ohh thank you so much for this, i am searching for this...

[@Ashishbains25]

Not able to import screen class(importing org.sikuli.api), its showing "Cannot instantiate the type Screen".

[@deep80105]

U need to import import org.sikuli.script.Screen;

[@DineshKumar-du2dm]

Great learning Naveen...Very much needed for my flash application project. Thanks a lot :)

[@santoshs105]

Getting below error on running script. Any idea how to solve it? [error] RunTimeAPI: * terminating: loadlib: libVisionProxy.dylib not available in /Users//Library/Application Support/Sikulix/SikulixLibs_201510081336

[@kshipra4504]

Hi! If we run the same script on different system with different pixel resolution(which might see the same image as of different resolution), will this even work there?

[@ahmadrafiamarkhil4552]

how to take screenshot for sikuli?

[@NamRaj2021]

sir ! what to write code to pen the desktop applications.? for suppose if we want to open chrome browser by taking screenshot then we can not add url like driver.get(" ........") .

[@sreenivasu493]

Good explanation. if i want to take a screen shot of particular image in windows. How to select and how to take screenshot in windows. please explain

[@shaliniverma9233]

Can we do automation testing for desktop games or any type of games we play on our PC using sikuli?

[@DineshKumar-du2dm]

Hi Naveen, I'm struct with the below error when i tried to use sikuli with selenium. Could you please help me to figure out the solution for this issue. Exception in thread "main" FindFailed: can not find P(C:/Selenium/gmail.PNG) S: 0.7 in S(0)[0,0 1280x720] Line 2189, in file Region.java at org.sikuli.script.Region.handleFindFailedShowDialog(Region.java:2189) at org.sikuli.script.Region.handleFindFailed(Region.java:2134) at org.sikuli.script.Region.wait(Region.java:2546) at google.main(google.java:26)

[@ramitdhamija6655]

Hi, is there any way to use Sikuli with Remote Machines(Selenium Grid) ? I have been using your Sikuli method along with the command: "driver.setFileDetector(new LocalFileDetector());" but it doesn't work and shows error "FindFailed" however it works locally.

[@PoojaThakur-bp2tz]

Hi @naveen , I am trying to automate a desktop application using sikuli but I am getting number format exception , have tried to catch the exception using the exception handling but no help , further to add on this I am performing a simple operation when I need to search the icon on screen and click the icon but getting the number format exception Please note : I have performed the sikuli integration with selenium web driver

[@aishwaryab3592]

getting this error when we run selenium sikuli code in remote VM using jenkin..Mouse: not useable (blocked)

[@omashete3800]

how to take screenshot please suggest me

[@fathimasyed4232]

interesting .. New concept for me :) Thank you ..

[@santoshs105]

Getting below error on running script. Any idea how to solve it? [error] RunTimeAPI: * terminating: loadlib: libVisionProxy.dylib not available in /Users//Library/Application Support/Sikulix/SikulixLibs_201510081336

[@nagasri3664]

Naveen after adding both the dependencies I got error in pom.xml. please help me out

[@ankurkosaria1569]

awesome naveen.. it looks so easy

[@indrajitbhattacharjee8204]

Nice explanation Naveen.One query how to slide the video based on a particular time frame say i want to slide the video at a position 10:35 ?

[@abhilashtc]

Hi Naveen... Just happened to watch this video, This is the first video that I've watched on Sikuli. Its interesting and simple and the execution is fast when compared with QTP for flex automation. What I understood is Sikuli does the image comparison for the relevant object and perform the subsequent action. I have a doubt since its identify the objects based on the images... What if I am executing the test on a different machine or same machine after changing the screen resolution... Will Sikuli be able to identify the object??

[@deep80105]

It will behave unexpectedly.It might throw FindFailed exception. It is better to use with same resolution.

[@lavanya.ds0657]

Hi sir, I'm trying to run sikuli code along with other java code(, only 2 steps involve sikuli) using run.bat file , java language, it's failing abruptly without throwing any error while executing the sikuli method, please help me to resolve this issue

[@real_hello_kitty]

Thanks. Appreciate.🧤😀

[@naseemakhtar8243]

Hi Naveen, I am trying to upload file using selenium in Webdriver. Getting ExceptionInitializerError. Please help me how to resolve this issue. Have also added the required dependency in pom.xml filr for sikuli.

[@mandarjoshiin123]

Hi Naveen, I am getting cannot instantiate type Screen error. What can be the reason?

[@rupjitdas8509]

If we move our mouse control from the browser under test or if we minimize it will sikuli still work or will it fail

[@bihari1422]

Hi Naveen, by going the videos playlist I dont know about Maven Project

[@anuragsingh-oj2xs]

How can we seek the you tube video at a particular time using Sikuli?

[@balapramodhsheriyala7847]

I am unable to run the program any suggestions please

[@kieranocallaghan7667]

Couldnt create the Screen object java.base/jdk.internal.loader.ClassLoaders$AppClassLoader cannot be cast to java.base/java.net.URLClassLoader

[@anithadevasenavijayavelan5670]

Thank you Naveen, I tried but I got image not found and text search switch off in console. Even I added sikuli-java.jar file . And also I added imagepath.setbundlepath(“path of the image file”) But still I revive the same error. Can u please help me to fix this issue

[@purvidholakia3570]

Hi Naveen, First of all thanks. I have learnt java and selenium by watching your all lectures. Thank you so much for uploading very useful videos. Today i exactly follow your steps and captured almost 10-12 images but getting one error and not getting any solution on google. The error is FindFailed: can not find P(C2.PNG) S: 0.7 in S(0)[0,0 1366x768] Line 2189, in file Region.java at org.sikuli.script.Region.handleFindFailedShowDialog(Region.java:2189) at org.sikuli.script.Region.handleFindFailed(Region.java:2134) at org.sikuli.script.Region.wait(Region.java:2546) I am trying to capture a first name from the image having 12 names. It has clicked 2-3 times but now getting an error. Any help will be appreciated.

[@TwinkleGandhi]

I'm facing same error. did you get any help?

[@rahulgade1870]

I am also getting same error..Do you know any solution

[@madhurinemade27]

What if same image present twice on the page will sikuli work for it?

[@celebrationsadventures4105]

when i launch desired link in driver.get method "ads" get started every alternate iterations. how to handle SkipADS flash object

[@santoshs105]

Getting below error on running script. Any idea how to solve it? [error] RunTimeAPI: *** terminating: loadlib: libVisionProxy.dylib not available in /Users//Library/Application Support/Sikulix/SikulixLibs_201510081336

[@Rashmi_Chauhan]

hey naveen how to automate scroll functionality using sikuli.can you help me with this

[@sindug707]

How to generate report and error log for sikuli

[@brahmendrajayaraju9529]

What is the system resolution we have to set

[@MrRaviBhavsar]

Hi @naveen , can we automate flex based application ?

[@pranaykumar8616]

Hi Naveen, Can you please upload a video to compare images using sikuli.

[@crazylovebutreal9338]

it ask for Screen and Pattern object need to override some methods

[@WMohanty]

How to take screen shots of pause button in windows.

[@mayurkarnik310]

Hi Naveen I want to know whether we can run sikuli script on jenkins or not?

[@naveenautomationlabs]

Yes you can. Make sure all the images are part of your workspace so that Jenkins can read them.

[@mayurkarnik310]

Yes i will take care of that..is there any configuration related changes we need to do on jenkins?Thanks for your reply.

[@mayurkarnik310]

Naveen..I am not able to run sikuli script through jenkins. It get execute when i rut it from locally, but from jenkins it does nothing.Plz help me

[@puneetgupta4006]

i'm getting below error when i'm doing same Error: Unable to initialize main class com.excel.utility.KZbin Caused by: java.lang.NoClassDefFoundError: org/sikuli/script/FindFailed

[@puneetgupta4006]

kindly guide plz.......

[@tejastoley6714]

i take screenshot of like logo but it will click on share.

[@puneetgupta4006]

i'm getting below mentioned error - [error] RunTimeINIT: *** BE AWARE: Running on Java 8+ *** Please report problems *** [error] RunTimeINIT: *** Java 8+: skipped: storeClassPath() [error] RunTimeINIT: *** Java 8+: skipped: storeClassPath() [error] RunTimeINIT: *** Java 8+: skipped: addToClasspath() - caller: RunTime.libsExport API [error] RunTimeINIT: *** Java 8+: skipped: dumpClassPath() [error] RunTimeINIT: *** terminating: libs to export not found on above classpath: /sikulixlibs/windows/libs64 kindly suggest me if anyone knows

[@sabavathamir3611]

sir did u upload autoit topic?

[@nalinaksheepanda1596]

Screen class has now become an Interface, also Pattern class changed, I found an alternative approach using JavascriptExecutor from another site and the below is also working. WebElement video = driver.findElement(By.tagName("video")); JavascriptExecutor js = (JavascriptExecutor)driver; // pausing the video js.executeScript("arguments[0].pause();", video); Thread.sleep(5000L); //playing the video js.executeScript("arguments[0].play();", video); Thread.sleep(5000L);

[@shreyanshjain2347]

Screen class is available . mvnrepository.com/artifact/com.sikulix/sikulixapi/2.0.4

[@cinthiyavincent9527]

@@shreyanshjain2347 thank you

[@HarpreetKaur-nm8qu]

Hi Naveen, Encountering below error: Exception in thread "main" FindFailed: can not find P(images/search.png) S: 0.7 in S(0)[0,0 1280x800]

[@tejastoley6714]

how can you take a screen shot of specific element i have a window 10

[@anupamdey5924]

@@tejastoley6714 snipping tool

[@vishalshaha1079]

Sir, I am facing trouble with sikuli. I am getting an error that says "cannot instantiate the type screen".

[@RayeedWorld]

vishal shaha I am having the same problem. Can you give us a solution Naveen, please?

[@deekshapuri5252]

Naveen could you please help in this?

[@ArunRajput-ut7gt]

brother telme de jarfiles u have downloaded in jarfiles folder

[@danedocgiant5761]

knowledgable guy. i don't like his attitude though.

[@mariabajwa8632]

hi naveen, how to automate flex application through Selenium Flex API,(sfapi)? kindly upload video regarding this when you will be free... thank you

[@DeepakVishwakarma-uv4yr]

Can someone please help me with sikuli script api link. It will be really helpful.

[@priyal7641]

Please guide me to create Maven project

[@sabavathamir3611]

why r u using sikuli..for webapplication..we have xpath and y r u using sikuli naveen..

[@kshipra4504]

Getting Exception ----> Exception in thread "main" java.lang.ExceptionInInitializerError at org.sikuli.basics.Debug.log(Debug.java:697) for line Screen s=new Screen(). Seems to be related with maven jar...Please suggest

[@jaykatti]

Hi Naveen, I tried executing these using Sikuli and I exactly followed the steps for creating a Maven project. However, I keep getting this error message. Can you help pls. ? Tried googling for solutions, but could not resolve the issue. [error] RunTimeINIT: *** terminating: libs to export not found on above classpath: /sikulixlibs/windows/libs64

[@deep80105]

U need to double click on .jar file and accept option 2 for windows. It will download the necessary api.I was facing the same issue and now it is resolved.