Katalon Studio 9 - Test Suite Collection - How to run Test Suites in parallel

[@魏卡咪魯]

Hi Raghav , I have to say your whole Katalon studio series videos and other videos help me a lot , they are very useful. Thanks for your work !

[@RaghavPal]

You're welcome

[@KatalonPlatform]

Great video. Thanks for your support :)

[@gpmaestro2209]

Hi Raghav, Just want to give you background: We are in process to setup &/or evaluate automation using Katalon studio v 7.7.2 for our application under testing. The AUT has WEB, API and thin tiers. To start with I created 3 test cases for REST API & 3 test-cases for web-ui and tried to ran these test cases in parallel execution mode underneath test collection. Katalon studio always throwing different errors for above 3 web-ui test cases though there same platform(I.e chrome) used for all runs. I analyzed that Katalon studio throwing different errors for every run. Per Katalon documentation &/or forum responses I tried below options: 1. Reduced thread pool size to 2 threads still Katalon studio throwing errors for 3 web-ui tests. 2. I tried to increase global project page load time - 30 seconds & actions time - 30 seconds underneath project ->settings->execution - web-ui setting but no luck. 3. I tried to increase heap size and tweak garbage collection algorithm but still web-ui test cases steps failing for different reasons. 4. Then I added is web-ui element visible method to detect web component visibility and based on visibility traversing subsequent logic. However those web-ui test cases failing for different reasons. Per one Katalon studio forum thread - This is just my guess based on the symptoms, but it’s probably a consequence of multi-threading. When you use “Parallel Execution” mode in a Test Suite Collection, underneath Katalon will create many execution threads, and every now and then it switches to a different thread and continue that execution. A side-effect is that during these switches, the browsers are in and out of focus, which may cause the web page (specifically the elements) to react unexpectedly. For example, an element may not be interactable if it’s not focused, and this may be the case when the entire browser is not focused. Please advice is there is any problem in my approach for running parallel mode & suggest how to rectify errors occurred while executing web-ui tests in parallel execution mode. Thanks, Ganesh

[@RaghavPal]

Hi Ganesh, Looks like you have tried all the solutions that I may have suggested. In case the failure is consistent, and occurs at the same step everytime, you may try adding some delay before that step and try. After this the best option will be to reach to Katalon Support team directly and inform that you are evaluating Katalon Studio for your organization and inform the issues faced

[@cuentaprueba6768]

con estos videos se aprende mucho

[@RaghavPal]

Gracias por ver

[@puneethchidura3713]

Hi Raghav, The above video was a great explanation on Test Suite Collections. I am unable to see the reports option on the left side in the version of Katalon in using in my local. I am currently using "Katalon Studio -7.2.1". Could you please lemme know how do it get to see it. Thanks.

[@RaghavPal]

Hi Puneeth, reporting is now moved to a plugin. Check this - kzbin.info/www/bejne/opbNe4R8r7aUgKc

[@ravendrathallapureddy7774]

Raghav, thanks for videos. Is there a way i can run same tests/test suites using different app urls. or do i have to duplicate the tests?

[@RaghavPal]

you can add test data and then add variables in your test case to get values from the test data.

[@Bookshelf4you]

Hi Raghav, Thanks for your videos on Katalon studio , very useful. My query is unrelated to the current video- Do you have any videos uploaded on API Testing with Katalon Studio ?

[@RaghavPal]

Hi Sangeetha, not yet, i will do them

[@tejkumarkempaiah4906]

Thanks for the videos :) They are very helpful... The report option is missing the katalon version: 7.0.3, Please suggest.

[@RaghavPal]

Hi Tej, report has moved to a plugin. Watch this - kzbin.info/www/bejne/opbNe4R8r7aUgKc

[@gsantos9]

Hi Raghav, thanks for the video was a nice help. How can I set the Select Enviroment : Web Desktop: edge, firefox, chrome, etc... because in my case the only one that appears is Web Service Thanks in advance

[@RaghavPal]

Hi Guilherme, are you talking about the run dropdown. While createing the project you must have selected type as web-services, You can select type as web or generic

[@gsantos9]

@@RaghavPal Exactly!! Thanks :D solved my problem

[@whizwizzy]

Hi thank you for this awesome video. Can I ask also if we can use this tool for oracle browser application? Btw what is the name of the soundtrack you are playing at the end of each video you are doing? thanks

[@RaghavPal]

Hi Ally, you can actually do a POC with Katalon Studio as it's free and then decide. I don't remember the music track name

[@kristhudas726]

Hi Raghav , I have 1 test suite consisting of 10 test-cases and i would like to run complete test-suite parallely in chrome browser(in sauce-labs) how this can be achieved??

[@RaghavPal]

Hi Kristhu, you can try sauce labs integration plugin - forum.katalon.com/t/katalon-studio-sauce-labs-integration-is-here/29473

[@TheUkr1244]

Very well explained.

[@RaghavPal]

Thanks for watching Uday

[@appansingharoy491]

Hi Raghav, thanks much for these wonderful videos on Katalon. I'm facing a problem while creating the test suite collection. The "run with" option is coming web service by default and not getting changed. Also, another issue on reporting - html report and log file is not getting generated. Please suggest any solution for these issues. I'm using katalon v6.1.5 (Win 32 Bit). Thanks for your help !!

[@RaghavPal]

Hi Appan, for the first issue, it may be that while creating the project you selected type as api/web serivces, you can create a web for generic type project. For the 2nd one, since ver 6.1.5 you need to add basic reports plugin for reporing. Pls check here store.katalon.com/product/59/Basic-Report docs.katalon.com/katalon-studio/docs/basic-report.html

[@cleytoncqueiroz]

Very good! Very Best!

[@RaghavPal]

Thanks for watching Cleyton

[@asadhaider1961]

Hello Sir. Thanks for your helpful videos . It really helped me a lot .. I wanted to ask you that I am facing a problem in reports setion ... I have a version of 705 but its not shoe me any reports even if I click on the test suite last run i is showing me a dialog box of saying if you are intrested in katalon click here.. Please can you help me ..

[@asadhaider1961]

mistake 7.5 version

[@RaghavPal]

Hi Asad, you will need to add Basic Reports plugin - Check this - kzbin.info/www/bejne/opbNe4R8r7aUgKc

[@tsarevdmitry]

thanks for explanation

[@RaghavPal]

you're welcome

[@pradipathennarasu7294]

Hi Raghav.. With the new version of Katalon,there is an option "Max Concurrent Instance" for the parallel run option. Could you please help with the use of the option? Also in your video when test is running i can see two different browsers poping up which proves tests are running parallelly,but in my case i dont see the second browser..Not sure if parallel execution option works...Any clue on this?

[@RaghavPal]

Hi Pradipa, Max concurrent instance means how many instances you want to run in parallel, suppose you have 4 test suites and you select 4 max concurrent instances and all 4 will start together in parallel. Suppose you provide 2 instances than 2 parallel instances will run and as soon as one test suite will complete the 3rd one will be picked up and so on. Now the number of parallel instances also depends on your machine configuration. In your case, try to have some wait time as the first step so you can see both browsers in parallel

[@howang8662]

I have three test suites that run perfectly normal independently. After adding them to a suite collection and run it sequentially, it always randomly fails at some points. I wonder what could be the possible reason for this? Thank you very much!

[@RaghavPal]

Hi Derek, will need to check the logs

[@kowsalrajkesavan6545]

Raghav, 1. Test Suite1 contain Test Case 1 & Test Case 2 (Open browser - login) 2. Test Suite 2 contain Test Case 3 & Test Case 3 (Search books - logout) After I run the test suite collection, the first suites runs, Katalon display test passed, but never run the second Suite. Can u please help me to sort out this!!!

[@RaghavPal]

Hi Kowsalraj, Yes, pls tell me your doubt here

[@kowsalrajkesavan6545]

So the use of "Test Suite Collection" is to add the same test suite (that with single test case only) multiple times and run parallely with different browsers right bro? What I did is -> I had added 2 Test suites (that with two test cases enabled in each suites) inside the test suite collection. After I executed, Test suite 1 was successfully executed but When goes to Test Suite 2 browser closed (Test Suite 2 is not executed)

[@RaghavPal]

Will have to see you steps in test cases for this

[@kowsalrajkesavan6545]

Can you please send me your mail id bro? I can send you detaily

[@divyagotewal]

Hi Raghav, I ran my test suite collection in chrome browser, it is working fine but in Firefox, safari, IE, and Edge browser didn't work. Is there any settings or installation etc I need to do?

[@RaghavPal]

Hi Divya, you need to check the error/issues and we can troubleshoot accordingly.

[@Sholdanenko]

Hi. Thank you for great videos. Can you film a tutorial "how to upload a file"?

[@RaghavPal]

You're welcome. Will try to do in some time

[@over1498]

Did they remove the "Run With" column? Seems like Katalon is removing features in latest versions... How do I define what it is run on?

[@RaghavPal]

Hi, don't think so, what ver are you using. pls check again. Hope you are not checking in TestSuite instead of TestSuiteCollection

[@appansingharoy491]

@Over, some headers are hidden in test suite collection. Hover your mouse in the junction of any two headers and you can understand the difference. Then drag the hidden headers and you can get the run with option.

[@ariannacarbonell9]

Hello, I need a suite to run two test cases in parallel and another sequential, so the test collection does not work for me, what advice do you give me to do it?

[@RaghavPal]

Hi Arianna, you can still add these test cases in different test suite and then create 2 Test Suite Collections. Can add the suites you want to run in parallel in one suite and in the other add the ones you like to run sequentially. Now if you like to start both TS Coll at the same time you command line

[@saraalyahya8253]

Hi , is that called also concurrency testing ? or there is a different ?

[@RaghavPal]

Hi Sara, in general, you can say both are same. If you go deeper, there is a diff, Can check this - medium.com/@itIsMadhavan/concurrency-vs-parallelism-a-brief-review-b337c8dac350

[@saraalyahya8253]

@@RaghavPal Thanks , but if i used the Parallel testing , i can get the same result when i use the concurrency , for example if there is a crash , will be display while using Parallel

[@punitb9853]

Hi Raghav, The Execute does nothing when I run the Test collection. Is there any other setting/configuration required to execute the test?

[@RaghavPal]

Hi Punit, are the test suite checked (enabled) for execution.

[@punitb9853]

Automation Step by Step - Raghav Pal - Hi Raghav Yes I have checked the test suites in test collection same as shown in your video. When I run a single test suite with multiple tests it works fine however when I add a test collection suite and execute the test it doesn't do anything.

[@RaghavPal]

This is strange, Not sure why is this happening, hope there are no settings for this. The last resort is get a new version of Katalon Studio and try.

[@punitb9853]

Ok I will try that as well. Thanks !

[@rmznbyk149]

Hi Raghav , How can i run collection on KRE? What is the execution command?

[@RaghavPal]

Hi, on cmd prompt you will need to change dir (cd) to the location of KRE folder and then run the command generated from Katalon Studio

[@bnkumarreddy3863]

How to test date filed in test katalon studio . I created objects like source , destination and input date of journey , search How to send date in calendar field .

[@divushree]

Unable to run katalon project in IE safari could you pls help me on this

[@RaghavPal]

Hi Divushree, What is the issue you are getting, For IE, you will have to check this - docs.katalon.com/katalon-studio/docs/internet-explorer-configurations.html For Safari, make sure you allow remote automation from developer menu Sarari > Preferences > Advanced > Check - Show developer menu Close preferences and Goto menu Develop > Allow Remote Automation support.testsigma.com/support/solutions/articles/32000021870-configuring-safari-for-automated-tests-in-testsigma

[@tinasaxena9348]

Hello sir, how to run one website in two chrome browsers simultenaously?

[@RaghavPal]

Tina To run one website in two Chrome browsers simultaneously using Katalon Studio, you can use the following steps: 1. Open Katalon Studio and create a new test case. 2. Add the following code to your test case: ```groovy // Open the first Chrome browser. WebDriver driver1 = new ChromeDriver(); // Open the second Chrome browser. WebDriver driver2 = new ChromeDriver(); // Navigate to the website in both browsers. driver1.get("www.google.com/"); driver2.get("www.google.com/"); // Perform your test actions on both browsers. // Close both browsers. driver1.quit(); driver2.quit(); ``` 3. Run the test case. This code will open two Chrome browsers and navigate to the specified website in both browsers. You can then perform your test actions on both browsers. When you are finished, the code will close both browsers. If you need to switch between the two browsers during your test case, you can use the following code: ```groovy // Switch to the first browser. DriverFactory.changeWebDriver(driver1); // Switch to the second browser. DriverFactory.changeWebDriver(driver2); ``` You can also use the `DriverFactory.getWebDriver()` method to get the current WebDriver object. This can be useful if you need to perform some actions on the current browser, such as getting the page title or taking a screenshot. Here is an example of a complete test case that runs one website in two Chrome browsers simultaneously: ```groovy import com.kms.katalon.core.webui.keyword.WebUI class RunWebsiteInTwoChromeBrowsers { @Test def void runWebsiteInTwoChromeBrowsers() { // Open the first Chrome browser. WebDriver driver1 = new ChromeDriver(); // Open the second Chrome browser. WebDriver driver2 = new ChromeDriver(); // Navigate to the website in both browsers. driver1.get("www.google.com/"); driver2.get("www.google.com/"); // Perform your test actions on both browsers. // Switch to the first browser and check the page title. DriverFactory.changeWebDriver(driver1); String pageTitle = WebUI.getWindowTitle(); assert pageTitle == "Google"; // Switch to the second browser and take a screenshot. DriverFactory.changeWebDriver(driver2); WebUI.takeScreenshot("screenshot.png"); // Close both browsers. driver1.quit(); driver2.quit(); } } ``` You can customize this test case to meet your specific needs. For example, you can change the website that you are testing, add more test actions, or change the way that you switch between the two browsers.

[@PREMKUMAR-wg4qb]

Hi, Can I run Web and Mobile test cases paralley in one test suite ?

[@RaghavPal]

Hi Prem, I have not tried that, but in case you create test cases for mobile and web, You should be able to add them in test suite and then add the suite in test suite collection and try to run with parallel option on.

[@hoavinh1546]

Hi, can I run a collection from the command line? Thanks.

[@RaghavPal]

Hi Hoa, it is explained in a future video. Can check all Katalon Playlist here - automationstepbystep.com/

[@vipshrm9]

Hi , can we do the same with mobile testing and select two different devices for test suites ... One for testsuite1 and other for testsuite2 ??

[@RaghavPal]

Hi Vipul, in the test suite collection, I do see option to select android and iOS, but not exactly sure if you can add 2 devices with your system (or emulators) and run on different devices. May be the Run Configuration column can do this, but not sure, I have asked someone in Katalon Studio team, Lets see if I get some response. You can also ask this in Katalon forum. let me know if you get some response

[@vipshrm9]

Automation Step by Step - Raghav Pal Okay , Thanks for the reply man ... Your tutorials on automation are really good ... and If I'm able to do so I'll let you know .. ✌️

[@RaghavPal]

Thanks Vipul, did you anyways try to connect 2 devices and see if you get the option in TestSuiteCollection runner

[@vipshrm9]

Hey , I am able to automate two test suites on two different Android devices in parallel . 🤘Yay

[@iniramesh]

@@vipshrm9 Hello Vipul, I am trying to do the above mentioned parallel execution on Android mobile devices using Kobiton. Could you please let me know how did you configure this in Katalon studios?

[@sskk1503]

for dynamic xpath what we have to do man and one thing i have multiple hotels in one page how to a verify...

[@RaghavPal]

Not exactly clear, Are you having trouble in identifying objects. You can watch earlier tutorials on that.

[@tutkuayavefe]

is it possible to use Xamarin test cloud with katalon studio?

[@RaghavPal]

Katalon has direct integration with Kobiton, but you can use Xamarin as well - www.katalon.com/videos/automating-native-xamarin-ios-application-macos-katalon-studio/

[@nguyenminhhieu5332]

Can you direct the add file data and run the data file?

[@RaghavPal]

Hi, did not completely understand your query. Please elaborate.

[@BharathHari1]

can we take screen shot at failed step.. Is it possible in katalon?

[@RaghavPal]

yes Bharath we can do that.

[@RaghavPal]

check this - docs.katalon.com/display/KD/%5BWebUI%5D+Take+Screenshot

[@tinasaxena9348]

Means i have website in which i have to work on both the side patient and doctor so in this when patient send some data then it is visible to the doctor side so how to record this in two browsers parallely?

[@RaghavPal]

To record a test case in Katalon Studio that runs one website in two Chrome browsers simultaneously and captures the interaction between the two browsers, you can use the following steps: 1. Open Katalon Studio and create a new test case. 2. In the **Record** section of the test case, select the **Browser-based Recorder** option. 3. Click the **Record** button. 4. In the **Choose browser** dialog box, select the **Chrome** browser and click the **OK** button. 5. Katalon Studio will open two Chrome browsers. 6. In the first Chrome browser, navigate to the patient side of your website. 7. In the second Chrome browser, navigate to the doctor side of your website. 8. Perform the actions that you want to record on the patient side of the website. 9. Once you have finished recording the actions on the patient side, stop the recording. 10. Katalon Studio will generate a test case that contains the steps that you recorded. 11. You can now review and edit the test case as needed. To run the test case, simply click the **Run** button. Katalon Studio will open two Chrome browsers and execute the test case in both browsers simultaneously. Here is an example of a complete test case that runs one website in two Chrome browsers simultaneously and captures the interaction between the two browsers: ```groovy import com.kms.katalon.core.webui.keyword.WebUI class RunWebsiteInTwoChromeBrowsersAndCaptureInteraction { @Test def void runWebsiteInTwoChromeBrowsersAndCaptureInteraction() { // Open the first Chrome browser. WebDriver driver1 = new ChromeDriver(); // Open the second Chrome browser. WebDriver driver2 = new ChromeDriver(); // Navigate to the website in both browsers. driver1.get("www.mywebsite.com/patient"); driver2.get("www.mywebsite.com/doctor"); // Perform the actions on the patient side of the website. WebUI.setTextField("patient_name", "John Doe"); WebUI.setTextField("patient_email", "[e-mail]"); WebUI.clickButton("submit_button"); // Switch to the doctor side of the website and verify that the patient data is displayed. DriverFactory.changeWebDriver(driver2); String patientName = WebUI.getText("patient_name"); String patientEmail = WebUI.getText("patient_email"); assert patientName == "John Doe"; assert patientEmail == "[e-mail]"; // Close both browsers. driver1.quit(); driver2.quit(); } } ``` You can customize this test case to meet your specific needs. For example, you can change the actions that you perform on the patient side of the website, add more assertions to verify the interaction between the two browsers, or change the way that you switch between the two browsers.

[@tinasaxena9348]

@@RaghavPal thanks but in top when we click on record option then by default chrome is selected and i cannot find record based option and when it will open two browser where is the option to choose two browsers?

[@tinasaxena9348]

@@RaghavPal because from toolbar we can select only one chrome so how to select two browser from where and on which setting we can select two browser?

[@RaghavPal]

ok, if i get any more info will check. Meanwhile can check with Katalon Studio support team or forum

[@tinasaxena9348]

@@RaghavPal can you tell me where recorder based option in katalon from which two browser will open for recording

[@yangjeerai8363]

MobileElement label_job=driver.findElement("co.olivemedia.hihoandroidwebapp:id/bt_refine"); if(label_job.isDisplayed()) I need to check if element is displayed and then apply conditions in katalon. Please help me out how can i achieve this ?

[@RaghavPal]

You can create custome Keywords.

[@yangjeerai8363]

while(Mobile.verifyElementExist(findTestObject('android.widget.TextView3 - Jobs'), 10)) { loop statement; if(Mobile.verifyElementnotExist(findTestObject('android.widget.TextView3 - Jobs'), 10)) { } break; } In above code, I want to loop until element Job exist if (element job does not exist) go to if statement. But I have having issue in if statement -Failed to check for element not exist (Root cause: Element 'Object Repository/android.widget.TextView3 - Jobs' is exist).Actually code should ignore if statement and again loop if element job is found.I have used same code in selenium with isDisplayed() function instead of exist function which is working fine.Please help me ou

[@RaghavPal]

Can you try using not ! and give positive condition in if block. Not sure, just try out.

[@yangjeerai8363]

I used it but it is not working.Cant we use do while loop in katalon? I am unable to use it code shows issue in do statement line.

[@yangjeerai8363]

if(!Mobile.verifyElementExist(findTestObject('android.widget.TextView3 - Jobs'), 10)) Failed to check for element 'Object Repository/android.widget.TextView3 - Jobs' exist (Root cause: Element 'Object Repository/android.widget.TextView3 - Jobs' not found) if(Mobile.verifyElementNotExist(findTestObject('android.widget.TextView3 - Jobs'), 10)) Failed to check for element not exist (Root cause: Element 'Object Repository/android.widget.TextView3 - Jobs' is exist)

[@RaghavPal]

I could not follow up on this. Is it resovled now

[@yangjeerai8363]

No it is not solved.Errors : if(!Mobile.verifyElementExist(findTestObject('android.widget.TextView3 - Jobs'), 10)) Failed to check for element 'Object Repository/android.widget.TextView3 - Jobs' exist (Root cause: Element 'Object Repository/android.widget.TextView3 - Jobs' not found) if(Mobile.verifyElementNotExist(findTestObject('android.widget.TextView3 - Jobs'), 10)) Failed to check for element not exist (Root cause: Element 'Object Repository/android.widget.TextView3 - Jobs' is exist)

[@Deniz-ss1sv]

:)

[@RaghavPal]

Thanks for watching Deniz