Katalon Studio 10 - Test Execution REPORTS

For new ver watch - • Katalon Studio | How t...
Today we will learn:
1. Test Case Report
2. Test Suite Report
3. Test Suite Collection Report
_________________________________________
1. Test Case Report - Log Viewer
Features:
--------------
Execution Filters
Tree View
Scroll Lock
Test Case Report is not preserved
_________________________________________
2. Test Suite Report - Historical Report
Features:
--------------
created after Test Suite execution
named with timestamp - YYYYMMDD_HHmmss
provides summary + details
html report
Test Suite Report is preserved (historical report)
_________________________________________
3. Test Suite Collection Report - Historical Report
Features:
--------------
created after Test Suite Collection execution
named with timestamp - YYYYMMDD_HHmmss
provides summary + details
html report
This Report is preserved (historical report)
_________________________________________
Helpful Tips:
can rename reports to meaningful names
can view captured screenshots in reports
can open reports after execution
_______ ONLINE COURSES TO LEARN _______
Visit - automationstepb...
----------- UI TESTING -----------
Selenium Beginners - bit.ly/2MGRS8K
Selenium Java Framework from Scratch - bit.ly/2N9xvR6
Selenium Python - bit.ly/2oyMp5x
Selenium Tips - bit.ly/2owxc50
Selenium Builder - bit.ly/2MKNtlq
Katalon Studio - bit.ly/2wARFdi
Robot Framework - bit.ly/2Px6Ue9
----------- API TESTING -----------
Web Services (API) - bit.ly/2MGafL7
SoapUI - bit.ly/2MGahmd
Postman - bit.ly/2wz8LrW
General - bit.ly/2PYdwmV
----------- MOBILE TESTING -----------
Mobile Playlist - bit.ly/2PxpeUv
----------- CI | CD | DEVOPS -----------
Jenkins Beginner - bit.ly/2MIn8EC
Jenkins Tips & Trick - bit.ly/2LRt6xC
Docker - bit.ly/2MInnzx
----------- VERSION CONTROL SYSTEM -----------
Git & GitHub - bit.ly/2Q1pagY
----------- PERFORMANCE TESTING -----------
JMeter Beginner - bit.ly/2oBbtIU
JMeter Intermediate - bit.ly/2oziNVB
JMeter Advanced - bit.ly/2Q22Y6a
JMeter Tips & Tricks - bit.ly/2NOfWD2
Performance Testing - bit.ly/2wEXbLS
----------- JAVA -----------
Java Beginners - bit.ly/2PVUcXs
Java Tips & Tricks - bit.ly/2CdcDnJ
----------- MAVEN -----------
Maven - bit.ly/2NJdDRS
----------- OTHERS -----------
Redis- bit.ly/2N9jyCG
Misc - bit.ly/2Q2q5xQ
Tools & Tips - bit.ly/2oBfwoR
QnA Friday- bit.ly/2NgwGpw
Sunday Special - bit.ly/2wB23BO
Ask Raghav- bit.ly/2CoJGWf
Interviews - bit.ly/2NIPPxk
All Playlists - bit.ly/2LSiezA
----------- FOLLOW -----------
Facebook - / automationstepbystep
Twitter - / automationsbs
KZbin - / automationstepbystep

[@KatalonPlatform]

Thank you for your detailed tutorial :) You did an amazing job!

[@ronytraveller]

How can I see report weui.comment report?

[@dennywidyatmoko9892]

almost 1 month I did not work because I got laid off, and I used the time to upgrade skills by watching your video while looking for a new job.thanks a lot

[@RaghavPal]

Glad I could help Denny

[@revitasurya]

Thank you for these tutorials! So helpful for me.

[@RaghavPal]

You're very welcome Revita

[@VeenapatelNaluvala]

Hi Raghav . thank you for this amazing video It worked for me . Please make a video to get extent reports Thank you so much 😊

[@RaghavPal]

Hi Veena, sure I will do

[@keshavdwivedi5192]

thank you raghav for your wonderful explanation there is an issue with my test suite collection report, in my report if I open containing folder of test suite collection report then only rp file is shown no html or csv report are shown please tell me why is this happening ? please note that my test suite collection reports are getting formed properly

[@RaghavPal]

Hi Keshav, hope you created the collection and ran it properly. Any information in the logs ? Maybe you can try again with a fresh test

[@marturam1503]

Hi Raghav, Thanks the video session, Possibly can you upload session for IE11, its very helpful

[@RaghavPal]

I will do, you can also check this docs.katalon.com/katalon-studio/docs/internet-explorer-configurations.html

[@sachinjoshi2783]

Hi Raghav, I am very new to Katalon and using it just as a workaround for the load tests (since the Loadrunner version that we are using does not support the application). I am running 3 instances of browser simultaneously by giving "Delay between actions" as 5 sec. I collect response time from the report for the major actions/clicks. Is this delay included in the elapsed time in the reports? For instance, from Katalon User 1 takes 5.5 s for Doc view, User 2 - 5.6 s, and User 3 - 5.8 s while it takes less than 1 sec manually to complete this step. For some of the steps, there is a huge difference between the times like User 2 and 3 are taking 6 times more time. I am unable to reach any conclusion here. Could someone please help?

[@RaghavPal]

Hi Sachin, this may not be the best way to do a load test and the results will not be consistent. Creating virtual users load will also be tricky here. I will suggest to try some other performance testing tool like JMeter

[@testingtrail]

Thank you for this Raghav, apparently reports section is not part of Enterprise edition.

[@RaghavPal]

Hi Jorge, Reports feature was moved to a plugin. Check this - kzbin.info/www/bejne/opbNe4R8r7aUgKc

[@testingtrail]

@@RaghavPal thank you!!

[@nirajshakya7075]

I am using Katalon 7.0.1. In test explorer, I cannot see the Reports folder. Please assist

[@RaghavPal]

Hi Niraj, reports have moved to a plugin. Check this - kzbin.info/www/bejne/opbNe4R8r7aUgKc

[@satishquality336]

Can you please upload a video about using Junit/testng in Katalon Studio?

[@RaghavPal]

Hi Satish, i might look into it in some time.

[@adarshjain2745]

Hi Raghav ..in the project --> settings ..there is no report option displaying where i can choose take screenshot and create videos for passe and failed test case...is there any prerequisite for that ..?i have installed basics report plugin and it's displaying under plugins secn in project--> settings though...

[@RaghavPal]

Hi Adarsh, there are some changes in the latest ver, check docs.katalon.com/katalon-studio/docs/record-browser-based-videos.html

[@adarshjain2745]

@@RaghavPal thanks for ur prompt rpl... 😊

[@asadhaider1961]

Sir, your video at 3:29 when you told us about date year time .. I was talking about this report in previous comment also I am not getting is .. I mean when I click on this date year time option it gives me a warning dialog box .. Pleases help me in this .. thanks :)

[@RaghavPal]

Hi Asad, now the report feature is moved to a plugin Basic Reports, Watch this video - kzbin.info/www/bejne/opbNe4R8r7aUgKc

[@kotiramisetty8711]

Hi Raghav, can u please mke a video on how to generate extent reports in katalon ?

[@RaghavPal]

Hi Koti, I will check on this

[@VeenapatelNaluvala]

Hi Raghav can we create extent reports in katalon please let us know

[@trilokvooka7925]

How to export HTML report in latest katalon studio

[@RaghavPal]

Hi Trilok, watch this - kzbin.info/www/bejne/opbNe4R8r7aUgKc

[@zaheer21]

Hi Raghav, I guess this video is not completely relevant in latest version because Report folder is not available in Katalon.

[@RaghavPal]

Hi Zaheer, yes Katalon has recently moved the Reporting functionality to a plugin Basic Reports. I have covered it here - kzbin.info/www/bejne/opbNe4R8r7aUgKc

[@theshakeel2003]

Please share the video for data driven testing

[@RaghavPal]

will add

[@gowthamravindra9626]

Hi Raghav, I'm not able to take a screenshot on failure, it says ERROR: [SMART_XPATH] Cannot save screenshot to: C:/Users/Flow/Reports/smart_xpath, reason: (y + height) is outside of Raster

[@RaghavPal]

Hi Gowtham, I see you have also created this in Forum, lets wait to have a reply.

[@hemantsinha2730]

Hi Raghav ,thank you but I have latest katalon studio in which Report section seems not be free ,its asking to go for enterprise edition. Please let me know if I can get report for free version of katalon studio also somehow? Thanks in advance

[@RaghavPal]

Hi Heman, yes, now you need to get Basic Reports plugin. Watch - kzbin.info/www/bejne/opbNe4R8r7aUgKc

[@hemantsinha2730]

Thanks Raghav.

[@blhekai]

Hi Raghav , Do you konw how to bypass CAPTCHA when we using katalon or selenium?

[@blhekai]

thanks~I'm planning to use jenkins+testLink+selenium, that's a very very huge project :)

[@blhekai]

by the way, i found another solution: first, I ran a selenium script to manually type the CHAPTCHA, after that, I got the login cookies ,save it in files. second, I ran another selenium script (functionally) ,read the saved cookies file,and insert the cookies into selenium script program, refresh the page, finally ,it works with logined,so I can do the rest testing works ~

[@RaghavPal]

great! ideally captcha is to avoid any action by bots or automated scripts, so there are no straight forward ways to handle it. I am glad you worked and found your way through it.

[@vikashkeshri5849]

How to read data from csv or external file?? how to validate the database through katalon?? Please share us the detail information.

[@RaghavPal]

Hi Vikash, these links will help docs.katalon.com/display/KD/Manage+Test+Data www.katalon.com/resources-center/tutorials/data-driven-testing/

[@vikashkeshri5849]

Hi i need a help. I have one scenarion ilke a login to facebook page giveing a valid credential. I take the help of katalon recorder and object repository is created for that scenario. When i am trying to re-execute the same scenario wit the help of RUN button in katalon, is failing the login button of facebook login page. I tried to give only xpath or id or name or combinations of both. Sometime its work and sometimes is fail. Please share your inputs for my query. This are the console for login button: 02-05-2018 06:31:11 PM - [INFO] - Finding web element with id: 'Object Repository/FB112/Page_Facebook log in or sign up/input_u_0_a' located by 'By.xpath: //*[@id = 'u_0_2']' in '30' second(s) 02-05-2018 06:31:43 PM - [FAILED] - Unable to click on object 'Object Repository/FB112/Page_Facebook log in or sign up/input_u_0_a' (Root cause: com.kms.katalon.core.webui.exception.WebElementNotFoundException: Web element with id: 'Object Repository/FB112/Page_Facebook log in or sign up/input_u_0_a' located by 'By.xpath: //*[@id = 'u_0_2']' not found) 02-05-2018 06:31:43 PM - [END] - End action : click 02-05-2018 06:31:43 PM - [END] - End Test Case : Test Cases/FB_Login_Update 02-05-2018 06:31:43 PM - [FAILED] - Test Cases/FB_Login_Update FAILED because (of) Unable to click on object 'Object Repository/FB112/Page_Facebook log in or sign up/input_u_0_a' (Root cause: com.kms.katalon.core.webui.exception.WebElementNotFoundException: Web element with id: 'Object Repository/FB112/Page_Facebook log in or sign up/input_u_0_a' located by 'By.xpath: //*[@id = 'u_0_2']' not found) Regards, Vikash Keshri

[@punitb9853]

Not able to execute the Test suite collection, therefore, no Test suite collection report generated.

[@RaghavPal]

Check the other comment.

[@ronybarua7742]

How can i generate only WebUI.Comment report

[@RaghavPal]

not sure, will need to check Rony

[@pavimfy8218]

hi Raghav I am using 6.3.3 version and build 11. I have installed the report plugin also. 1. I dont see the Reports folder itself on my tests explorer left panel. How do i make the Reports folder visibile in TestsExplorer ? 2. I tried to execute a testcase and then right clicked to see Open containing folder and in Reports folder in backend I see report is not generated. Is it like For testcases Reports dont get generated. (PS. For testSuite I can see the reports in reports folder with updated timestamps) How do i make the Reports folder visibile in TestsExplorer ? Thanks

[@RaghavPal]

Hi Pavi, reports feature has now moved to plugin Basic Reports. Watch this - kzbin.info/www/bejne/opbNe4R8r7aUgKc

[@siyandlovu7863]

You can use the link below to to download a report plugin: store.katalon.com/product/59/Basic-Report

[@renoramos5559]

Hi Reghav, hope you can help me out... idk why i cant take a screenshot on failure, it says WARNING] - Cannot take screenshot, pls help me!

[@RaghavPal]

Hi Reno, what does the error log say. Any issue with the lib.

[@renoramos5559]

When i open the report on .html it says "[WARNING] - Cannot take screenshot" on the log, and the option "Take screenshot when execution failed" on the project settings is activated

[@RaghavPal]

ok, difficult to say anything without logs/info. Can you try sending a email to [e-mail]

[@renoramos5559]

I finally found out by myself what was the problem, since the log didnt have anything to tell me why it failed, i had to find manually why it wasnt taking the screenshot, it wasnt taking a picture because the page wasnt loaded, so, the software wasnt able to take a screenshot of the page, i just wrote WebUI.waitForPageToLoad(seconds) and that solved the problem. Thank you a lot Reghav for ansering my comments, hope this helps other people!

[@RaghavPal]

Great to know this. Definitely it will help others. Keep learning.

[@Deniz-ss1sv]

:)

[@RaghavPal]

Thanks for watching Deniz