Advanced Jira Xray Manual Testing: Coverage and Traceability Reports, Creating Sprints, Versions

Stay tuned for the next Jira Xray-related video covering automated testing!
== Contents of the Video ==
0:00 Overview of Project Planning
5:22 Creating a Jira Project
6:40 Creating a Version in Jira Xray
7:10 Creating Stories for Version 1
8:10 Creating Tests for Version 1
10:25 Creating a Test Set for v1.0, sprint 1
11:33 Test Repository Overview
12:20 Test Coverage Report
13:03 Traceability Report showing uncovered stories
14:20 Test Coverage and Traceability Report NOTRUN
15:00 Creating Test Execution for Sprint 1, v1.0
16:00 Starting Sprint 1
17:00 Traceability Report with Test Runs
17:40 Adding a Bug/Defect and View on Traceability
19:48 Creating Sprint 2, Version 2
20:10 Creating Regression Test Set
21:00 Creating Stories, Version 2
21:45 Test Coverage Report for Version 2
22:35 Make Tests Through Excel!
23:00 Creating Test Set Version 2
24:00 Adding Tests to Regression Test Set
25:00 Creating Test Execution for Sprint 2
26:00 Starting Sprint 2
26:54 Conclusion

[@mouadkerdoud9428]

Great video! I hope you continue these series!

[@theglitchvlogs8345]

Great stuff. Thank you

[@user-gj1cr8jm9z]

Thanku so so much mam. i will be forever indebted to you for making it in easy and understandable , and concise format . have the interview in ne hour and you just sort my biggest problem. Hope i get the job.

[@usamachshoukatali7096]

Excellent video! Super

[@tejpata5789]

it was informative please upload more

[@maximusminimus8050]

Very helpful, thank you.

[@marioelena]

Just came across this video. Great stuff. One thing that I can suggest is to label your Tests. Example: You can label one test as Sanity and have it live in a Sanity Test Set. If ever you want to generate a new sanity test set for a particular version you can use the labels to filter based off those labels. One thing I'm trying to wrap my head around is, how do Test Plans come into play. Colleauge told me use Test Sets over Test Plans. So I maintain a sanity test plan and a current release vesrion test plan. When we release I wasn't sure if I could use 1 execution for both plans. It worked, but only tests from the first plan were imported, which got me thinking is this the right approach... (also xray website is down so couldn't look for the answer). Based off your expereince do you know what works best?

[@mariasozinyu381]

I realised that when creating TE002, both TS002 and regression test set was added. Although the regression test set had both TS001 and TS002. Any reason?

[@himelkhan929]

Thank you so much to make this video. It is very helpful for those people who are in learning stage. Can I take hands-on training from you?

[@AyeshaAhmed0]

Hey Himel, I'm glad the videos are helpful to you. Currently, I'm not offering any hands-on training but if you have anything that you would like to learn, let me know and I'll post more videos related to that :)

[@maheshn6933]

Hi Ayesha, Perfect video for someone who wants to learn JIRA-Xray plugin... Just a quick one, you have created "Execution Test set" for Sprint 2 in which you have added "Regression Test set" as well as "Test set for Subtraction", please correct me if I'm wrong. Can we not add "Test set for Subtraction" to "Regression set" directly. Please advise. regards,

[@AyeshaAhmed0]

Hey Mahesh, you're absolutely right! You can add the test set for subtraction to the regression set as well since its important to test both old and new features (stories) in each sprint. You usually do three things: work on the current sprint, make sure nothing is broken in the previous sprint, and create backlog for the next sprint. Hope that helps!

[@maheshn6933]

@@AyeshaAhmed0 Very prompt response, many thanks Do you conduct any training program or Boot camp sessions? Please advise

[@AyeshaAhmed0]

@@maheshn6933 Hey Mahesh, currently I'm not offering any courses or training, however if there's any topic you would like to know please let me know and I'll post more videos that may be useful to you :)

[@davidelmaleh]

Great video ! I can’t find the test coverage report in my project What am I missing??

[@AyeshaAhmed0]

Thank you! If you haven't already downloaded xray, you can do so using this link: marketplace.atlassian.com/apps/1211769/xray-test-management-for-jira. You'll need the app to generate test coverage reports. Another reason I can think of is that you might not saved your xray settings. In the video, I showed which settings to enable. Hope that helps!

[@sanasayeed6095]

Hi @Ayesha, I am struggling while reusing the test cases for the different scope items(for integration testing, regression testing and so on..) in different sprint. Can you please help me in that case how I can reuse the test cases . Also, if you can showcase the folder structuring of the scenarios, versions, features, function, test set according to diff release. Thanks,

[@AyeshaAhmed0]

Hey Sana, you can definitely reuse test cases that you created in previous sprints. What you can do is create a test set or test execution (which ever you prefer), and select the 'add tests' options. Then, you should be able to see any old test cases that you made by either typing in the name or the key of the specific test case.

[@user-dc1fm1lz5c]

Hi there! Great video! One issue our team is experiencing is our traceability report only returns our requirements that are set to uncovered. We are unable able to understand why because we expect to see all our requirements. We have asked for support for help and they are unable to help. Is this something you have experienced and can comment on?

[@adamS993]

Hi, slightly unrelated question but when it comes to creating automation rules in Jira is there a way to create one that automatically links a test execution to the test case it was created for?

[@AyeshaAhmed0]

Hey there, this link maybe helpful to you in regards to your question: community.atlassian.com/t5/Marketplace-Apps-Integrations/XRAY-How-to-link-test-and-test-execution-in-Jira-automation/qaq-p/1589048

[@maroofahmedmalik7705]

Hi. Im trying to connect with people who are doing automated test using xray. I am having some trouble there. let me know if you can help. Thank you

[@Musscat2012]

Hi Ayesha. Saying manual testing, do you mean that while you wrote all steps in Jira Xray, the real test you made manually just went to the calculator and added manually these numbers to check the result. right? Are there any other popular tools for manual testing description? Thanks a lot

[@NeerajKumar-th4ee]

Audio is missing in this video. Am I only facing this issue?

[@AyeshaAhmed0]

Hey there! I'm not sure if you mean the audio is missing for the whole video or just some parts of it, but in some steps of the video I have sped it up since it's quite repetitive and muted the audio there.

[@adamS993]

Is linking Xray test cases to Jira stories a newer feature? I’ve never seen that option before

[@AyeshaAhmed0]

Hello, as far as I'm aware of, it's always been a feature to do so. Hope that answers your question :)

[@adamS993]

@@AyeshaAhmed0 thanks! I’ve been linking test cases to product requirements in R4J, so I must’ve not realized this feature

[@VintageGold]

At about 22:35 you talk about how tedious it can be to write the test cases inside of Jira. I watched the video on importing the cases with a CSV file just before this one. In your experience, what advantages do you see by writing them outside of Jira and importing them?

[@AyeshaAhmed0]

Hey there! That's a great question. One big advantage is the ease of writing and adding the test cases all at once in a single batch versus having to individually make the test cases in Jira. It can get a little repetitive in Jira so personally I find it easier to just import them all from a csv file. Hope that helps!

[@VintageGold]

@@AyeshaAhmed0, that's great, thank you!

[@Not-just-doing-I.T.]

Is that OneNote you are using as a Chalkboard? Would you mind explaining how you get a full screen display like that? My OneNote is just a white sheet, having a line and date/time. I don't even get black as an option for the page colour :(

[@AyeshaAhmed0]

Hey! I am using OneNote for the video. To get the full screen display, you can click on the two arrows pointing outwards symbol on the top right corner and if you hover over it, it will say 'Enter Fullscreen Mode'. To get the black background, you can go to 'View' located on the tool bar at the top of your screen and go to 'Page Color'. There you'll find different color options, and you can click on 'More Colors' to get a dark display of your choosing. Hope that helps :)

[@Not-just-doing-I.T.]

@@AyeshaAhmed0 thank you for the quick reply. I hadn't realised OneNote could be used like this.. works brilliantly in your in your video. I can't see for sure, but it looks like you have been able to delete/remove the default underline of the date/time. I can remove the date/time but the line remains (press Ctrl-A delete doesn't get rid of it). It is a small irritation, but if you have any tips how to get a clean page, I would appreciate it.

[@AyeshaAhmed0]

@@Not-just-doing-I.T. I didn't remove the default underline in my video. I simply scrolled down and zoomed in to hide the title. If you're using an older version of OneNote you might have the option to go to the View tab and click on 'Hide Page Title', otherwise I'm not sure if there is a way to hide it as of yet.

[@vikass5477]

Hi Ayesha,, I need some help, I have to create Test execution report for two project for ex : Project A and Project B which are interlink with each other and issue are linked too. So I have written an filter and it is extracting exact issue I want, but problem is under one project that is Project A and I am not able to get the issue of Project B. In under project A so can you please help me on this?

[@AyeshaAhmed0]

Hey Vikas, based on this latest post: community.atlassian.com/t5/Marketplace-Apps-Integrations/JIRA-XRay-Cross-Project-Requirement-Coverage/qaq-p/1946509, I don't think its possible as of yet to have a cross-project report.

[@vikass5477]

@@AyeshaAhmed0 Thanks for the reply, I would like to take forward this question I want to know some thing on reporting part please do help. I have Overall test result gadgets in my Kanban dashboard, So in that gadget I have overall test result status distribution like Total tests, Pass, Fail, Executing and Aborted. So I want to export it to my excel file but there is no option in gadget as well as in Jira to facilitate to export the data into excel. Can you help me how can i export it to an excel file, I mean only overall test results data. For reference I have a filter is used to apply it inside gadget to show up the results on gadgets. Filter no 1: Project= ABCD AND Issuetype=TestExecution AND Labels= Application OR Project= XYZ AND Issuetype=TestExecution AND Labels= Application ----> This is my filter number one. Filter no 2: Project= ABCD AND Issue in testExecutionTests(Filter no 1) AND Labels= Application OR Project= XYZ AND Issue in testExecutionTests(Filter no 1) AND Labels= Application the Filter no 2 is used inside Gadget to get the overall test results in Dashboard. So I have used Filter no 2 inside = Test Execution report in Xray- report option but it is showing No records found message. So Let me know how to export the overall test result into excel file is there any other options to export data into excel file. Thanks