How to create Xray dashboard widget showing test execution results matrix for multiple test cases

Other Questions Jira
1

I need help setting up a dashboard widget in Jira Xray that shows test execution statistics in a specific format. I’m working with a test plan that has over 300 test cases, but I only need to track 22 specific ones (let’s call them TEST-100 through TEST-121). These tests get executed multiple times daily by different team members.

I want to create a single widget that displays:

  • Test cases listed vertically (TEST-100, TEST-101, etc.)
  • Execution statuses shown horizontally (Pass, Fail, etc.)
  • Both count and percentage for each status

For example:

Test Case    | Pass     | Fail     | Total
TEST-100     | 3(60%)   | 2(40%)   | 5(100%)
TEST-101     | 1(25%)   | 3(75%)   | 4(100%)

I’ve managed to create filters using JQL like key in testExecutions("TEST-100","Pass") but I can only display one test case at a time. Is there a way to combine all 22 test cases into one comprehensive view instead of creating separate widgets for each?

2

I faced a similar issue when trying to track execution metrics for key test cases. Unfortunately, Xray’s widgets don’t support a multi-case matrix view. To solve this, I created a script that runs periodically to fetch execution data using the REST API and formats it into a table on a Confluence page. By setting up a webhook to trigger the script upon test execution completion, I managed to gather results for all 22 test cases and calculate the necessary percentages. While it might not be as seamless as Xray, embedding the Confluence page into your Jira dashboard provides a consolidated view without needing complex gadget development. The API documentation is helpful once you determine the right execution history endpoints.

3

totally agree! xray can be a bit of a pain for complex views. eazyBI is definitely a solid option. if you’re in a hurry, exporting to excel can give you the flexibility you need, even tho it might be a hassle.

4

Unfortunately, Xray’s dashboard widgets can’t handle matrix views across multiple test cases. Your JQL approach is right, but it’s stuck with single-case queries. I hit the same wall with a big test suite and ended up building a custom Gadget with Atlassian’s SDK - worked like a charm. You can make it query multiple test executions at once and format everything into your matrix layout. Another option is using Xray’s REST API to grab execution data and build a custom HTML table for your dashboard. Takes some dev work but you get total control over how it looks. The trick is hitting the testexecution endpoint with the right filters to pull results from all 22 test cases efficiently.