Xray for Jira is a complete, full-featured Atlassian verified test management add-on for Jira. Xray supports both manual and automated tests and a complete testing life cycle: test planning, test designing, and test execution to help developers improve the quality of their systems.
Xray for Jira is an add-on developed by Xpand Add-ons, an Atlassian Expert Company.
Table of Contents
Xray Data Import
Xray import options are available starting from eazyBI version 4.2.0. Xray import is supported just for Jira Server (and not for Jira Cloud).
If you have installed Xray add-on for Jira Server then in Jira import options you will see Import Xray option.
You can import Xray 2.0 custom field "Test Environments" using Advanced settings for custom fields. You can use following custom field definition example (replacing NNNNN with a corresponding field ID):
After the import the following additional dimension will be added:
All test requirement issues will be shown in this dimension and organized in Project and Requirement levels. Will be imported all issues with types selected in "Requirement Issue Types" and with link type "Tests".
|Xray Test Plan|
All test plan issues will be shown in this dimension and organized in Project and Plan levels. (Will be shown starting from Xray version 2.0)
Xray Test Set
All test set issues will be shown in this dimension and organized in Project and Set levels.
|Xray Test Pre-condition|
All test pre-condition issues will be shown in this dimension and organized in Project and Pre-condition levels.
|Xray Test Execution|
All test execution issues will be shown in this dimension and organized in Project and Execution levels.
All defect issues added during testing will be shown in this dimension and organized in Project and Defect levels.
|Xray Test Executed by||Users who executed tests.|
|Xray Test Execution Status||Test execution status – by default there are TODO, PASS, EXECUTING, FAIL and ABORTED statuses, but also there can be other user-defined statuses (starting from Xray 2.0).|
|Xray Pre-condition Type||Pre-condition types - Manual, Cucumber|
|Xray Test Type||Test types - Manual, Cucumber|
The following measures will be imported. These measures can be analyzed by the mentioned Xray specific dimensions as well as by Issue dimension (where individual tests executions are registered as issues with Test Execution type) and by other standard dimension members which correspond to the issue with Test Execution type.
|Xray Tests created|
How many tests are created.
|Xray Tests scheduled||How many tests are scheduled within selected dimensions but not yet executed.|
|Xray Tests executing||How many tests are executing within selected dimensions.|
|Xray Tests executed||How many tests are executed within selected dimensions.|
|Xray Tests defect count||How many defects are registered for a test execution (including individual test steps). Unique count of different defects is returned.|
Also following calculated members will be created.
|Xray Test last executed date|
Last execution date for a test issue
|Xray Test last executed by||An last executor for a test issue|
|Xray Test last execution status||Last execution status for a test issue|
|Xray Tests executed first date||Date and time for first executed test within selection|
|Xray Tests executed last date||Date and time for last executed test within selection|
|Xray Tests execution summary||Test statuses within selection|
Xray Report Examples
Overall Xray Test Run Results
You can create a simple test execution report to quickly see the overall snapshot of your test execution results. You can specify additional filters, for example Xray Test Plan, Test Environment, Test Set, Time period, or other Xray dimensions.
Copy and import report definition into your eazyBI account:
Created and Executed by Test and Test Set
Analyze created and executed Xray tests by project and test set. This will give you a full overview of test execution status across all your project portfolio.
Cumulative Xray Test Burn-Down Chart
Analyze the progress of a Test Plan to see how it evolves over time. How many tests are created, how many of them have been completed, and whether the tests are To-do, Executing, Pass, Fail, or Aborted. Spot issues more easily, make better project forecasting, and see whether or not the testing goes according to schedule.
Test Status History Report
Detailed information about each test: which tests have been scheduled, executed, or completed most often; how many times and how long each test has been run; what statuses have been returned; which tests have been failing most often.
Top Defects Report
List all distinct tests who executed with defects. Find out what defects are captured in each version and how many tests does that affect?