Xray Comparison

Top 3 reasons to choose Xray over Zephyr

Join the #1 Manual & Automated Test Management App for QA in Jira

Automated tests with native support for BDD methodology and more

With native support for Behavior Driven Development (Gherkin/Cucumber) and integration with multiple test automation frameworks, including JUnit, NUnit, Robot, Behave, Calabash, Selenium and UFT Pro (LeanFT) there’s no excuse not to automate your tests and manage them in Jira.

The only tool that allows you to manage all your Tests as Jira issues

Xray’s tests are normal Jira issues which allow for full Jira power. Thus, you are able to configure screens, workflows and add custom fields to your testing related issues. Tests may validate requirements, defects, any issue type in fact. And you can track their progress in your existing Agile boards!

Ensures consistency by storing test definitions for past executions

In some regulated industries data consistency is crucial and mandatory, to ensure that your recorded data is not tampered. Xray ensures that your historical test data is not changed, so you know the exact conditions and specifications for which you reported your results.

Xray vs. Zephyr Features

Specify

Create, view, edit, clone tests

Link to Defects and Requirements

Visual editor for steps

Imbued Generic Automated Tests

Native support for BDD (Gherkin/Cucumber)

Preconditions for test cases

Re-use preconditions between test cases

Multiple preconditions for test cases

 
 

Organize

Organize testing artifacts in the same or different projects

Organize tests in Test Sets

Hierarchical test organization in folders and subfolders

 
 

Plan

Test plans

Hierarchical tests for execution organization in folders and subfolders

 
 

Execute

Create, edit, clone and schedule test executions

Ad hoc style (execute unplanned tests)

Personalize and create Test run statuses

 
 

Measure

Track with progress bars on Test Execution/Cycles

Track requirement coverage/status directly on issues, as an attribute

Number of built-in reports

6

6

Number of built-in gadgets

6

8

 
 

Explore and evolve

Advanced query language

Built-in REST API

 
 

Characteristics

Consistency (Test changing non-retroactivity on past executions)

Usage of JIRA Issue Types

Test
Pre-Condition
Test set
Test Execution
Test Plan

Test

Split test executions and plans between different projects

Email notifications

 
 

Test Environments

Analyze test results and requirement coverage per Test Environment

 
 

Configuration

Extensive configuration, including behavior

Per project configuration

Support for project separation between requirements and tests

 
 

Agile integration

See Test Executions and Test Plans in JIRA's native Agile board

CI Integrations (Jenkins, Bamboo)

Importing results

Cucumber
JUnit
NUnit
Robot framework
Behave
Selenium
Xamarin Test Cloud

Importing tests

Cucumber
Manual via Excel/CSV
JUnit
NUnit
Robot framework

Excel/CSV

Importing results from other tools

HP ALM/QC 12.5x

Exporting Tests to fully customized DOC/PDF/Excel with Xporter

Integration with other JIRA-related tools (e.g. Confluence)

UI supported languages

English
German
French
Spanish

8

Xray vs. Zephyr Pricing

Users

10
$10 $10
25
$500 $750
50
$1 000 $1 500
100
$2 000 $3 000
250
$4 000 $6 000
500
$6 500 $8 000
2 000
$10 000 $12 000
10 000
$13 000 $15 000
over 10 000
$16 000 $20 000

Try Xray for free

There is no better way to know our products than to test them yourself!

Stuck on Zephyr? Email us at sales@xpand-addons.com regarding migration.