In previous blog posts we have looked at the different test case management tools available for developers and Quality Assurance teams.
Depending on the size of your team and the types of projects you are building, it is essential to store your test cases in a reliable application so they can be
easily accessed and updated by yourself and your team.
The test case management tools currently available are diverse and it may be difficult to decide which one is best for you. We have compiled a list of our favorite test case management tools below.
PLUS QA Test Platform
Over the years we have tested and utilized some of the various test case management tools listed in this post. These past few years we have spent time building our own customized test case management system. Combined with our bug tracking tool, our test case management solution helps us streamline the QA process and provide simple and quick access to executed test cases for our clients.
TestRail is consistently rated top in their class. This system manages test cases, test plans and test runs. TestRail also has the ability to integrate bug tracking tools and automation programs. Although TestRail does not have its own bug tracking tool, it can integrate with over 35 different bug tracking systems including Jira, Redmine, Bugzilla, Github and more!
TestRail can be the most impressive in its reporting and analytics functionality. Teams can schedule times to pull reports which can help them track with consistency. It adds to the system’s ability to show test history for auditing purposes. In addition, teams can show individual contributions to the project and also forecast project deadlines based on the history of previous projects.
Overall, TestRail is commended for its ease of use and reporting & documentation features.
Visit Gurock.com/testrail for more information.
TestLodge is a very basic system great for companies that are new to test case management tools. Primarily, their focus is within the test plan aspect of the system. Allowing users more customization in building or importing test suites and test cases. In fact, Google Sheet users will rejoice in the ease to convert their test plans and cases into TestLodge. TestLodge actually has more overall customization features allowing the user to customize by fields & filters, workflow, and permissions.
Another great feature with TestLodge is that it allows unlimited number of users for the account, making collaboration much easier. Like most test case management systems there is a bug tracker integration feature as well.
TestLodge is appealing for teams that do not currently utilize a test case management tool. The basic features and the extremely
approachable price point make this a great fit for projects that could benefit from more structure, storage, and integration.
Test Management for Jira (TM4J)
If your team is looking for a system that is able to integrate with Jira, Test Management for Jira (TM4J) is a great option. TM4J is a no-nonsense system that provides the essential needs for test case management.
TM4J has the ability to create libraries for test cases so it is easy to reuse test cases over and over again. Because of its tight
integration with Jira there is no need for your team to toggle between Jira and testing software. Scheduled reporting allows for users to consistently share testing data and metrics.
TM4J’s selling point is the ability to save time and energy by being an integration of the testing tool teams use most.
For the team who enjoys working with Jira but wants a little more than what TM4J offers, Zephyr is a great match. There are two options available: Zephyr Jira application and the stand alone Zephyr application. Of these options the stand-alone application has double the amount of features for your team; however, the price point for the native application is a great value if your team relies completely on working with Jira for their projects.
Zephyr’s main focus is on the easy integration with Jira. Because of that, the look and feel of Zephyr is similar to Jira. In addition to Jira integration, Zephyr can also integrate with other various automation platforms and continuous integration tools. Zephyr will then track metrics and data on a real-time dashboard.
This system has been previously criticized for completing releases without proper bug fixes, nevertheless, it has also been noted that Zephyr addresses issues and feedback their users provide in a timely manner. Many fortune 500 companies have been noted for using Zephyr and seemingly have success with this system.
This system doesn’t focus on a particular feature or integration but puts an emphasis on the project as a whole. It focuses on the idea of the “story” behind each project to keep up with Agile development cycles. This tool in particular is a great visualization tool.
allows teams to set up notifications, call out specific team members, complete Boolean searches, create checklists, and integrate with a variety of tools. Integration possibilities go beyond bug tracking tools, and also include time tracking and roadmapping tools to assist with the overall goal of the project.
Pivotal tracker is best utilized by teams that work on multiple projects. Their prices will vary based on the amount of projects the team works on and the number of collaborators who are given permission per project (broken down into members, owners, and viewers).
Free3 Collaborators2 ProjectsUnlimited StoragePaidBilled Annually5 Collaborators – $12.50 / mo10 Collaborators – $29.17 / moPaidBilled Annually15 Collaborators – $62.50 / mo25 Collaborators – $125 / mo50 Collaborators – $250 / mo
This system is another add-on feature to Jira. Since Xray is a little newer to the community, it has clearly had some extra time to look at what Zephyr does and learn from their successes (and their failures).
Overall the major benefit of working with Xray is the system’s ability to work with Behavior Driven Development and other test automation frameworks. This gives users the ability to run thousands of tests in a matter of hours versus days. But that’s exactly who Xray intends on attracting– large companies that run thousands of tests at a time. Specifically this can be illustrated in their pricing, which obviously favors larger organizations that will be utilizing the system with multiple users.
HipTest has recently been renamed CucumberStudio after being acquired by SmartBear. Their primary focus is with Behavior Driven Development. In this system, users can easily edit their steps in a scenario. In test case management, it’s often appealing to have the ability to reuse previous cases. CucumberStudio allows users to reuse steps with action words and update business terminology with ease. Because tests can be generated in natural language it is also easier to collaborate with your team.
Minimalist displays provide users with the ability to view data/information at a glance. Information is tracked and stored from product conception to continuous release. Since Cucumber can be integrated with Jira, it is yet another option for those who enjoy collaboration within that system. Pricing for this system is also on the low end with a $5/month flat fee for up to 10 users, and $2/month for 10-100 users.
In software development it is essential to have a test case management tool that aligns with your team’s goals.The choice of a test case management tool depends on multiple factors including the size of your team, pricing, and integrations with other softwares. When selecting a solution you should keep in mind that the software you choose will need to be accessed by multiple users within your organization. Therefore, you should take an overall look at the needs of your team.
These tools should work for everyone involved. Good tools are measured in their ability to meet your team’s goals to collect, organize, and catalog information that can later be utilized in the present and for future projects.
Test case management tools can be utilized to give long term support to your product and team. Overall, teams should look for a tool that is streamlined and contributes to the specificity of their project.