Try our new research platform with insights from 80,000+ expert users

IBM Engineering Test Management vs SpecFlow comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Sep 16, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

IBM Engineering Test Manage...
Ranking in Test Management Tools
9th
Average Rating
7.6
Reviews Sentiment
7.4
Number of Reviews
11
Ranking in other categories
Load Testing Tools (10th)
SpecFlow
Ranking in Test Management Tools
12th
Average Rating
7.2
Reviews Sentiment
7.1
Number of Reviews
4
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of May 2025, in the Test Management Tools category, the mindshare of IBM Engineering Test Management is 2.7%, down from 3.0% compared to the previous year. The mindshare of SpecFlow is 1.7%, up from 1.6% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Management Tools
 

Featured Reviews

HZ
Scalable and Stable solution with good integration function and support team
IBM Rational has the RFT, which is rational functional testing. We do test automation with rational functional testing. So after we do that, we can put in all the code, then I can build it, then put all the test cases, and put all the build code for the shared location. And then rational that shared location means that RQM has access to the shared location. So, when we execute, if a test case is automated, we can run it from RQM. We need to have the environment ready for it to execute. Once we have that, then we can select the task case. So, by clicking on one button, the other environment is automatically plugged in. Then test results will be automatically transferred back to our RQM. So, in RQM, we can view it, and it is integrated. So we can run the test and the automation from RQM, and the test results will come back. Azure DevOps first test case is there, but then we tried to use Selenium to do half automation. Still, we realized that it wouldn't have the integration. We could do something in the pipeline, but it fires the Selenium test automation code. But then the test results won't be brought back or added to AzureDesk DevOps. That's something that I do hope that there can be another other system that can have this kind of integration. RQM can be improved because it's not related to our server and could be faster. We need to find out how much database storage is needed and keep increasing it. We heard that the latest version of RQM can clean up some old ones and give the same test result. But that one feature we are yet to use. It's a setting that we can set up, and then it goes automatically or gives me the choice to do it manually.
KreshenAmourdon - PeerSpot reviewer
An automation solution with good integration capabilities that needs to focus on providing an option for chain testing to its users
In our company, we need to maintain the scripts of the product daily, and in case of failures, we need to check out the scripts. I would recommend the product to those planning to use it based on both they are planning to build. If you are going for unit testing or small scripts, then you can go with SpecFlow. I don't have much experience with the solution. It is a good and straightforward product. It is also an easy-to-use and user-friendly product that can easily adapt to any framework. I rate the overall solution a seven out of ten.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"RQM is something that we use everyday, so it has to be up and running, otherwise we would lose everything."
"It's very reliable as a solution."
"Integration with the other professional tools is a very strong advantage, so that we can have a traceability between the requirements and defects in Rational Team Concert. That's the most important aspect."
"It allows user to add whichever widget (predefined) based on the need. It has integration with CCM and RM to achieve traceability."
"Latest features include versioning of testings which can be great when used for multiple releases of a product."
"The one feature that has not allowed us to switch to any other solution is the integration with functional testing."
"RQM's best features are integration with test automation and performance testing."
"The most valuable feature is the RFT because it allows us to automate manual test cases."
"The initial setup is easy."
"One of the most valuable features of SpecFlow for us is its risk identification capabilities."
"SpecFlow's best feature is the ability to add additional layers to the programming."
"The most valuable feature of the solution is unit testing...It is also an easy-to-use and user-friendly product that can easily adapt to any framework."
 

Cons

"RQM could be improved by adding a feature that allows test requirements to be selected when creating a task plan."
"Currently, the user interface needs to be more user-friendly."
"Integration capabilities with other vendors' tools should improve."
"It would be helpful if we could assign a hierarchy to a group of test cases."
"Adding support for uploading a collection of test cases would be a helpful addition."
"Organizing the test cases is tedious. There is no mechanism to keep and maintain the test cases as hierarchy. This should be seriously addressed."
"Mainly Quality Assurance and DevOps, but of course the whole company and management areas with more knowledge of quality and client success approach."
"I think it's fine from a performance perspective but usability is something that needs improvement."
"SpecFlow's installation and configuration can be a bit challenging due to its flexibility as an open-source tool."
"Regarding improvement, it would be good if SpecFlow could provide chain testing, which it currently doesn't allow."
"SpecFlow would be improved with the addition of functionality reporting, which would be really helpful for automation testing."
"I'd prefer in TFS if we could be writing test cases, not in the old classical version. We should be writing in Gherkin and then automatically have it convert that Gherkin test case into SpecFlow feature files."
 

Pricing and Cost Advice

"Each license includes 12 months of customer support. A free 90-day trial of the software is also available."
"The licenses of these tools (the whole CLM package) is very costly as compared to other vendors' tools."
"SpecFlow is open-source and free of charge."
"SpecFlow is an open-source product."
report
Use our free recommendation engine to learn which Test Management Tools solutions are best for your needs.
853,682 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Healthcare Company
19%
Financial Services Firm
16%
Manufacturing Company
13%
Computer Software Company
12%
Computer Software Company
16%
Healthcare Company
14%
Financial Services Firm
12%
Manufacturing Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
 

Questions from the Community

What do you like most about IBM Rational Quality Manager?
The one feature that has not allowed us to switch to any other solution is the integration with functional testing.
What needs improvement with IBM Rational Quality Manager?
IBM Rational has the RFT, which is rational functional testing. We do test automation with rational functional testing. So after we do that, we can put in all the code, then I can build it, then pu...
What is your primary use case for IBM Rational Quality Manager?
We create test cases, and then we need to plan a new task plan feature from the existing task case file and execute the test results, which will be saved in RQM. So that is how we are using the too...
What do you like most about SpecFlow?
One of the most valuable features of SpecFlow for us is its risk identification capabilities.
What is your experience regarding pricing and costs for SpecFlow?
SpecFlow is an open-source product. You just use SpecFlow's plugin capabilities or add it to your existing framework.
What needs improvement with SpecFlow?
In terms of improvement, SpecFlow's installation and configuration can be a bit challenging due to its flexibility as an open-source tool. While it offers a balanced flexibility, setting it up migh...
 

Also Known As

IBM Rational Quality Manager, Rational Quality Manager
SpecFlow+
 

Overview

 

Sample Customers

Ehrhardt, Cisco Systems, Anadolu Hayat Emeklilik, CareCore National, ItaÒ BBA, Barr
Microsoft, Caterpillar, Siemens, Charles Schwab, IBM, Deloitte, Accenture, Philips, Dell, Deutsche Bank
Find out what your peers are saying about IBM Engineering Test Management vs. SpecFlow and other solutions. Updated: April 2025.
853,682 professionals have used our research since 2012.