Try our new research platform with insights from 80,000+ expert users

IBM Engineering Test Management vs SmartBear TestComplete comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

ROI

Sentiment score
8.2
IBM Engineering Test Management improves efficiency, reduces defects, integrates well with IBM software, enhancing workflow and providing cost savings.
Sentiment score
6.8
SmartBear TestComplete automation saves time, enhances client satisfaction, and boosts efficiency, with annual savings of approximately $10,000.
Once set up, only one person is needed to handle all tasks, reducing the requirement for multiple personnel.
 

Customer Service

Sentiment score
7.1
IBM Engineering Test Management's customer support is praised for responsiveness and effectiveness, with improvements in response times and satisfactory experiences.
Sentiment score
6.9
SmartBear TestComplete's customer support is knowledgeable but inconsistent, with delays and unresolved issues needing faster escalation and responses.
 

Scalability Issues

Sentiment score
7.7
IBM Engineering Test Management scales smoothly for large organizations with thousands of users and test cases, including automated ones.
Sentiment score
7.4
SmartBear TestComplete is scalable and adaptable, with flexible scripting, but may require licensing for wider deployment.
 

Stability Issues

Sentiment score
6.9
IBM Engineering Test Management is reliable and stable, with good performance but occasionally impacted by server configuration and database space issues.
Sentiment score
6.9
SmartBear TestComplete generally stable, but users report crashes, memory leaks, and HTML5 testing delays in certain scenarios.
 

Room For Improvement

IBM Engineering Test Management requires a user-friendly interface, enhanced usability, data handling, hierarchical structuring, and seamless integration with automated pipelines.
SmartBear TestComplete faces challenges in object recognition, integrations, licensing, performance, and support across browsers and mobile devices.
While using SmartBear TestComplete, we are fine with the current capabilities, however, it would be beneficial to improve some performance aspects, especially the image comparison feature.
 

Setup Cost

<p>IBM Engineering Test Management provides robust features and customization with flexible pricing, ideal for large enterprises needing comprehensive test management.</p>
SmartBear TestComplete's pricing and licensing receive mixed reviews, seen as both reasonable and costly depending on usage and modules.
 

Valuable Features

IBM Engineering Test Management is praised for fast, reliable customizable workflows, and robust integrations, particularly in testing and tracking functionality.
SmartBear TestComplete excels in cross-platform automation, integration, and support for multiple languages, enhancing automated testing efficiency and maintenance.
The most valuable feature of SmartBear TestComplete for me is the image comparison functionality.
 

Categories and Ranking

IBM Engineering Test Manage...
Average Rating
7.6
Reviews Sentiment
7.4
Number of Reviews
11
Ranking in other categories
Test Management Tools (15th), Load Testing Tools (18th)
SmartBear TestComplete
Average Rating
7.6
Reviews Sentiment
6.8
Number of Reviews
76
Ranking in other categories
Functional Testing Tools (7th), Regression Testing Tools (4th), Test Automation Tools (5th)
 

Mindshare comparison

While both are Quality Assurance solutions, they serve different purposes. IBM Engineering Test Management is designed for Test Management Tools and holds a mindshare of 2.6%, down 2.9% compared to last year.
SmartBear TestComplete, on the other hand, focuses on Test Automation Tools, holds 5.9% mindshare, down 6.9% since last year.
Test Management Tools
Test Automation Tools
 

Featured Reviews

HZ
Scalable and Stable solution with good integration function and support team
IBM Rational has the RFT, which is rational functional testing. We do test automation with rational functional testing. So after we do that, we can put in all the code, then I can build it, then put all the test cases, and put all the build code for the shared location. And then rational that shared location means that RQM has access to the shared location. So, when we execute, if a test case is automated, we can run it from RQM. We need to have the environment ready for it to execute. Once we have that, then we can select the task case. So, by clicking on one button, the other environment is automatically plugged in. Then test results will be automatically transferred back to our RQM. So, in RQM, we can view it, and it is integrated. So we can run the test and the automation from RQM, and the test results will come back. Azure DevOps first test case is there, but then we tried to use Selenium to do half automation. Still, we realized that it wouldn't have the integration. We could do something in the pipeline, but it fires the Selenium test automation code. But then the test results won't be brought back or added to AzureDesk DevOps. That's something that I do hope that there can be another other system that can have this kind of integration. RQM can be improved because it's not related to our server and could be faster. We need to find out how much database storage is needed and keep increasing it. We heard that the latest version of RQM can clean up some old ones and give the same test result. But that one feature we are yet to use. It's a setting that we can set up, and then it goes automatically or gives me the choice to do it manually.
Prakhar Goel - PeerSpot reviewer
Used for integration automation, user-based automation, and web automation
The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.
report
Use our free recommendation engine to learn which Test Management Tools solutions are best for your needs.
859,579 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Healthcare Company
19%
Financial Services Firm
15%
Manufacturing Company
15%
Real Estate/Law Firm
9%
Computer Software Company
18%
Manufacturing Company
15%
Financial Services Firm
13%
Government
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

Ask a question
Earn 20 points
What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
I am not involved in pricing or licensing; our management team handles these aspects.
What needs improvement with SmartBear TestComplete?
While using SmartBear TestComplete, we are fine with the current capabilities, however, it would be beneficial to improve some performance aspects, especially the image comparison feature. Occasion...
 

Also Known As

IBM Rational Quality Manager, Rational Quality Manager
No data available
 

Overview

 

Sample Customers

Ehrhardt, Cisco Systems, Anadolu Hayat Emeklilik, CareCore National, ItaÒ BBA, Barr
Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Find out what your peers are saying about IBM Engineering Test Management vs. SmartBear TestComplete and other solutions. Updated: July 2020.
859,579 professionals have used our research since 2012.