No more typing reviews! Try our Samantha, our new voice AI agent.

IBM DevOps Test UI vs Perfecto comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Jun 3, 2026

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

IBM DevOps Test UI
Ranking in Functional Testing Tools
25th
Average Rating
7.2
Reviews Sentiment
7.1
Number of Reviews
8
Ranking in other categories
Regression Testing Tools (12th)
Perfecto
Ranking in Functional Testing Tools
20th
Average Rating
8.4
Reviews Sentiment
7.4
Number of Reviews
23
Ranking in other categories
Performance Testing Tools (13th), Mobile App Testing Tools (6th), Test Automation Tools (21st)
 

Mindshare comparison

As of August 2026, in the Functional Testing Tools category, the mindshare of IBM DevOps Test UI is 1.6%, up from 0.8% compared to the previous year. The mindshare of Perfecto is 2.5%, down from 4.3% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Functional Testing Tools Mindshare Distribution
ProductMindshare (%)
Perfecto2.5%
IBM DevOps Test UI1.6%
Other95.9%
Functional Testing Tools
 

Featured Reviews

HZ
Lead Systems Tester at Government of Ontario, Canada
Reliable test automation, and test data creation with efficient support
The solution can be improved by removing the need for object matching in the framework. The latest version has increased load time before testing can be run. The reason is that changes were made to how it works with the browser and the startup takes some time. Adjusting those changes to speed up the load time will improve the solution.
Roland Castelino - PeerSpot reviewer
QA Lead at BMO Financial
Its reporting allows us to have a clear view regarding what tests have been executed
The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature. We leverage Perfecto’s reporting and analytics a lot. From the CI Dashboard, it is mainly the status, which is the past, failure count, and time consumption, e.g., how much time did an average test or script take? Along with that, it provides the historical view compared to the previous result, e.g., am I a pass or fail? Also, the stack trace is very important. Whenever a pass occurs, we don't look beyond that. However, whenever a failure occurs, the stack trace information that it gives us is pretty critical for us when figuring out where failures lie. It gives a summary for the pass/fail count, total test count, the historical view, time consumption for each test as well as the total tests, and the stack rate of the failure. Perfecto's analytics are very important since we use them on a daily basis. We run our executions daily. After every execution, we pull information from the Perfecto reporting system and share that with our stakeholders. Having this information accurately reported is pretty important for us, so everybody is aware of the current status of the product. That way, we can evaluate the health of the product or environment against that which has been executed. Therefore, it helps make those real-time decisions and highlights the impact to the business. I found Perfecto to be pretty easy to use while executing against cross-platforms. The main reason is because the same script or test automation where we execute on multiple platforms has minimal changes that I need to do. Also, it is easy for me to set up an execution on one platform, then on another platform, either in parallel or one after the other. Parallel opportunities save me time. Once the execution has been completed across these different configurations, I can always check and compare, e.g., what are the differences and consistencies? We utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs. I use it occasionally for manual testing. Though, there are other team members who use it more frequently than I do. I use it mainly for executing my automated tests. We have the Perfecto lab, cloud devices, and machines. I can program my test to execute against any of those devices, which gives me more confidence in my product. I can compare and see how my product or application functionally behaves across these different devices and from a UI point of view, which helps me a lot. The device lab is extremely important to our testing operations. We rely on having multiple devices up and running all the time. Whenever we kick off an execution, there are multiple reasons why executions may get triggered: * CodeCommit * A scheduled job. * Might be on-demand by any stakeholder. We need the lab to be available, as we need devices up and running for executions to take place. Also, the devices help since they allow us to have parallel execution, and not just wait for a sequential device to become free and available. Therefore, volume is definitely key. It also gives us an opportunity to compare execution across platforms in that space. It is extremely important to you that the lab provides same-day access to new devices since we analyze that data every single day after execution. Perfecto provides their own framework called Quantum Framework. That is one option. The other option is, if I want to have my own framework, I can have a Java-based Maven project, take a Selenium library, AppiumLibrary, and REST Assured library, and utilize the open-source framework. It is easy for us to connect to Perfecto, no matter what framework we use, as long as it has these core libraries in it. I can design and structure it any way that I want. The execution will happen in Perfecto no matter what since they have support for these tools or libraries. It is pretty neat that way. We are not dependent on using just one particular framework to use Perfecto. While there are still some framework limitations, there is the opportunity to use multiple, different open-source frameworks, then pass the execution to Perfecto. We can use most frameworks, then design and craft it any way that we want, then just pass the execution to Perfecto.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"By automating regression test suites using this product, we were able to show time savings of more than 1200 hours in less than ONE year."
"It helps in automation by using better object recognition as compared to other tools in the market."
"It is compatible with all sorts of Dark Net applications. Its coverage is very good."
"Test automation is most valuable because it saves a lot of time."
"Robust API provides quick turnaround for developers to understand and automate functional test case quickly."
"The technical support is good; at least their response time is good, and whenever we ask them for help regarding deployment customizations, custom code implementation, or other code needs, they heavily support us, assign us IT engineers who work alongside us helping with code-related issues, and stay until the problem is resolved."
"As it is built on Ellipse/Java and costs less than other tools, it is recommended."
"IBM Rational Functional Tester is very contextual."
"Their team is really great to work with. They're very flexible, and they always show care. They prioritize our work, our company, and our working relationship. I appreciate the ad hoc sessions that they schedule to provide help with troubleshooting, provide the information that we're looking for, or do a demo of a new feature that they have. They're always willing and very quick to get that scheduled for us. I appreciate that a lot."
"The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests."
"In terms of Perfecto's ability to perform cross-platform testing, I would rate it a ten out of ten."
"The Perfecto device lab has allowed us to run tests on multiple devices at the same time and across multiple platforms as well, increasing the efficiency of our testing and saving money, time, and effort while enabling comprehensive testing and high app quality that we otherwise wouldn't be able to achieve."
"Using the device lab has definitely helped us to scale our testing operations."
"Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every new release would be a difficult task. But with Perfecto, it is easy."
"The number one feature, which if we didn't have out-of-the-box would be missed, is the fact that we have video execution. That gives us the ability to view errors or defects in the progression, from beginning to the end of the video."
"There are a whole bunch of things that I like about the solution, but I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. The reports are very detailed."
 

Cons

"It does not fully justify being a paid tool, and it needs improvement."
"With version 8.5 we faced workspace crash issues frequently."
"The latest version has increased load time before testing can be run."
"If in the future there is no support for mobile applications, then we will be using it less."
"If the solution is running on Linux, there are some issues around application compatibility."
"If you look at today's current context, I wouldn't recommend RFT because there are far more advanced solutions and products available."
"The object repository used for identifying objects can be made better. It has been noticed that the RFT tool is unable to identify some objects, due to which we are unable to add them to the object repository."
"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."
"The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well."
"Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making."
"We've had a couple of issues lately with videos not loading or browsers dying after some execution, although that happens very rarely."
"In iOS, it needs improvements with some limitations."
"It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution."
"One improvement would be speed of execution. If it is an iOS native app, we have noticed that the speed is a bit slower. Perfecto might need to make some improvements in this area."
"When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good."
"On the analytics side, Perfecto is in need of improvement."
 

Pricing and Cost Advice

"Licensing is good but the prices for the products are expensive. A single-user license may go for something like $10,000 to $30,000. There are no additional costs, and support is included within that price."
"It's definitely on the higher end of prices for this type of service."
"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."
"Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."
"This is an expensive solution compared to others, by 30% to 40%."
"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."
"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."
"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."
"Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."
report
Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.
909,725 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Outsourcing Company
14%
Manufacturing Company
12%
Financial Services Firm
9%
Construction Company
8%
Financial Services Firm
19%
Construction Company
12%
Outsourcing Company
7%
Healthcare Company
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business1
Midsize Enterprise3
Large Enterprise5
By reviewers
Company SizeCount
Small Business1
Midsize Enterprise1
Large Enterprise23
 

Also Known As

IBM Rational Functional Tester
Perfecto Mobile, Perfecto Web
 

Overview

 

Sample Customers

Edumate
Virgin Media, Paychex, Rabobank, R+V, Discover
Find out what your peers are saying about IBM DevOps Test UI vs. Perfecto and other solutions. Updated: August 2026.
909,725 professionals have used our research since 2012.