IBM DevOps Test UI vs Perfecto comparison

IBM and Perforce are both solutions in the Functional Testing Tools category. IBM is ranked #26, while Perforce is ranked #15. IBM holds a 1.5% mindshare in FT, compared to Perforce’s 3.6% mindshare. Additionally, 88% of IBM users are willing to recommend the solution, compared to 88% of Perforce users who would recommend it.

IBM DevOps Test UI

Read 8 IBM DevOps Test UI reviews

819 Views
663 Comparison Views

88% willing to recommend

Perfecto

Read 23 Perfecto reviews

3,436 Views
2,371 Comparison Views

88% willing to recommend

IBM DevOps Test UI

Perfecto

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Dec 18, 2024

IBM DevOps Test UI and Perfecto compete in the DevOps testing environment. IBM DevOps Test UI holds an advantage in enterprise integration, while Perfecto is superior in mobile testing.

Features: IBM DevOps Test UI is renowned for seamless integration with IBM tools, offering robust enterprise test automation and compatibility with various enterprise platforms. Features include comprehensive support for Java and .NET scripting and integration with third-party libraries. Perfecto excels in mobile testing with support for Appium, Selenium, and a cloud-based device lab offering extensive OS and browser coverage, parallel testing, and detailed reporting analytics.

Room for Improvement: IBM DevOps Test UI could improve its support for non-IBM environments and enhance mobile testing capabilities. More agile testing options could cater to startups or smaller teams. Perfecto could enhance compatibility with more framework integrations and improve the user interface for non-technical users. Additional enhancements in real-time reporting tools and cost optimization could also be beneficial.

Ease of Deployment and Customer Service: IBM DevOps Test UI offers a straightforward setup within the IBM ecosystem and dedicated enterprise support, ideal for those invested in IBM products. Perfecto provides flexible deployment options for various environments with outstanding customer service, focused on mobile testing solutions and troubleshooting.

Pricing and ROI: IBM DevOps Test UI demands a higher initial setup cost, especially for integrating additional IBM services, but secures ROI through vast capabilities for large enterprises. Perfecto presents more competitive pricing for initial deployment in mobile-focused projects, promising swift ROI through enhanced mobile testing features.

To learn more, read our detailed IBM DevOps Test UI vs. Perfecto Report (Updated: December 2025).

Buyer's Guide

IBM DevOps Test UI vs. Perfecto

December 2025

Download the complete report

Helped 881,082 peers since 2012

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Categories and Ranking

IBM DevOps Test UI

Ranking in Functional Testing Tools

26th

Average Rating

7.2

Reviews Sentiment

7.1

Number of Reviews

Ranking in other categories

Regression Testing Tools (13th)

Perfecto

Ranking in Functional Testing Tools

15th

Average Rating

8.4

Reviews Sentiment

7.4

Number of Reviews

Ranking in other categories

Performance Testing Tools (16th), Mobile App Testing Tools (5th), Test Automation Tools (22nd)

Mindshare comparison

As of January 2026, in the Functional Testing Tools category, the mindshare of IBM DevOps Test UI is 1.5%, up from 0.5% compared to the previous year. The mindshare of Perfecto is 3.6%, down from 5.1% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Functional Testing Tools Market Share Distribution
Product	Market Share (%)
Perfecto	3.6%
IBM DevOps Test UI	1.5%
Other	94.9%

Functional Testing Tools

Featured Reviews

Hellen Zhang

Lead Systems Tester at Government of Ontario, Canada

Reliable test automation, and test data creation with efficient support

The solution can be improved by removing the need for object matching in the framework. The latest version has increased load time before testing can be run. The reason is that changes were made to how it works with the browser and the startup takes some time. Adjusting those changes to speed up the load time will improve the solution.

Read full review

Roland Castelino

QA Lead at BMO Financial

Its reporting allows us to have a clear view regarding what tests have been executed

The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature. We leverage Perfecto’s reporting and analytics a lot. From the CI Dashboard, it is mainly the status, which is the past, failure count, and time consumption, e.g., how much time did an average test or script take? Along with that, it provides the historical view compared to the previous result, e.g., am I a pass or fail? Also, the stack trace is very important. Whenever a pass occurs, we don't look beyond that. However, whenever a failure occurs, the stack trace information that it gives us is pretty critical for us when figuring out where failures lie. It gives a summary for the pass/fail count, total test count, the historical view, time consumption for each test as well as the total tests, and the stack rate of the failure. Perfecto's analytics are very important since we use them on a daily basis. We run our executions daily. After every execution, we pull information from the Perfecto reporting system and share that with our stakeholders. Having this information accurately reported is pretty important for us, so everybody is aware of the current status of the product. That way, we can evaluate the health of the product or environment against that which has been executed. Therefore, it helps make those real-time decisions and highlights the impact to the business. I found Perfecto to be pretty easy to use while executing against cross-platforms. The main reason is because the same script or test automation where we execute on multiple platforms has minimal changes that I need to do. Also, it is easy for me to set up an execution on one platform, then on another platform, either in parallel or one after the other. Parallel opportunities save me time. Once the execution has been completed across these different configurations, I can always check and compare, e.g., what are the differences and consistencies? We utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs. I use it occasionally for manual testing. Though, there are other team members who use it more frequently than I do. I use it mainly for executing my automated tests. We have the Perfecto lab, cloud devices, and machines. I can program my test to execute against any of those devices, which gives me more confidence in my product. I can compare and see how my product or application functionally behaves across these different devices and from a UI point of view, which helps me a lot. The device lab is extremely important to our testing operations. We rely on having multiple devices up and running all the time. Whenever we kick off an execution, there are multiple reasons why executions may get triggered: * CodeCommit * A scheduled job. * Might be on-demand by any stakeholder. We need the lab to be available, as we need devices up and running for executions to take place. Also, the devices help since they allow us to have parallel execution, and not just wait for a sequential device to become free and available. Therefore, volume is definitely key. It also gives us an opportunity to compare execution across platforms in that space. It is extremely important to you that the lab provides same-day access to new devices since we analyze that data every single day after execution. Perfecto provides their own framework called Quantum Framework. That is one option. The other option is, if I want to have my own framework, I can have a Java-based Maven project, take a Selenium library, AppiumLibrary, and REST Assured library, and utilize the open-source framework. It is easy for us to connect to Perfecto, no matter what framework we use, as long as it has these core libraries in it. I can design and structure it any way that I want. The execution will happen in Perfecto no matter what since they have support for these tools or libraries. It is pretty neat that way. We are not dependent on using just one particular framework to use Perfecto. While there are still some framework limitations, there is the opportunity to use multiple, different open-source frameworks, then pass the execution to Perfecto. We can use most frameworks, then design and craft it any way that we want, then just pass the execution to Perfecto.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"It is compatible with all sorts of Dark Net applications. Its coverage is very good."

"Test automation is most valuable because it saves a lot of time."

"The most valuable feature is the UI component tester."

"IBM Rational Functional Tester is very contextual."

"The most valuable aspect of the solution is that it covers all types of devices on the market allowing you to test different versions of an operating system."

"The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests."

"We are continuously doing testing on different environments, devices, and platforms. It executes seamlessly on multiple devices without having any connectivity issues. It has been really helpful for us to test on cloud devices."

"In terms of cross-platform testing, they offer all of it, every device available in the market. It covers real scenarios that mimic production so that we don't miss out on any devices that our clients might be using to run the applications we develop. It's been great and very helpful."

"Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every new release would be a difficult task. But with Perfecto, it is easy."

"We are able to offer a quality product that has been tested fully, which improves our customer satisfaction. That is a good thing. It has also reduced our IT infrastructure cost. We don't have to spend a lot on setting up infrastructure, which becomes redundant or obsolete very soon. It helps in offsetting that cost."

"The automation piece is the most valuable feature. Every time we had a new version of either OS or an application, we found that being able to automate the testing across different devices is very valuable."

"We're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us."

More Perfecto pros

Cons

"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."

"The latest version has increased load time before testing can be run."

"They need to do a complete revamp so that even a non-technical person can manage the tool."

"If the solution is running on Linux, there are some issues around application compatibility."

"Previously, we used the cradle. Every time the mobile was blocking it, we would have to ask Perfecto to provide another one. That took a lot of time away from us."

"I'm hoping they can support on-premises instances. We have been working on a JIRA integration with Perfecto—and I'm extremely impressed that they have that—but at this time they're not supporting onsite JIRA instances, which is what we have."

"It would be nice if there were some kind of AI to compile a list of available devices. Currently, we have to look at the web interface to see the available devices, but the pipelines can't do it on their own there. We always need to do this manually, so it would be better if this feature were automated."

"One improvement would be speed of execution. If it is an iOS native app, we have noticed that the speed is a bit slower. Perfecto might need to make some improvements in this area."

"The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well."

"It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution."

"It would be ideal if there was a complete integration with other test management tools and other applications like HPLM, Micro Focus, or Microsoft Azure."

"We feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required."

More Perfecto cons

Pricing and Cost Advice

"Licensing is good but the prices for the products are expensive. A single-user license may go for something like $10,000 to $30,000. There are no additional costs, and support is included within that price."

"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."

"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."

"This is an expensive solution compared to others, by 30% to 40%."

"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."

"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."

"It's definitely on the higher end of prices for this type of service."

"Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."

"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."

More Perfecto pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.

See recommendations

881,082 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Computer Software Company

21%

Manufacturing Company

15%

Outsourcing Company

Government

Financial Services Firm

24%

Computer Software Company

10%

Manufacturing Company

Healthcare Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

By reviewers
Company Size	Count
Small Business	1
Midsize Enterprise	3
Large Enterprise	5

By reviewers
Company Size	Count
Small Business	1
Midsize Enterprise	1
Large Enterprise	23

Comparisons

OpenText Functional Testing vs IBM DevOps Test UI

Compared 13% of the time

Katalon Studio vs IBM DevOps Test UI

Compared 13% of the time

Tricentis Tosca vs IBM DevOps Test UI

Compared 12% of the time

OpenText Functional Testing for Developers vs IBM DevOps Test UI

Compared 10% of the time

Selenium HQ vs IBM DevOps Test UI

Compared 9% of the time

More IBM DevOps Test UI Competitors

BrowserStack vs Perfecto

Compared 26% of the time

Sauce Labs vs Perfecto

Compared 19% of the time

Appium vs Perfecto

Compared 8% of the time

LambdaTest vs Perfecto

Compared 6% of the time

Eggplant Test vs Perfecto

Compared 4% of the time

More Perfecto Competitors

Product Reports

Buyer's Guide

Functional Testing Tools

December 2025

Download IBM DevOps Test UI product report

Buyer's Guide

Perfecto

January 2026

Download Perfecto product report

Also Known As

IBM Rational Functional Tester

Perfecto Mobile, Perfecto Web

Overview

IBM DevOps Test UI, also known as Rational Functional Tester, is a software tool designed for automated functional and regression testing of Graphical User Interfaces (GUIs) and data-driven testing. It automates the testing process to ensure application functionalities work as intended and identifies any issues caused by new code changes. The tool is tailored for GUI testing, allowing for easy recording and playback of test cases that interact with UI elements like buttons and menus. It supports data-driven testing, enabling comprehensive tests across various data sets. Additionally, it offers visual editing features with screenshot representations for easy test creation and ScriptAssure technology to maintain test scripts even if the UI changes.

IBM

Perfecto is a cloud-based mobile app testing tool that is designed to help test applications on different operating systems and devices. The solution lets users automate processes related to advanced test scenarios and access browser versions and devices according to individual requirements. With Perfecto’s smart test execution capabilities, teams can manage testing across web and mobile platforms using a single script, conduct parallel testing for large test suites, and design advanced user-based test scenarios to accelerate app release cycles. The solution is also helpful for IT departments, providing insights into biometrics, device vitals, audio injection, network throttling, packet loss, and rotation data to meet desired end-user conditions that align with business priorities.

Perfecto Features

Perfecto has many valuable key features. Some of the most useful ones include:

Live Stream analysis
Reporting/analytics
Activity dashboard
Action-word testing
Bug tracking
Debugging
BDD & codeless automation
Model-based testing
Real-time monitoring
Role-based permissions
User management
Test failure analysis
Real user simulation

Perfecto Benefits

There are many benefits to implementing Perfecto. Some of the biggest advantages the solution offers include:

Streamlined test creation: When you use Perfecto, test creation is easy for your teams. Testing frameworks, like Appium, allows you to scale automated test scripts without any issues.

Scalable test execution: Perfecto enables you to accelerate your mobile app testing and is elastically-scaled with no single point of failure, so you can get the testing cadence you need. In addition, the solution makes it possible for you to execute tests from within IDEs as well as through CI servers like Jenkins.

Superior application quality for mobile: By using Perfecto, you can maximize continuous testing and shift quality by combining the solution with BlazeMeter. Together, these two solutions can help you measure mobile user experience, produce high-quality test data on demand, and create realistic mock services.

AI-driven test automation dashboards: The solution’s unique dashboards and heatmaps give you high-level visibility with timelines and trends.

Cloud-based lab: Perfecto’s Smart Testing Lab gives you the tools you need to quickly test your mobile app against thousands of permutations.

Reviews from Real Users

Perfecto is a solution that stands out when compared to many of its competitors. Some of its major advantages are that it has fantastic testing, reporting, and automation capabilities.

Roland C., QA Lead at BMO Financial, says, “The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature.”

Andy B., Systems Engineer at a financial services firm, writes, “I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. Perfecto is excellent when it comes to executing cross-platform testing.”

A Director, QE Automation & Analytics at a financial services firm, says, “The most valuable feature is cloud-based automation and testing.”

Another PeerSpot reviewer, Kristina B., Product Manager at a manufacturing company, states, “The solution allows us to do seamless cross-platform testing, saves time, and comes with excellent customer service.”

Perforce

Sample Customers

Edumate

Virgin Media, Paychex, Rabobank, R+V, Discover

Buyer's Guide

IBM DevOps Test UI vs. Perfecto

December 2025

Free Report: IBM DevOps Test UI vs. Perfecto

Find out what your peers are saying about IBM DevOps Test UI vs. Perfecto and other solutions. Updated: December 2025.

DOWNLOAD NOW

881,082 professionals have used our research since 2012.

See our IBM DevOps Test UI vs. Perfecto report.

See our list of best Functional Testing Tools vendors.

We monitor all Functional Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.