Try our new research platform with insights from 80,000+ expert users

IBM DevOps Test UI vs Sauce Labs comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 18, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

IBM DevOps Test UI
Ranking in Functional Testing Tools
29th
Average Rating
7.2
Reviews Sentiment
7.1
Number of Reviews
8
Ranking in other categories
Regression Testing Tools (14th)
Sauce Labs
Ranking in Functional Testing Tools
13th
Average Rating
8.8
Reviews Sentiment
7.2
Number of Reviews
113
Ranking in other categories
Test Automation Tools (19th)
 

Mindshare comparison

As of July 2025, in the Functional Testing Tools category, the mindshare of IBM DevOps Test UI is 0.8%, down from 0.8% compared to the previous year. The mindshare of Sauce Labs is 5.9%, down from 6.6% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Functional Testing Tools
 

Featured Reviews

HZ
Reliable test automation, and test data creation with efficient support
The solution can be improved by removing the need for object matching in the framework. The latest version has increased load time before testing can be run. The reason is that changes were made to how it works with the browser and the startup takes some time. Adjusting those changes to speed up the load time will improve the solution.
AnupKumar4 - PeerSpot reviewer
Offers good stability and robust but lacks generative AI capabilities
Technical support is equally very important. If you talk about anything deployed to production, and the project is live, customers are using that, and they might face some issues, some functional issues. That's when support people play a role in identifying the fix or the incident. Based on that, we create an incident based on the customer defect or whatever. Once the incident gets raised, the support will play a role in working on that particular incident. If it's a code-based incident, administration, or integration issue, support people play a big role in resolving those issues before reaching the exact developers.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It is compatible with all sorts of Dark Net applications. Its coverage is very good."
"The most valuable feature is the UI component tester."
"IBM Rational Functional Tester is very contextual."
"Test automation is most valuable because it saves a lot of time."
"Testing subscription videos for on-demand software, making them better quality and bug free for our customers."
"It has significantly enhanced our testing accuracy by approximately 50%."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"The most valuable feature is the ability to run concurrent automated tests up to a specified value, depending on what we are currently paying for."
"The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They also provide real devices, so you just provide the URL and test your application."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"The insights section provides a great overall state of the automation suite and can identify trends relatively quickly. If we see a dip in our passing rate over time, we can look at what changed when the test started failing to find the root cause rather than doing a quick fix to find that the test fails a short time later."
"It provides a comprehensive selection of browsers and platform versions for our test automations and CI/CD pipeline process. It also provides a comprehensive set of virtual mobile devices, which we can configure for our automation and availability. These features are valuable for us when it comes to testing our applications. We have a website and mobile applications that we want to test and diversify to various browsers and mobile devices as well as restore various versions. This helps us to find bugs that users might be facing and correct them."
 

Cons

"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."
"If the solution is running on Linux, there are some issues around application compatibility."
"They need to do a complete revamp so that even a non-technical person can manage the tool."
"The latest version has increased load time before testing can be run."
"On a rare occasion, I will come into a ticket where a customer will have reached out to me after reaching out to Sauce Labs, saying, "Sauce Labs doesn't understand what I am going through. They are not being very helpful." So, I try to do clean up there. Outside of those extremely rare occasions, I have only had one or two of those support issues."
"Another aspect that could be improved is having the virtual devices boot up a little quicker. Sometimes we wait up to a minute before a device is available. It would be nice if that was 30 seconds or so."
"They could improve the platform's customer support services."
"The ability to configure the memory and CPU for the test machines should be included."
"Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time."
"One of the challenging areas for us is the reporting and the matrix. It should be based on roles, but right now it is only available for the admin role. The admin role can really do a lot of stuff, but our infrastructure team, which holds the admin role, is not ready to hand it over to us on the testing team. If Sauce Labs had permissions associated with roles, where this role could do this activity and that role could do that activity, it would be easier for us."
"If I had to speak of an area that could be improved it would probably have to be the speed of interaction with the devices. There is at times a considerable amount of lag while using some of the virtual and at times even physical device farm"
"The testing process is difficult. I need to prove the complete competency of the tool, and I am finding that challenging."
 

Pricing and Cost Advice

"Licensing is good but the prices for the products are expensive. A single-user license may go for something like $10,000 to $30,000. There are no additional costs, and support is included within that price."
"When you reach the Enterprise licensing tier, base level being with 10 concurrent test sessions, pricing is essentially per-unit-of-concurrency thereafter with a relatively linear increase and not much benefit for "bulk"."
"The number of concurrent VMs that Sauce Labs provides depends on your purchase license level."
"Compared with other services, Sauce Labs is a bit expensive."
"Cost-wise, it's decent. If you have to get the base version out of it, it's the best solution to go with. As compared to other cloud service providers, the pricing of Sauce Labs is decent."
"Trial the product and see if it suits your needs."
"​Now that we have an enterprise license, we no longer have to worry about minutes each month!​"
"With respect to pricing, they did a bundled discount because we went with Sauce Labs for both mobile and browser. They were very competitive on pricing and provided a bundle discount for us as a larger customer."
"We did initially go with Sauce Labs because of the pricing and integration."
report
Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.
860,711 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
28%
Financial Services Firm
15%
Real Estate/Law Firm
10%
Government
7%
Financial Services Firm
19%
Computer Software Company
12%
Retailer
6%
Manufacturing Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

Ask a question
Earn 20 points
What do you like most about Sauce Labs?
It has significantly enhanced our testing accuracy by approximately 50%.
What needs improvement with Sauce Labs?
Sauce Labs can include new technologies like generative AI, which can reduce the human effort in writing test cases. For example, in my current project, we reduced the time it took to complete user...
What is your primary use case for Sauce Labs?
I work as an automation engineer using Selenium WebDriver with Java, and API automation using Rest Assured with Java. I have also worked with Docker integration on AWS. Additionally, I have experie...
 

Also Known As

IBM Rational Functional Tester
No data available
 

Overview

 

Sample Customers

Edumate
Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
Find out what your peers are saying about IBM DevOps Test UI vs. Sauce Labs and other solutions. Updated: May 2025.
860,711 professionals have used our research since 2012.