Try our new research platform with insights from 80,000+ expert users

IBM DevOps Test UI vs Sauce Labs comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 18, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

IBM DevOps Test UI
Ranking in Functional Testing Tools
29th
Average Rating
7.2
Reviews Sentiment
7.1
Number of Reviews
8
Ranking in other categories
Regression Testing Tools (14th)
Sauce Labs
Ranking in Functional Testing Tools
12th
Average Rating
8.8
Reviews Sentiment
7.2
Number of Reviews
113
Ranking in other categories
Test Automation Tools (15th)
 

Mindshare comparison

As of May 2025, in the Functional Testing Tools category, the mindshare of IBM DevOps Test UI is 0.7%, down from 0.9% compared to the previous year. The mindshare of Sauce Labs is 5.7%, down from 6.8% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Functional Testing Tools
 

Featured Reviews

HZ
Reliable test automation, and test data creation with efficient support
The solution can be improved by removing the need for object matching in the framework. The latest version has increased load time before testing can be run. The reason is that changes were made to how it works with the browser and the startup takes some time. Adjusting those changes to speed up the load time will improve the solution.
Joel Alonzo - PeerSpot reviewer
Metrics about testing across the company are easily accessible, and it's easy to get teams up and running
Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot. The other issue is that when you're behind a corporate proxy and inside a corporate network, it's a nightmare in general. And the problem that we've come up against over and over again is that a lot of our network staff don't want to open up giant CIDR blocks to internal traffic. Opening it up to one endpoint which is Sauce Labs, through a little API is perfectly fine. That's one IP address and it's no big deal. But for their virtual machines they have one jump box and that jump box contains an entire CIDR block that changes each time the tunnel starts up. In other words, if every call went into one IP and that got bounced back to a load balancer or net gateway, that would help a lot too. When I go to the network team and say, "Hey, we're using a product, a piece of software, and I need an entire CIDR block opened," the first and almost eternal response to that will be "absolutely not." Getting things set up and running is always going to be a bit of a struggle within any corporate environment. Most of that is not Sauce Labs' fault, but the things I just mentioned are things they could do to help deal with that struggle.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It is compatible with all sorts of Dark Net applications. Its coverage is very good."
"The most valuable feature is the UI component tester."
"Test automation is most valuable because it saves a lot of time."
"IBM Rational Functional Tester is very contextual."
"Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc."
"Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."
"Allows us to do JIRA Cloud and BambooHR Integration."
"The most critical thing is that this software aligns with our Agile and DevOps way of doing things. It integrates with kickoff scripts through DevOps."
"It offers the single best solution for integrating deep automated browser testing in a CI/CD pipeline."
"They update for the latest browsers and mobile phones and support a lot of combinations. They have 1,000-plus desktop combinations and browser versions, which is really great. We need that at Applause. The all-in-one testing suite aspect of it is really important because most of our clients prefer to go to one place."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers."
 

Cons

"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."
"The latest version has increased load time before testing can be run."
"They need to do a complete revamp so that even a non-technical person can manage the tool."
"If the solution is running on Linux, there are some issues around application compatibility."
"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable."
"There have been various times throughout the last month or so where the service has gone down during business hours."
"Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time."
"I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"The pricing model of Sauce Labs could be more flexible. Sauce Labs has just one price for the type of solution and a set number of devices. Other solutions have a fee for the base solution and an additional cost per device. If you're a smaller organization, you have to consider your needs. Some smaller companies still need to test various devices, so my advice is to start small and scale up as needed. We had initially planned to start big, but that would have been a big waste."
"The only drawback is the speed, it will be good if we have a server in Asia too. It will be great if we can improve speed while initialization and execution."
"With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the Selenium scripts, we require web locators. We have to capture them from the local and execute the script on Sauce Labs. If Sauce Labs can provide a solution where we can inspect any of the mobile devices online, it will be very helpful for us."
 

Pricing and Cost Advice

"Licensing is good but the prices for the products are expensive. A single-user license may go for something like $10,000 to $30,000. There are no additional costs, and support is included within that price."
"Trial the product and see if it suits your needs."
"The pricing is definitely on the higher end, and there are other options that are more cost-effective."
"Go ahead please. Try it at a smaller scale."
"Compared with other services, Sauce Labs is a bit expensive."
"We did initially go with Sauce Labs because of the pricing and integration."
"The pricing is reasonable due to the amount of diversity that they provide. However, I feel they might be more flexible to bargain based on their relationship with our organization."
"We have an enterprise account; it has worked great for our needs."
"It is an expensive tool."
report
Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.
850,028 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
28%
Financial Services Firm
17%
Real Estate/Law Firm
9%
Government
7%
Financial Services Firm
19%
Computer Software Company
15%
Retailer
7%
Manufacturing Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

Ask a question
Earn 20 points
What do you like most about Sauce Labs?
It has significantly enhanced our testing accuracy by approximately 50%.
What needs improvement with Sauce Labs?
Sauce Labs can include new technologies like generative AI, which can reduce the human effort in writing test cases. For example, in my current project, we reduced the time it took to complete user...
What is your primary use case for Sauce Labs?
I work as an automation engineer using Selenium WebDriver with Java, and API automation using Rest Assured with Java. I have also worked with Docker integration on AWS. Additionally, I have experie...
 

Also Known As

IBM Rational Functional Tester
No data available
 

Overview

 

Sample Customers

Edumate
Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
Find out what your peers are saying about IBM DevOps Test UI vs. Sauce Labs and other solutions. Updated: April 2025.
850,028 professionals have used our research since 2012.