Try our new research platform with insights from 80,000+ expert users

IBM DevOps Test UI vs Katalon Studio comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on May 21, 2025

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

IBM DevOps Test UI
Ranking in Regression Testing Tools
13th
Average Rating
7.2
Reviews Sentiment
7.1
Number of Reviews
8
Ranking in other categories
Functional Testing Tools (26th)
Katalon Studio
Ranking in Regression Testing Tools
2nd
Average Rating
8.0
Reviews Sentiment
6.6
Number of Reviews
55
Ranking in other categories
API Testing Tools (4th), Test Automation Tools (2nd)
 

Mindshare comparison

As of January 2026, in the Regression Testing Tools category, the mindshare of IBM DevOps Test UI is 2.6%, up from 0.8% compared to the previous year. The mindshare of Katalon Studio is 11.0%, down from 17.6% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Regression Testing Tools Market Share Distribution
ProductMarket Share (%)
Katalon Studio11.0%
IBM DevOps Test UI2.6%
Other86.4%
Regression Testing Tools
 

Featured Reviews

HZ
Lead Systems Tester at Government of Ontario, Canada
Reliable test automation, and test data creation with efficient support
The solution can be improved by removing the need for object matching in the framework. The latest version has increased load time before testing can be run. The reason is that changes were made to how it works with the browser and the startup takes some time. Adjusting those changes to speed up the load time will improve the solution.
Ramanagowda Hullur - PeerSpot reviewer
Senior Automation Engineer at Stryker
Recording limitations and remote access challenges have affected desktop application testing
Katalon Studio has proven effective in our deliverables, particularly in designing the framework where other tools typically require coding in client libraries such as Python or Java. With Katalon Studio, there is no such complexity, allowing us to organize projects modularly based on folder structures without needing to write separate code. The self-healing feature for web application automation and its built-in CI/CD ecosystem integration eliminates the need for external tools for pipeline setup. Katalon Studio excels in CI/CD integration, providing an inbuilt ecosystem without the need for external setup, and it features a postings structure along with keyword and library availability. Newcomers to the team can easily adapt to the setup or project structure, which contributes to its popularity, along with its low-code or no-code capability that allows for a comprehensive platform supporting web, mobile, API, and desktop automation. The self-healing mechanism for test cases autonomously identifies issues with locators and ensures they continue functioning, which is impressive, along with the robust object repository. Katalon Studio has significantly aided our team, especially when clients expect deliveries for CI/CD integration that requires automation test scripts to run on a daily schedule. The self-healing feature automatically identifies available locators for elements in the DOM, ensuring that test cases remain functional. Katalon Studio has positively impacted our organization by facilitating faster delivery when clients have urgent requirements. We can deliver quickly based on urgency due to the features Katalon Studio provides. This has led to significant reductions in time spent on framework configuration, designing, and training individuals who are unfamiliar with the tool, helping us save both time and costs.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Test automation is most valuable because it saves a lot of time."
"It is compatible with all sorts of Dark Net applications. Its coverage is very good."
"The most valuable feature is the UI component tester."
"IBM Rational Functional Tester is very contextual."
"Katalon Studio is user-friendly."
"One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."
"Katalon Studio has positively impacted my organization by helping the team reduce manual regression effort and improve release confidence by catching UI issues earlier."
"The functionality of the data is very good. You can upload and disperse data using the solution."
"The best thing about the solution is that there is a record and playback functionality."
"We can write code in Java and it is easy to link to other JARs that we find on the internet, which is very handy."
"The initial setup of Katalon Studio was easy."
"Smart Wait and XPath healing are valuable features."
 

Cons

"If the solution is running on Linux, there are some issues around application compatibility."
"The latest version has increased load time before testing can be run."
"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."
"They need to do a complete revamp so that even a non-technical person can manage the tool."
"During parallel execution, some reports are randomly switched."
"The free version of the solution is not user friendly at all."
"I would like Katalon Studio to develop manual test case generation using AI capabilities, as other tools like those using OpenAI are already doing this."
"Katalon Studio should improve its usability, it still needs some improvement where users can easily use it to build their automation suite. It requires some initial work to set it up. There should be more keywords in the library to limit the coding requirements, this will allow a non-technical person easily start using it, which would be better."
"One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language."
"We have had some issues when it comes to stability, which is something that needs to be improved."
"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."
"It seems to lack a few requirements that a typical customer would want. Compared to other solutions, this product is lacking."
 

Pricing and Cost Advice

"Licensing is good but the prices for the products are expensive. A single-user license may go for something like $10,000 to $30,000. There are no additional costs, and support is included within that price."
"We were using the free version of this tool."
"The price is not high it's good."
"The tool is affordable."
"The approximate cost is around $8,000."
"The cost of Katalon Studio is expensive but it is less than some of the other solutions, such as Micro Focus UFT or SmartBear TestComplete. The cost is the main reason we are using Katalon Studio."
"In terms of pricing, Katalon, Selenium, and Cypress all represent a similar level of investment. The software for these tools are either true open source or almost open source (because they charge a small fee), so pricing is a neutral point for me."
"The product is expensive."
"The price of Katalon Studio is reasonable. They recently had a price increase that might impact new subscribers. We are using a business license."
report
Use our free recommendation engine to learn which Regression Testing Tools solutions are best for your needs.
879,425 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
21%
Manufacturing Company
15%
Government
8%
Legal Firm
7%
Computer Software Company
16%
Financial Services Firm
14%
Manufacturing Company
10%
Government
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business1
Midsize Enterprise3
Large Enterprise5
By reviewers
Company SizeCount
Small Business21
Midsize Enterprise14
Large Enterprise25
 

Questions from the Community

Ask a question
Earn 20 points
What is your experience regarding pricing and costs for Katalon Studio?
I started with the trial version and found it had many features. I purchased the next level, and the setup cost was reasonable for me. For working professionals, Katalon Studio provides a lot at a ...
What needs improvement with Katalon Studio?
One needed improvement is that if I run it one time, it works, but if I run it continuously, the application gets stuck. If I run the application 15 to 20 times, it may get stuck. I take off one po...
 

Also Known As

IBM Rational Functional Tester
No data available
 

Overview

 

Sample Customers

Edumate
Coca-Cola Tesla Black Board TaTa Consultancy Services Sony
Find out what your peers are saying about IBM DevOps Test UI vs. Katalon Studio and other solutions. Updated: December 2025.
879,425 professionals have used our research since 2012.