No more typing reviews! Try our Samantha, our new voice AI agent.

IBM DevOps Test UI vs Katalon Studio comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Jun 3, 2026

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

IBM DevOps Test UI
Ranking in Regression Testing Tools
12th
Average Rating
7.2
Reviews Sentiment
7.1
Number of Reviews
8
Ranking in other categories
Functional Testing Tools (25th)
Katalon Studio
Ranking in Regression Testing Tools
3rd
Average Rating
8.0
Reviews Sentiment
6.6
Number of Reviews
56
Ranking in other categories
API Testing Tools (6th), Test Automation Tools (2nd)
 

Mindshare comparison

As of August 2026, in the Regression Testing Tools category, the mindshare of IBM DevOps Test UI is 2.8%, up from 1.2% compared to the previous year. The mindshare of Katalon Studio is 6.0%, down from 15.6% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Regression Testing Tools Mindshare Distribution
ProductMindshare (%)
Katalon Studio6.0%
IBM DevOps Test UI2.8%
Other91.2%
Regression Testing Tools
 

Featured Reviews

HZ
Lead Systems Tester at Government of Ontario, Canada
Reliable test automation, and test data creation with efficient support
The solution can be improved by removing the need for object matching in the framework. The latest version has increased load time before testing can be run. The reason is that changes were made to how it works with the browser and the startup takes some time. Adjusting those changes to speed up the load time will improve the solution.
Ramanagowda Hullur - PeerSpot reviewer
Senior Automation Engineer at Stryker
Recording limitations and remote access challenges have affected desktop application testing
Katalon Studio has proven effective in our deliverables, particularly in designing the framework where other tools typically require coding in client libraries such as Python or Java. With Katalon Studio, there is no such complexity, allowing us to organize projects modularly based on folder structures without needing to write separate code. The self-healing feature for web application automation and its built-in CI/CD ecosystem integration eliminates the need for external tools for pipeline setup. Katalon Studio excels in CI/CD integration, providing an inbuilt ecosystem without the need for external setup, and it features a postings structure along with keyword and library availability. Newcomers to the team can easily adapt to the setup or project structure, which contributes to its popularity, along with its low-code or no-code capability that allows for a comprehensive platform supporting web, mobile, API, and desktop automation. The self-healing mechanism for test cases autonomously identifies issues with locators and ensures they continue functioning, which is impressive, along with the robust object repository. Katalon Studio has significantly aided our team, especially when clients expect deliveries for CI/CD integration that requires automation test scripts to run on a daily schedule. The self-healing feature automatically identifies available locators for elements in the DOM, ensuring that test cases remain functional. Katalon Studio has positively impacted our organization by facilitating faster delivery when clients have urgent requirements. We can deliver quickly based on urgency due to the features Katalon Studio provides. This has led to significant reductions in time spent on framework configuration, designing, and training individuals who are unfamiliar with the tool, helping us save both time and costs.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The most valuable feature is the UI component tester, which analyzes the changes in UI elements and allows me to automatically adapt and change my automation testing."
"It helps in automation by using better object recognition as compared to other tools in the market."
"By automating regression test suites using this product, we were able to show time savings of more than 1200 hours in less than ONE year."
"Robust API provides quick turnaround for developers to understand and automate functional test case quickly."
"The most valuable feature is the UI component tester."
"It is 100% compatible with all sorts of database integrations and is compatible with all types of open source TFT-based applications, which makes it a great product to have."
"As it is built on Ellipse/Java and costs less than other tools, it is recommended."
"IBM Rational Functional Tester is very contextual."
"Katalon Studio is useful because it helped us to generate reports to see which test cases passed versus which ones failed."
"The scalability of the product is good."
"Katalon Studio is easy to install and to learn for other technical people who work in quality assurance and don't work in developing software for a long time."
"This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation."
"It is easy for a non-technical person to use and adopt."
"The recording feature of this product is very valuable for our testing purposes."
"Katalon Studio has improved our organization because it's improving the speed to market and the speed of delivery."
"Overall, I recommend it highly and find it easy to use with many integrations."
 

Cons

"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."
"It does not fully justify being a paid tool, and it needs improvement."
"They need to do a complete revamp so that even a non-technical person can manage the tool."
"With version 8.5 we faced workspace crash issues frequently."
"If the solution is running on Linux, there are some issues around application compatibility."
"The object repository used for identifying objects can be made better. It has been noticed that the RFT tool is unable to identify some objects, due to which we are unable to add them to the object repository."
"If in the future there is no support for mobile applications, then we will be using it less."
"The latest version has increased load time before testing can be run."
"We have been seeing some error pop-ups that are difficult to understand why they were triggered."
"Katalon Studio sometimes restarts during automation, and as mentioned earlier, the app experiences lag, so those are the main areas that need improvement."
"The reporting is very good, but it could be better."
"Katalon Studio should improve its usability, it still needs some improvement where users can easily use it to build their automation suite. It requires some initial work to set it up. There should be more keywords in the library to limit the coding requirements, this will allow a non-technical person easily start using it, which would be better."
"While the web testing is great, we expect more from the API testing."
"Sometimes the IDE can be a little stuck or may lag a little bit, and I have had issues capturing certain XPaths where the record and playback does not necessarily capture the accurate XPath."
"I would like Katalon Studio to develop manual test case generation using AI capabilities, as other tools like those using OpenAI are already doing this."
"The price of the solution is a bit high. It's one of the reasons we decided not to continue using the product."
 

Pricing and Cost Advice

"Licensing is good but the prices for the products are expensive. A single-user license may go for something like $10,000 to $30,000. There are no additional costs, and support is included within that price."
"I am using the free version."
"Katalon Studio is an expensive tool."
"The product is expensive."
"The product’s pricing is very, very low."
"The tool is affordable."
"Price-wise, Katalon Studio is a costly product. Considering what the solution provides its users with, I can say that price-wise, Katalon Studio is an okay product."
"Katalon Studio is a free tool."
"The pricing is good. It is the market average."
report
Use our free recommendation engine to learn which Regression Testing Tools solutions are best for your needs.
908,834 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Outsourcing Company
15%
Manufacturing Company
13%
Financial Services Firm
10%
Construction Company
9%
Financial Services Firm
14%
Manufacturing Company
10%
Computer Software Company
10%
Outsourcing Company
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business1
Midsize Enterprise3
Large Enterprise5
By reviewers
Company SizeCount
Small Business21
Midsize Enterprise14
Large Enterprise25
 

Questions from the Community

Ask a question
Earn 20 points
What is your experience regarding pricing and costs for Katalon Studio?
Pricing felt reasonable for the features provided, especially considering the time saved during the automation setup and execution. From a user perspective, Katalon Studio offers good value, partic...
What needs improvement with Katalon Studio?
I feel nothing needs improvement for Katalon Studio, as it is already the best in the industry, providing the best enhancement for users. Katalon Studio is already top-notch with no need to improve.
What is your primary use case for Katalon Studio?
My main use case for Katalon Studio is to work on many projects, and my tester has four years of experience in testing, which allows me to specialize in functional testing, regression, web, and mob...
 

Also Known As

IBM Rational Functional Tester
No data available
 

Overview

 

Sample Customers

Edumate
Coca-Cola Tesla Black Board TaTa Consultancy Services Sony
Find out what your peers are saying about IBM DevOps Test UI vs. Katalon Studio and other solutions. Updated: June 2026.
908,834 professionals have used our research since 2012.