Try our new research platform with insights from 80,000+ expert users

IBM DevOps Test UI vs Katalon Studio comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on May 21, 2025

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

IBM DevOps Test UI
Ranking in Regression Testing Tools
13th
Average Rating
7.2
Reviews Sentiment
7.1
Number of Reviews
8
Ranking in other categories
Functional Testing Tools (29th)
Katalon Studio
Ranking in Regression Testing Tools
3rd
Average Rating
7.8
Reviews Sentiment
6.6
Number of Reviews
50
Ranking in other categories
API Testing Tools (4th), Test Automation Tools (4th)
 

Mindshare comparison

As of October 2025, in the Regression Testing Tools category, the mindshare of IBM DevOps Test UI is 2.0%, up from 0.9% compared to the previous year. The mindshare of Katalon Studio is 14.5%, down from 17.8% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Regression Testing Tools Market Share Distribution
ProductMarket Share (%)
Katalon Studio14.5%
IBM DevOps Test UI2.0%
Other83.5%
Regression Testing Tools
 

Featured Reviews

HZ
Reliable test automation, and test data creation with efficient support
The solution can be improved by removing the need for object matching in the framework. The latest version has increased load time before testing can be run. The reason is that changes were made to how it works with the browser and the startup takes some time. Adjusting those changes to speed up the load time will improve the solution.
Keerthi Prasannakumar - PeerSpot reviewer
Has improved test efficiency and automated repeated sanity checks using reusable components
The best features Katalon Studio offers include its user-friendly nature. It is very much a user-friendly automation framework that supports both beginners and advanced users. It combines manual and script-based testing, allowing easy recording of steps and customization using Java or Groovy. Its built-in reporting, data-driven testing, and CI/CD integration are extremely useful for managing end-to-end automation efficiently. The best feature of Katalon Studio is its ease of setup with both manual and scripted automation, plus strong integration techniques, which help the tester find reports easily. It is more focused on debugging, reusability, and reporting. The reporting and debugging features of Katalon Studio help me in my testing workflow by providing test execution reports with logs, screenshots, and videos for failed steps, which makes it easier to analyze results. The report can be in formats such as HTML, PDF, or integrated into Katalon TestOps for tracking trends over time. For debugging, I use the debug mode to run test cases step-by-step, check every value, and inspect the console and log viewer for error messages. Katalon Studio highlights the exact failed step, provides stack traces, and helps quickly identify issues in locator data or synchronization. For example, in one of my projects, I automated a video upload and a preview feature in a web application. During execution, the test failed at the preview validation step. The Katalon Studio report showed that the preview element was not visible within expected time. I switched to debug mode, added a wait condition, and re-ran the test step-by-step to verify that the video preview loaded correctly before validation. After updating the script with an explicit wait, the test passed consistently, confirming all steps were successful and improving the reliability of future regression runs. Katalon Studio's report and debug mode help identify whether it's a timing issue or if we need an explicit wait. A key feature I notice in Katalon Studio is its cross-platform automation, supporting web, mobile, API, and desktop testing in one tool. The record and playback feature is my favorite because I'm not from a coding background. It allows for quick test creation without coding, making it accessible even for beginners. The repository and data-driven testing provide centralized storage for test elements, improving reusability. We can run the same test with multiple sets of data, which is also significant. The integration part is excellent, along with reusable test suites and keywords, which allow modular and maintainable test structures across projects. Katalon Studio has positively impacted my organization by significantly speeding up the testing process. The repetitive regression tests that used to take hours or days are now completed in a day or just two to three hours. The built-in reports and debugging features improved communication with developers and made issue resolution faster. With Katalon Studio providing detailed reports, false arguments have gradually reduced. Overall, test coverage, accuracy, and team productivity have enhanced, allowing for a more confident delivery of builds and shorter turnaround times. I think the company has a positive impact overall.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The most valuable feature is the UI component tester."
"Test automation is most valuable because it saves a lot of time."
"IBM Rational Functional Tester is very contextual."
"It is compatible with all sorts of Dark Net applications. Its coverage is very good."
"User-friendly and a good solution."
"It provides us daily feedback on the status (failing/working) of the core features of our websites."
"It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."
"The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities."
"The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options."
"The report generated using Katalon Studio is extremely valuable."
"This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation."
"Katalon Studio is easier to use compared to SmartBear TestComplete."
 

Cons

"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."
"If the solution is running on Linux, there are some issues around application compatibility."
"The latest version has increased load time before testing can be run."
"They need to do a complete revamp so that even a non-technical person can manage the tool."
"Katalon lacks integration with other software, including integrating other languages like .NET and PHP."
"There is not much support offered for the free version, which is something that could be improved."
"I've seen that our clients are not truly aware of the power behind Katalon."
"There could potentially be more reporting within the solution. We need more issue reports, for example."
"The Object Spy is rather frustrating to work with, so I tend not to use it."
"The solution can be further improved with better loading time."
"Its stability needs improvement."
"The price of the solution is a bit high. It's one of the reasons we decided not to continue using the product."
 

Pricing and Cost Advice

"Licensing is good but the prices for the products are expensive. A single-user license may go for something like $10,000 to $30,000. There are no additional costs, and support is included within that price."
"We were using the free version of this tool."
"The product’s pricing is very, very low."
"We are using the free version of Katalon Studio at this point."
"Its pricing is quite reasonable. If you require their help in getting started, then there is a professional services fee on top of the product license cost."
"The product is affordable. It has an average and competitive pricing compared to other vendors."
"The price of Katalon Studio is reasonable. They recently had a price increase that might impact new subscribers. We are using a business license."
"The prices are very high."
"There is a free version of the tool to use and support is available through the community forums, but there is a licensed version as well."
report
Use our free recommendation engine to learn which Regression Testing Tools solutions are best for your needs.
871,408 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
22%
Manufacturing Company
13%
Government
9%
Legal Firm
7%
Computer Software Company
18%
Financial Services Firm
14%
Manufacturing Company
9%
Government
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business1
Midsize Enterprise3
Large Enterprise5
By reviewers
Company SizeCount
Small Business20
Midsize Enterprise13
Large Enterprise19
 

Questions from the Community

Ask a question
Earn 20 points
What is your experience regarding pricing and costs for Katalon Studio?
Katalon Studio is on the expensive side. I rated it eight on a scale where ten is very expensive. I recommend optimizing the pricing, as a moderate value around five would be preferred.
What needs improvement with Katalon Studio?
The reporting is very good, but it could be better.
 

Also Known As

IBM Rational Functional Tester
No data available
 

Overview

 

Sample Customers

Edumate
Coca-Cola Tesla Black Board TaTa Consultancy Services Sony
Find out what your peers are saying about IBM DevOps Test UI vs. Katalon Studio and other solutions. Updated: September 2025.
871,408 professionals have used our research since 2012.