No more typing reviews! Try our Samantha, our new voice AI agent.

Digital.ai Continuous Testing vs Katalon Studio comparison

Why PeerSpot?
 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 15, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Digital.ai Continuous Testing
Ranking in Test Automation Tools
16th
Average Rating
7.6
Reviews Sentiment
4.9
Number of Reviews
7
Ranking in other categories
Mobile App Testing Tools (3rd), AI-Augmented Software-Testing Tools (2nd)
Katalon Studio
Ranking in Test Automation Tools
3rd
Average Rating
8.0
Reviews Sentiment
6.6
Number of Reviews
56
Ranking in other categories
Regression Testing Tools (3rd), API Testing Tools (4th)
 

Mindshare comparison

As of November 2026, in the Test Automation Tools category, the mindshare of Digital.ai Continuous Testing is 1.5%, up from 0.5% compared to the previous year. The mindshare of Katalon Studio is 3.6%, down from 8.2% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Test Automation Tools Mindshare Distribution
ProductMindshare (%)
Katalon Studio3.6%
Digital.ai Continuous Testing1.5%
Other94.9%
Test Automation Tools
 

Featured Reviews

Mampi Bhattacharya - PeerSpot reviewer
Developer at a tech vendor with 10,001+ employees
Continuous testing has accelerated daily releases and now provides faster, richer debugging insights
Digital.ai Continuous Testing could be better in certain areas, and I can share my experience-based view on what can be frustrating. One issue is device availability and queue delays during peak CI hours. Sometimes devices are busy, causing tests to queue and the pipeline to slow down unexpectedly, which is especially painful for large regression suites or tight release timelines. Improvements are needed in smarter auto-scaling of device pools and better priority-based scheduling. Additionally, execution speed variability occurs; the same test sometimes runs fast and sometimes slow, depending on device load and network latency, making results less predictable. More stable execution environments and better performance isolation per session would help. Furthermore, debugging can still be indirect; even with logs or videos, I do not fully control the device as I would with local debugging, making it hard to pause and inspect live states or reproduce edge-case issues locally. More interactive debugging and improved local reproduction tools are necessary. Cost versus usage efficiency is another area of concern, as device cloud usage can be expensive and we sometimes have idle or inefficient tests that waste money. Improvements in usage analytics and cost optimization suggestions for smart test selection to run only impacted tests are areas where I believe Digital.ai Continuous Testing could improve.
TM
Quality Automation Specialist at SymphonyAI
Fast UI automation has reduced regression effort and has improved tester onboarding
The best features Katalon Studio offers include how even a manual tester can use it with built-in keywords and recording features. A framework does not need to be built from scratch, unlike other tools. Katalon Studio provides an out-of-the-box automation framework, which allows quick starts, and its built-in keywords and record and playback functionality make it easier for manual testers transitioning to automation. Additionally, the object repository simplifies test creation and makes maintenance more manageable. The test suite and execution profiles also allow easy test organization for environment-specific execution, and the built-in reports provide ready-to-share insights with the team. If I had to select one standout feature, the framework setup stands out as the best feature, as it makes starting automation quickly and straightforwardly without heavy setup. Katalon Studio has positively impacted my organization by helping the team reduce manual regression effort and improve release confidence by catching UI issues earlier. It positively impacted the company by speeding up test execution and allowing faster feedback before releases, which reduces last-minute defects. The quick setup of the framework enabled the team to start automation faster, improving overall QA productivity without increasing team size. Additionally, automated regression tests maintained consistent test coverage and reduced the risk of repetitive manual reports, which overall helped Katalon Studio reduce manual regression effort, improve test consistency, and provide faster feedback to the team, enhancing release quality.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The most valuable part of Experitest is the number of real devices on which the test is run."
"The most useful feature for me is Mobile Studio. It has a UI where I can click on elements, and it generates a script for me. Mobile Studio can generate code from testing steps. I'm using Python with it."
"I have seen a clear positive ROI after implementing Digital.ai Continuous Testing, especially in terms of time saving, faster release cycle, and improved efficiency."
"Digital.ai Continuous Testing has had a very positive impact in terms of efficiency and quality."
"Experitest is one of the only companies to offer a real device on the cloud to perform testing, and they also provide quality documentations that help you navigate and maximize the solution."
"Digital.ai Continuous Testing has positively impacted my organization with massive reductions in testing time, enabling us to cut our regression cycle from two to three days down to two to three hours, transition from weekly releases to nearly daily deployments, and reduce production defects by 30 to 50% while significantly improving debugging efficiency and overall team productivity."
"Digital.ai Continuous Testing has had a pretty positive impact on the organization, especially in terms of speed and reliability."
"The scalability of the product is good."
"I like the feature where you can define a model that represents your website and then reuse the components from the model, as it makes creating more test cases easy."
"The learning curve is not steep, and it is quite easy to get used to it, and I'm sure it won't take you much time, but the results will be worth it many times over."
"The most important feature is the Jenkins integration; it is pretty straight forward and allows us to run nightly builds."
"When the company started to use Katalon Studio, the time in testing was very fast, it was more focused on the principal items, for example, the regression test and the integration test were more efficient and faster."
"The most valuable feature is its automation security capabilities."
"It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."
"Our clients have requested by all types of testing, including mobile, desktop, and API testing and all of those are covered by Katalon. I find that very valuable, very complete."
 

Cons

"I believe that it could be more stable. During times when something is not working, it is difficult to find the solution."
"I would also like to see more videos and descriptions that could make installation more efficient."
"The amount of time that I have spent on just figuring out how to use Experitest and get it to work was quite long compared to what I have been doing before."
"Device availability and queue delays during peak CI hours are an issue; sometimes devices are busy, causing tests to queue and the pipeline to slow down unexpectedly, which is especially painful for large regression suites or tight release timelines."
"Digital.ai Continuous Testing is a solid tool, but there are a few things that can be frustrating at times."
"Digital.ai Continuous Testing is a strong platform, but there are a few areas where it could be improved to make the experience even better."
"I have been automating tests for many years on many things but not on mobile devices. The amount of time that I have spent on just figuring out how to use Experitest and get it to work was quite long compared to what I have been doing before. I spent the first two weeks just getting it started. It would be good to have some video explanation of how to use it on your devices and get started. Their online documentation is quite good and extensive, but it would be quite good to have some end-to-end examples demonstrated."
"One challenge is that the initial setup and integration with CI/CD pipelines can sometimes be a bit complex, especially for teams new to automation."
"Support options need improvement. It is sometimes hard to find a solution to any given problem, thus you are forced to use another solution."
"Now we are having difficulties in using it and had to limit our automation experts to the features that Katalon allows us to use for free. It was free access and they claimed that it would be free for all time."
"I would like Katalon Studio to develop manual test case generation using AI capabilities, as other tools like those using OpenAI are already doing this."
"I would like to see improvements in how Katalon Studio works with iOS applications, especially with React Native applications."
"Restricted choice for scripting language (just Groovy)."
"The product’s regression testing time could be reduced."
"The solution can be further improved with better loading time."
"One area for improvement in Katalon Studio is execution speed. Larger test suites can take more time to execute."
 

Pricing and Cost Advice

"We make monthly payments. The cost is dependent on the number of devices we intend to support."
"It is quite fairly priced, but it really depends on your budget. It is somewhere in the mid-range of products. It is not free and it is not QGP that nearly costs a whole house. You pay for the number of users who require access to execute the tests."
"The price is reasonable for our company, but I'm not the decision-maker."
"Katalon Studio is a free tool."
"The tool's pricing is cheap compared to other alternatives. I would rate the tool's pricing a three out of ten."
"Katalon Studio is an expensive tool."
"The solution is more affordable than other vendors."
"There is a free version of the tool to use and support is available through the community forums, but there is a licensed version as well."
"We are using the free version of Katalon Studio at this point."
"In terms of pricing, Katalon, Selenium, and Cypress all represent a similar level of investment. The software for these tools are either true open source or almost open source (because they charge a small fee), so pricing is a neutral point for me."
"The tool is affordable."
report
Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
920,929 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Outsourcing Company
20%
University
14%
Financial Services Firm
11%
Comms Service Provider
5%
Financial Services Firm
13%
Manufacturing Company
11%
Outsourcing Company
9%
Computer Software Company
8%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business4
Midsize Enterprise2
Large Enterprise2
By reviewers
Company SizeCount
Small Business21
Midsize Enterprise14
Large Enterprise25
 

Questions from the Community

What needs improvement with Digital.ai Continuous Testing?
Digital.ai Continuous Testing is a solid tool, but there are a few things that can be frustrating at times. One thing I noticed is that the initial setup and configuration can feel complex, especia...
What is your primary use case for Digital.ai Continuous Testing?
The main use case for Digital.ai Continuous Testing has been automating test execution as part of the CI/CD pipeline, especially for ensuring builds are stable before the release. For example, I us...
What advice do you have for others considering Digital.ai Continuous Testing?
If someone is considering using Digital.ai Continuous Testing, my advice would be to start with a clear workflow in mind. From my experience, it works best when you use it as part of a CI/CD pipeli...
What is your experience regarding pricing and costs for Katalon Studio?
Pricing felt reasonable for the features provided, especially considering the time saved during the automation setup and execution. From a user perspective, Katalon Studio offers good value, partic...
What needs improvement with Katalon Studio?
I feel nothing needs improvement for Katalon Studio, as it is already the best in the industry, providing the best enhancement for users. Katalon Studio is already top-notch with no need to improve.
What is your primary use case for Katalon Studio?
My main use case for Katalon Studio is to work on many projects, and my tester has four years of experience in testing, which allows me to specialize in functional testing, regression, web, and mob...
 

Also Known As

Experitest Seetest, Experitest
No data available
 

Overview

 

Sample Customers

Samsung, American Express, Barclays, China Mobile, Citi, Cisco, McAfee
Coca-Cola Tesla Black Board TaTa Consultancy Services Sony
Find out what your peers are saying about Digital.ai Continuous Testing vs. Katalon Studio and other solutions. Updated: September 2026.
920,929 professionals have used our research since 2012.