No more typing reviews! Try our Samantha, our new voice AI agent.

Digital.ai Continuous Testing vs Perfecto comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 15, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Digital.ai Continuous Testing
Ranking in Mobile App Testing Tools
3rd
Ranking in Test Automation Tools
10th
Average Rating
7.6
Reviews Sentiment
4.9
Number of Reviews
7
Ranking in other categories
AI-Augmented Software-Testing Tools (3rd)
Perfecto
Ranking in Mobile App Testing Tools
5th
Ranking in Test Automation Tools
19th
Average Rating
8.4
Reviews Sentiment
7.4
Number of Reviews
23
Ranking in other categories
Performance Testing Tools (14th), Functional Testing Tools (16th)
 

Mindshare comparison

As of May 2026, in the Mobile App Testing Tools category, the mindshare of Digital.ai Continuous Testing is 5.8%, up from 1.4% compared to the previous year. The mindshare of Perfecto is 7.0%, up from 5.2% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Mobile App Testing Tools Mindshare Distribution
ProductMindshare (%)
Digital.ai Continuous Testing5.8%
Perfecto7.0%
Other87.2%
Mobile App Testing Tools
 

Featured Reviews

Mampi Bhattacharya - PeerSpot reviewer
Developer at a tech vendor with 10,001+ employees
Continuous testing has accelerated daily releases and now provides faster, richer debugging insights
Digital.ai Continuous Testing could be better in certain areas, and I can share my experience-based view on what can be frustrating. One issue is device availability and queue delays during peak CI hours. Sometimes devices are busy, causing tests to queue and the pipeline to slow down unexpectedly, which is especially painful for large regression suites or tight release timelines. Improvements are needed in smarter auto-scaling of device pools and better priority-based scheduling. Additionally, execution speed variability occurs; the same test sometimes runs fast and sometimes slow, depending on device load and network latency, making results less predictable. More stable execution environments and better performance isolation per session would help. Furthermore, debugging can still be indirect; even with logs or videos, I do not fully control the device as I would with local debugging, making it hard to pause and inspect live states or reproduce edge-case issues locally. More interactive debugging and improved local reproduction tools are necessary. Cost versus usage efficiency is another area of concern, as device cloud usage can be expensive and we sometimes have idle or inefficient tests that waste money. Improvements in usage analytics and cost optimization suggestions for smart test selection to run only impacted tests are areas where I believe Digital.ai Continuous Testing could improve.
Glenford John - PeerSpot reviewer
Product Manager, Device Integration at a comms service provider with 10,001+ employees
Saves us $2.6 million per year, provides more efficient testing, and helps us strengthen relationships with vendors
The automation piece is the most valuable feature. Every time we had a new version of either OS or an application, we found that being able to automate the testing across different devices is very valuable. Perfecto is great at executing cross-platform testing. From a carrier perspective, it's all mobile, but we also have web applications. We used to be able to test on Symbian, Windows OS, Android, and iOS. Today, we can go on a big screen and test on Chrome, Firefox, Explorer, and other browsers. My team leverages Perfecto's reporting and analytics. When we start stress testing an application, we can look at all the reporting that comes from that, and we can tell at what part of the day the app is performing better. Our analytics are very important to us. Presentations are important, so it's good to have reports with graphs that show the time of day or how the app was performing for months at a time. We use those reports to screen capture, go with the data, and to show to upper management. We can do a comparison of one version performance to another version of the application or device performance. We utilize Perfecto's cloud-based lab to test across devices, browsers, and OSs. We are a carrier, so we have our devices with different OS versions of devices. Right now, it's mostly just Apple and Androids. Back in the day, they had many different versions of the OS, but the only other thing on top of that is web-based browsers. We don't test Linux, which is an operating system of Windows. We don't use Perfecto's cloud. We use our own devices because we test on only our organization's devices. Unless we do some kind of competitive analysis, it's not really a test; it's just a comparison to see how other solutions compare to ours. The range of open-source technologies that Perfecto supports is great. I have a team of contractors that report to me and do all the testing for our organization, and that team turns over every couple of years. We mostly utilize the in-house automation that is available for anyone who isn't a great programmer. They have support for all these other drivers, and they have something for non-programmers who want to automate their work, which is amazing.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Digital.ai Continuous Testing has had a very positive impact in terms of efficiency and quality."
"Experitest is one of the only companies to offer a real device on the cloud to perform testing, and they also provide quality documentations that help you navigate and maximize the solution."
"Digital.ai Continuous Testing has had a pretty positive impact on the organization, especially in terms of speed and reliability."
"The most useful feature for me is Mobile Studio. It has a UI where I can click on elements, and it generates a script for me. Mobile Studio can generate code from testing steps. I'm using Python with it."
"Digital.ai Continuous Testing has positively impacted my organization with massive reductions in testing time, enabling us to cut our regression cycle from two to three days down to two to three hours, transition from weekly releases to nearly daily deployments, and reduce production defects by 30 to 50% while significantly improving debugging efficiency and overall team productivity."
"Experitest is one of the only companies to offer a real device on the cloud to perform testing. They also provide quality documentations that help you navigate and maximize the solution."
"I have seen a clear positive ROI after implementing Digital.ai Continuous Testing, especially in terms of time saving, faster release cycle, and improved efficiency."
"The most valuable part of Experitest is the number of real devices on which the test is run."
"The number one feature, which if we didn't have out-of-the-box would be missed, is the fact that we have video execution. That gives us the ability to view errors or defects in the progression, from beginning to the end of the video."
"One of the good things about Perfecto is the scalability that it provides."
"The Perfecto device lab has allowed us to run tests on multiple devices at the same time and across multiple platforms as well, increasing the efficiency of our testing and saving money, time, and effort while enabling comprehensive testing and high app quality that we otherwise wouldn't be able to achieve."
"We are able to offer a quality product that has been tested fully, which improves our customer satisfaction."
"Overall, it's a great solution."
"The most valuable aspect of the solution is that it covers all types of devices on the market allowing you to test different versions of an operating system."
"I also like the reporting functions. We are constantly downloading these reports and sharing them with our final customers. They help us understand what kind of bugs are happening through the applications. The recording feature is handy because it lets us see a video of the process we run through the pipeline and discover the point at which the automation is breaking."
"Perfecto facilitates delivering the product on time, through the cloud devices, so that there is no impact to our end-users."
 

Cons

"The integration process was good, but I've faced some challenges. Every time they release a new version, I find bugs in the UI and features. Sometimes, buttons don't work well. When this happens, I submit a ticket to technical support, but they often have to fix it in the next version."
"The amount of time that I have spent on just figuring out how to use Experitest and get it to work was quite long compared to what I have been doing before."
"Digital.ai Continuous Testing is a solid tool, but there are a few things that can be frustrating at times."
"I have been automating tests for many years on many things but not on mobile devices. The amount of time that I have spent on just figuring out how to use Experitest and get it to work was quite long compared to what I have been doing before. I spent the first two weeks just getting it started. It would be good to have some video explanation of how to use it on your devices and get started. Their online documentation is quite good and extensive, but it would be quite good to have some end-to-end examples demonstrated."
"I would also like to see more videos and descriptions that could make installation more efficient."
"Digital.ai Continuous Testing is a strong platform, but there are a few areas where it could be improved to make the experience even better."
"I believe that it could be more stable. During times when something is not working, it is difficult to find the solution."
"One challenge is that the initial setup and integration with CI/CD pipelines can sometimes be a bit complex, especially for teams new to automation."
"One improvement would be speed of execution. If it is an iOS native app, we have noticed that the speed is a bit slower."
"We have had some issues with performance, which is something that should be improved."
"The monitoring features, in particular network traffic monitoring, could be improved."
"Previously, we used the cradle. Every time the mobile was blocking it, we would have to ask Perfecto to provide another one. That took a lot of time away from us."
"I'm hoping that Perfecto will come up with browser testing as well because it would be easier to access it."
"It is slow compared to physical device testing. The interactive speed could be improved."
"Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making."
"There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools."
 

Pricing and Cost Advice

"It is quite fairly priced, but it really depends on your budget. It is somewhere in the mid-range of products. It is not free and it is not QGP that nearly costs a whole house. You pay for the number of users who require access to execute the tests."
"The price is reasonable for our company, but I'm not the decision-maker."
"We make monthly payments. The cost is dependent on the number of devices we intend to support."
"Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."
"Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."
"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."
"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."
"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."
"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."
"It's definitely on the higher end of prices for this type of service."
"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."
report
Use our free recommendation engine to learn which Mobile App Testing Tools solutions are best for your needs.
893,915 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
University
17%
Outsourcing Company
14%
Financial Services Firm
12%
Computer Software Company
11%
Financial Services Firm
22%
Construction Company
8%
Manufacturing Company
8%
Healthcare Company
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business4
Midsize Enterprise2
Large Enterprise2
By reviewers
Company SizeCount
Small Business1
Midsize Enterprise1
Large Enterprise23
 

Questions from the Community

What is your experience regarding pricing and costs for Digital.ai Continuous Testing?
The price is reasonable for our company, but I'm not the decision-maker.
What needs improvement with Digital.ai Continuous Testing?
Digital.ai Continuous Testing is a solid tool, but there are a few things that can be frustrating at times. One thing I noticed is that the initial setup and configuration can feel complex, especia...
What is your primary use case for Digital.ai Continuous Testing?
The main use case for Digital.ai Continuous Testing has been automating test execution as part of the CI/CD pipeline, especially for ensuring builds are stable before the release. For example, I us...
Ask a question
Earn 20 points
 

Also Known As

Experitest Seetest, Experitest
Perfecto Mobile, Perfecto Web
 

Overview

 

Sample Customers

Samsung, American Express, Barclays, China Mobile, Citi, Cisco, McAfee
Virgin Media, Paychex, Rabobank, R+V, Discover
Find out what your peers are saying about Digital.ai Continuous Testing vs. Perfecto and other solutions. Updated: April 2026.
893,915 professionals have used our research since 2012.