Try our new research platform with insights from 80,000+ expert users

Digital.ai Continuous Testing vs Perfecto comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 15, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Digital.ai Continuous Testing
Ranking in Mobile App Testing Tools
8th
Ranking in Test Automation Tools
21st
Average Rating
7.0
Reviews Sentiment
6.2
Number of Reviews
3
Ranking in other categories
AI-Augmented Software-Testing Tools (3rd)
Perfecto
Ranking in Mobile App Testing Tools
4th
Ranking in Test Automation Tools
23rd
Average Rating
8.4
Reviews Sentiment
7.4
Number of Reviews
23
Ranking in other categories
Performance Testing Tools (16th), Functional Testing Tools (15th)
 

Mindshare comparison

As of July 2025, in the Mobile App Testing Tools category, the mindshare of Digital.ai Continuous Testing is 1.8%, up from 1.6% compared to the previous year. The mindshare of Perfecto is 5.2%, down from 7.5% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Mobile App Testing Tools
 

Featured Reviews

Alan Chiou - PeerSpot reviewer
Has Mobile Studio feature which can generate scripts
The integration process was good, but I've faced some challenges. Every time they release a new version, I find bugs in the UI and features. Sometimes, buttons don't work well. When this happens, I submit a ticket to technical support, but they often have to fix it in the next version.
Roland Castelino - PeerSpot reviewer
Its reporting allows us to have a clear view regarding what tests have been executed
The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature. We leverage Perfecto’s reporting and analytics a lot. From the CI Dashboard, it is mainly the status, which is the past, failure count, and time consumption, e.g., how much time did an average test or script take? Along with that, it provides the historical view compared to the previous result, e.g., am I a pass or fail? Also, the stack trace is very important. Whenever a pass occurs, we don't look beyond that. However, whenever a failure occurs, the stack trace information that it gives us is pretty critical for us when figuring out where failures lie. It gives a summary for the pass/fail count, total test count, the historical view, time consumption for each test as well as the total tests, and the stack rate of the failure. Perfecto's analytics are very important since we use them on a daily basis. We run our executions daily. After every execution, we pull information from the Perfecto reporting system and share that with our stakeholders. Having this information accurately reported is pretty important for us, so everybody is aware of the current status of the product. That way, we can evaluate the health of the product or environment against that which has been executed. Therefore, it helps make those real-time decisions and highlights the impact to the business. I found Perfecto to be pretty easy to use while executing against cross-platforms. The main reason is because the same script or test automation where we execute on multiple platforms has minimal changes that I need to do. Also, it is easy for me to set up an execution on one platform, then on another platform, either in parallel or one after the other. Parallel opportunities save me time. Once the execution has been completed across these different configurations, I can always check and compare, e.g., what are the differences and consistencies? We utilize Perfecto’s cloud-based lab to test across devices, browsers, and OSs. I use it occasionally for manual testing. Though, there are other team members who use it more frequently than I do. I use it mainly for executing my automated tests. We have the Perfecto lab, cloud devices, and machines. I can program my test to execute against any of those devices, which gives me more confidence in my product. I can compare and see how my product or application functionally behaves across these different devices and from a UI point of view, which helps me a lot. The device lab is extremely important to our testing operations. We rely on having multiple devices up and running all the time. Whenever we kick off an execution, there are multiple reasons why executions may get triggered: * CodeCommit * A scheduled job. * Might be on-demand by any stakeholder. We need the lab to be available, as we need devices up and running for executions to take place. Also, the devices help since they allow us to have parallel execution, and not just wait for a sequential device to become free and available. Therefore, volume is definitely key. It also gives us an opportunity to compare execution across platforms in that space. It is extremely important to you that the lab provides same-day access to new devices since we analyze that data every single day after execution. Perfecto provides their own framework called Quantum Framework. That is one option. The other option is, if I want to have my own framework, I can have a Java-based Maven project, take a Selenium library, AppiumLibrary, and REST Assured library, and utilize the open-source framework. It is easy for us to connect to Perfecto, no matter what framework we use, as long as it has these core libraries in it. I can design and structure it any way that I want. The execution will happen in Perfecto no matter what since they have support for these tools or libraries. It is pretty neat that way. We are not dependent on using just one particular framework to use Perfecto. While there are still some framework limitations, there is the opportunity to use multiple, different open-source frameworks, then pass the execution to Perfecto. We can use most frameworks, then design and craft it any way that we want, then just pass the execution to Perfecto.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The most valuable part of Experitest is the number of real devices on which the test is run."
"Experitest is one of the only companies to offer a real device on the cloud to perform testing. They also provide quality documentations that help you navigate and maximize the solution."
"The most useful feature for me is Mobile Studio. It has a UI where I can click on elements, and it generates a script for me. Mobile Studio can generate code from testing steps. I'm using Python with it."
"We're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us."
"The number one feature, which if we didn't have out-of-the-box would be missed, is the fact that we have video execution. That gives us the ability to view errors or defects in the progression, from beginning to the end of the video."
"The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests."
"We are able to offer a quality product that has been tested fully, which improves our customer satisfaction. That is a good thing. It has also reduced our IT infrastructure cost. We don't have to spend a lot on setting up infrastructure, which becomes redundant or obsolete very soon. It helps in offsetting that cost."
"The most valuable aspect of the solution is that it covers all types of devices on the market allowing you to test different versions of an operating system."
"I also like the reporting functions. We are constantly downloading these reports and sharing them with our final customers. They help us understand what kind of bugs are happening through the applications. The recording feature is handy because it lets us see a video of the process we run through the pipeline and discover the point at which the automation is breaking."
"The most valuable feature is automated testing."
"In terms of cross-platform testing, they offer all of it, every device available in the market. It covers real scenarios that mimic production so that we don't miss out on any devices that our clients might be using to run the applications we develop. It's been great and very helpful."
 

Cons

"The integration process was good, but I've faced some challenges. Every time they release a new version, I find bugs in the UI and features. Sometimes, buttons don't work well. When this happens, I submit a ticket to technical support, but they often have to fix it in the next version."
"I would also like to see more videos and descriptions that could make installation more efficient."
"I have been automating tests for many years on many things but not on mobile devices. The amount of time that I have spent on just figuring out how to use Experitest and get it to work was quite long compared to what I have been doing before. I spent the first two weeks just getting it started. It would be good to have some video explanation of how to use it on your devices and get started. Their online documentation is quite good and extensive, but it would be quite good to have some end-to-end examples demonstrated."
"Previously, we used the cradle. Every time the mobile was blocking it, we would have to ask Perfecto to provide another one. That took a lot of time away from us."
"We have had some issues with performance, which is something that should be improved."
"I'm hoping that Perfecto will come up with browser testing as well because it would be easier to access it."
"Its performance should be improved. Anything to speed up the user interface would be a great help. We've had a lot of pain with their migration from a product UI that was based on Adobe Flash to the new product that is based on HTML5. Migrations like that seemed to be very painful and not a real smooth process. We're still sort of recovering from that migration from old technology to new, and we haven't got all the functionality ported over that we used to have on the old UI."
"It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution."
"If we could run an accessibility test in Perfecto against builds, it would help us a lot. Currently, that's a very manual process for us. We haven't found a tool that can do accessibility scans for iOS and doesn't depend on engineering effort. Having a feature related to that would be really awesome for us."
"The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well."
"It would be ideal if there was a complete integration with other test management tools and other applications like HPLM, Micro Focus, or Microsoft Azure."
 

Pricing and Cost Advice

"We make monthly payments. The cost is dependent on the number of devices we intend to support."
"The price is reasonable for our company, but I'm not the decision-maker."
"It is quite fairly priced, but it really depends on your budget. It is somewhere in the mid-range of products. It is not free and it is not QGP that nearly costs a whole house. You pay for the number of users who require access to execute the tests."
"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."
"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."
"This is an expensive solution compared to others, by 30% to 40%."
"It's definitely on the higher end of prices for this type of service."
"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."
"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."
"Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."
"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."
report
Use our free recommendation engine to learn which Mobile App Testing Tools solutions are best for your needs.
860,825 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
19%
Computer Software Company
19%
Retailer
9%
Insurance Company
9%
Financial Services Firm
24%
Computer Software Company
17%
Manufacturing Company
8%
Healthcare Company
5%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
 

Questions from the Community

What is your experience regarding pricing and costs for Digital.ai Continuous Testing?
The price is reasonable for our company, but I'm not the decision-maker.
What needs improvement with Digital.ai Continuous Testing?
The integration process was good, but I've faced some challenges. Every time they release a new version, I find bugs in the UI and features. Sometimes, buttons don't work well. When this happens, I...
What is your primary use case for Digital.ai Continuous Testing?
I'm using Digital.ai Continuous Testing to create and test a mobile application. We're developing and testing a mobile app.
Ask a question
Earn 20 points
 

Also Known As

Experitest Seetest, Experitest
Perfecto Mobile, Perfecto Web
 

Overview

 

Sample Customers

Samsung, American Express, Barclays, China Mobile, Citi, Cisco, McAfee
Virgin Media, Paychex, Rabobank, R+V, Discover
Find out what your peers are saying about Digital.ai Continuous Testing vs. Perfecto and other solutions. Updated: May 2025.
860,825 professionals have used our research since 2012.