No more typing reviews! Try our Samantha, our new voice AI agent.

AWS Device Farm vs Perfecto comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Mar 4, 2025

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

AWS Device Farm
Ranking in Mobile App Testing Tools
11th
Average Rating
6.6
Reviews Sentiment
6.6
Number of Reviews
2
Ranking in other categories
No ranking in other categories
Perfecto
Ranking in Mobile App Testing Tools
6th
Average Rating
8.4
Reviews Sentiment
7.4
Number of Reviews
23
Ranking in other categories
Performance Testing Tools (13th), Functional Testing Tools (20th), Test Automation Tools (21st)
 

Mindshare comparison

As of August 2026, in the Mobile App Testing Tools category, the mindshare of AWS Device Farm is 2.5%, up from 2.2% compared to the previous year. The mindshare of Perfecto is 6.6%, up from 5.0% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Mobile App Testing Tools Mindshare Distribution
ProductMindshare (%)
Perfecto6.6%
AWS Device Farm2.5%
Other90.9%
Mobile App Testing Tools
 

Featured Reviews

AshishSingh11 - PeerSpot reviewer
Automation Test Lead at Cap Gemini
A stable solution used for malware testing and APM that needs to improve its performance
The setup phase was fine because AWS had given the whole tree structure on their website. So, basically, if we go here and there apart from that tree structure, it does not support it. So they have a very sophisticated tree structure. So that is the only tree structure that we have to follow. Else, there will be problems. I rate the setup process a seven out of ten, with ten being the easiest setup. Since I had to study the solution, it took me a week to properly deploy it. I just followed the instructions given by AWS to deploy the solution. So on their website, whatever the steps they had given, I simply kept on following it.
MB
Manager and Platform Lead, Canadian Digital Banking at BMO
For Java code, we can see at exactly which step something failed, and we catch issues a lot earlier
In terms of cross-platform testing, I have used it mostly for the web and it's pretty strong. It's probably an eight out of 10. The reason it's an eight is that we've had a couple of issues lately with videos not loading or browsers dying after some execution, although that happens very rarely. For mobile, from what I have seen, it's probably also an eight out of 10. One thing they need to have is physical devices. And I am hoping in the future that there will be more virtual devices. Also, there is some error tagging that you can do in Perfecto, but it didn't work very well when I was using it. I wish that you could tag it with an error message per test case and it would be done automatically, instead of manually. In addition, if Perfecto could use AI to say, "Your environment is stable," or "not stable," and give a score on that, that would be really helpful. It could notify us through email. That would help, aside from the failed and passed test cases. It would be something more intelligent. If there were certain tags with certain errors and there were a certain number of them, it could tell us if login was broken in the environment, for example. There's definitely a little bit of room for improvement in terms of AI.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"What I like best about AWS Device Farm is that it offers actual physical devices that let you do more accurate testing because physical devices depict the live testing scenarios much better as opposed to emulated devices. AWS Device Farm is a pretty nice solution. Because it's an AWS service, you can use the CLI to tie in several steps that can create the pipeline, and run it efficiently. AWS Device Farm also gives you monitoring ability, observability, logging, etc., so I'm pretty satisfied with the solution."
"I rate the stability an eight out of ten."
"Performance-wise, Perfecto has been awesome."
"We're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us."
"Perfecto has affected our software quality in a good way. It has allowed us to execute on-demand and on-choice. We also track the number of issues that we find in the product. Every single day, we tag the issues that we found. For example, if something was found by automation, that means it was found by a Perfecto execution. Over time, we realized the real value in tracking those numbers. We can see now that we have clearly been finding issues earlier. It has allowed us to catch our defects earlier, thus improving the quality of our applications."
"In terms of cross-platform testing, they offer all of it, every device available in the market. It covers real scenarios that mimic production so that we don't miss out on any devices that our clients might be using to run the applications we develop. It's been great and very helpful."
"We have seen the biggest improvement in cost savings, initially saving $2.6 million a year just on roaming charges."
"Perfecto has affected our software quality in a good way; it has allowed us to catch our defects earlier, thus improving the quality of our applications."
"Perfecto is part of our testing life; when we test, we do it in Perfecto, and without it, our team would not be able to perform testing on mobile devices."
"Perfecto's device lab has helped us to scale our testing and it has made testing easier for us."
 

Cons

"An area for improvement in AWS Device Farm is that it lacks a lot of features that would tie it in with other AWS services. The solution doesn't have great connectivity with other services offered by AWS, for example, AWS Secrets Manager. This should be improved because a lot of times, that missing functionality hampers the quality and engineering standards in terms of deploying the full AWS suite of services. What I'd like to see in the next version of AWS Device Farm is for it to link better, or have some type of enrollment that would tie it in with other AWS services, such as EventBridge, Lambda, Secrets Manager, and any other new service from AWS."
"An area for improvement in AWS Device Farm is that it lacks a lot of features that would tie it in with other AWS services."
"It is slow. It is super slow. Performance is an area that can be improved."
"When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good."
"In iOS, it needs improvements with some limitations."
"It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution."
"We don't use Perforce's BlazeMeter with Perfecto. From my perspective, it's not really relevant."
"It would be nice if there were some kind of AI to compile a list of available devices. Currently, we have to look at the web interface to see the available devices, but the pipelines can't do it on their own there. We always need to do this manually, so it would be better if this feature were automated."
"There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools."
"I'm hoping they can support on-premises instances."
"We've had a couple of issues lately with videos not loading or browsers dying after some execution, although that happens very rarely."
 

Pricing and Cost Advice

"AWS Device Farm is an expensive service overall. You pay per device, and the cost for each device isn't cheap. My company paid for a device slot. It's a yearly subscription for a single device slot, so that's more cost-effective for my company. On a scale of one to five, where one is very expensive and five is very cheap, I'd give AWS Device Farm a two. It's on the more expensive side."
"It's definitely on the higher end of prices for this type of service."
"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."
"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."
"This is an expensive solution compared to others, by 30% to 40%."
"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."
"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."
"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."
"Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."
report
Use our free recommendation engine to learn which Mobile App Testing Tools solutions are best for your needs.
910,005 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Outsourcing Company
19%
Financial Services Firm
10%
Consumer Goods Company
10%
Computer Software Company
9%
Financial Services Firm
19%
Construction Company
12%
Outsourcing Company
8%
Healthcare Company
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
No data available
By reviewers
Company SizeCount
Small Business1
Midsize Enterprise1
Large Enterprise23
 

Also Known As

No data available
Perfecto Mobile, Perfecto Web
 

Overview

 

Sample Customers

NFL, Etsy, Tableau, Gannett, Miniclip, Allstate, Rainforest, goibibo, mysmartprice, Zillow
Virgin Media, Paychex, Rabobank, R+V, Discover
Find out what your peers are saying about AWS Device Farm vs. Perfecto and other solutions. Updated: August 2026.
910,005 professionals have used our research since 2012.