AWS Device Farm vs Perfecto comparison

Amazon Web Services (AWS) and Perforce are both solutions in the Mobile App Testing Tools category. Amazon Web Services (AWS) is ranked #7, while Perforce is ranked #4. Amazon Web Services (AWS) holds a 3.4% mindshare in MTT, compared to Perforce’s 5.8% mindshare. Additionally, 50% of Amazon Web Services (AWS) users are willing to recommend the solution, compared to 88% of Perforce users who would recommend it.

AWS Device Farm

Read 2 AWS Device Farm reviews

519 Views
472 Comparison Views

50% willing to recommend

Perfecto

Read 23 Perfecto reviews

3,624 Views
652 Comparison Views

88% willing to recommend

AWS Device Farm

Perfecto

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Mar 4, 2025

Perfecto and AWS Device Farm compete in the mobile app testing space. Perfecto generally has the upper hand with its robust feature set appealing to enterprises needing comprehensive testing.

Features: Perfecto provides automated and manual testing, real-time data insights, and cross-platform support. AWS Device Farm offers seamless integration with AWS services, flexible testing protocols, and a broad device range.

Ease of Deployment and Customer Service: Perfecto ensures efficient deployment with a smooth setup process and dedicated customer support. AWS Device Farm benefits from AWS’s infrastructure, offering reliable deployment, though its customer service may lack the personalization Perfecto offers.

Pricing and ROI: Perfecto requires higher initial investment but yields significant ROI with advanced features. AWS Device Farm's pay-as-you-go pricing is budget-friendly, offering excellent ROI for businesses with existing AWS platforms.

To learn more, read our detailed AWS Device Farm vs. Perfecto Report (Updated: March 2026).

Buyer's Guide

AWS Device Farm vs. Perfecto

March 2026

Download the complete report

Helped 885,667 peers since 2012

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Categories and Ranking

AWS Device Farm

Ranking in Mobile App Testing Tools

7th

Average Rating

6.6

Reviews Sentiment

6.6

Number of Reviews

Ranking in other categories

No ranking in other categories

Perfecto

Ranking in Mobile App Testing Tools

4th

Average Rating

8.4

Reviews Sentiment

7.4

Number of Reviews

Ranking in other categories

Performance Testing Tools (15th), Functional Testing Tools (14th), Test Automation Tools (20th)

Mindshare comparison

As of April 2026, in the Mobile App Testing Tools category, the mindshare of AWS Device Farm is 3.4%, up from 2.3% compared to the previous year. The mindshare of Perfecto is 5.8%, up from 5.1% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Mobile App Testing Tools Mindshare Distribution
Product	Mindshare (%)
Perfecto	5.8%
AWS Device Farm	3.4%
Other	90.8%

Mobile App Testing Tools

Featured Reviews

AshishSingh11

Automation Test Lead at Cap Gemini

A stable solution used for malware testing and APM that needs to improve its performance

The setup phase was fine because AWS had given the whole tree structure on their website. So, basically, if we go here and there apart from that tree structure, it does not support it. So they have a very sophisticated tree structure. So that is the only tree structure that we have to follow. Else, there will be problems. I rate the setup process a seven out of ten, with ten being the easiest setup. Since I had to study the solution, it took me a week to properly deploy it. I just followed the instructions given by AWS to deploy the solution. So on their website, whatever the steps they had given, I simply kept on following it.

Read full review

Glenford John

Product Manager, Device Integration at a comms service provider with 10,001+ employees

Saves us $2.6 million per year, provides more efficient testing, and helps us strengthen relationships with vendors

The automation piece is the most valuable feature. Every time we had a new version of either OS or an application, we found that being able to automate the testing across different devices is very valuable. Perfecto is great at executing cross-platform testing. From a carrier perspective, it's all mobile, but we also have web applications. We used to be able to test on Symbian, Windows OS, Android, and iOS. Today, we can go on a big screen and test on Chrome, Firefox, Explorer, and other browsers. My team leverages Perfecto's reporting and analytics. When we start stress testing an application, we can look at all the reporting that comes from that, and we can tell at what part of the day the app is performing better. Our analytics are very important to us. Presentations are important, so it's good to have reports with graphs that show the time of day or how the app was performing for months at a time. We use those reports to screen capture, go with the data, and to show to upper management. We can do a comparison of one version performance to another version of the application or device performance. We utilize Perfecto's cloud-based lab to test across devices, browsers, and OSs. We are a carrier, so we have our devices with different OS versions of devices. Right now, it's mostly just Apple and Androids. Back in the day, they had many different versions of the OS, but the only other thing on top of that is web-based browsers. We don't test Linux, which is an operating system of Windows. We don't use Perfecto's cloud. We use our own devices because we test on only our organization's devices. Unless we do some kind of competitive analysis, it's not really a test; it's just a comparison to see how other solutions compare to ours. The range of open-source technologies that Perfecto supports is great. I have a team of contractors that report to me and do all the testing for our organization, and that team turns over every couple of years. We mostly utilize the in-house automation that is available for anyone who isn't a great programmer. They have support for all these other drivers, and they have something for non-programmers who want to automate their work, which is amazing.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"What I like best about AWS Device Farm is that it offers actual physical devices that let you do more accurate testing because physical devices depict the live testing scenarios much better as opposed to emulated devices. AWS Device Farm is a pretty nice solution. Because it's an AWS service, you can use the CLI to tie in several steps that can create the pipeline, and run it efficiently. AWS Device Farm also gives you monitoring ability, observability, logging, etc., so I'm pretty satisfied with the solution."

"I rate the stability an eight out of ten."

"In terms of Perfecto's ability to perform cross-platform testing, I would rate it a ten out of ten."

"The number one feature, which if we didn't have out-of-the-box would be missed, is the fact that we have video execution. That gives us the ability to view errors or defects in the progression, from beginning to the end of the video."

"Overall, it's a great solution."

"Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every new release would be a difficult task. But with Perfecto, it is easy."

"Overall, it has helped massively to speed up our testing efforts and not just from a device point of view."

"Their team is really great to work with. They're very flexible, and they always show care. They prioritize our work, our company, and our working relationship. I appreciate the ad hoc sessions that they schedule to provide help with troubleshooting, provide the information that we're looking for, or do a demo of a new feature that they have. They're always willing and very quick to get that scheduled for us. I appreciate that a lot."

"One of the good things about Perfecto is the scalability that it provides, as we are able to quickly scale up the devices and choose Android devices, web-based applications, or whatever we need, and we can scale up quickly and easily."

"Perfecto has affected our software quality in a good way. It has allowed us to execute on-demand and on-choice. We also track the number of issues that we find in the product. Every single day, we tag the issues that we found. For example, if something was found by automation, that means it was found by a Perfecto execution. Over time, we realized the real value in tracking those numbers. We can see now that we have clearly been finding issues earlier. It has allowed us to catch our defects earlier, thus improving the quality of our applications."

More Perfecto pros

Cons

"An area for improvement in AWS Device Farm is that it lacks a lot of features that would tie it in with other AWS services."

"It is slow. It is super slow. Performance is an area that can be improved."

"An area for improvement in AWS Device Farm is that it lacks a lot of features that would tie it in with other AWS services. The solution doesn't have great connectivity with other services offered by AWS, for example, AWS Secrets Manager. This should be improved because a lot of times, that missing functionality hampers the quality and engineering standards in terms of deploying the full AWS suite of services. What I'd like to see in the next version of AWS Device Farm is for it to link better, or have some type of enrollment that would tie it in with other AWS services, such as EventBridge, Lambda, Secrets Manager, and any other new service from AWS."

"We feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required."

"The flakiness, or the accuracy, of the test execution can be improved."

"We've had a couple of issues lately with videos not loading or browsers dying after some execution, although that happens very rarely."

"We have had some issues with performance, which is something that should be improved."

"On the analytics side, Perfecto is in need of improvement."

"So, overall, I would rate Perfecto a seven out of ten because sometimes, we also have lagging with some of the devices. We get error messages, but we're not quite sure what's causing them."

"It would be nice if there were some kind of AI to compile a list of available devices. Currently, we have to look at the web interface to see the available devices, but the pipelines can't do it on their own there. We always need to do this manually, so it would be better if this feature were automated."

"The monitoring features, in particular network traffic monitoring, could be improved."

More Perfecto cons

Pricing and Cost Advice

"AWS Device Farm is an expensive service overall. You pay per device, and the cost for each device isn't cheap. My company paid for a device slot. It's a yearly subscription for a single device slot, so that's more cost-effective for my company. On a scale of one to five, where one is very expensive and five is very cheap, I'd give AWS Device Farm a two. It's on the more expensive side."

"Although Perfecto is a good product for us to use, it is a bit expensive. It takes management a bit of work to find the appropriate funding for us to keep Perfecto. I imagine there could be some way to make it more accessible."

"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."

"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."

"Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."

"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."

"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."

"This is an expensive solution compared to others, by 30% to 40%."

"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."

More Perfecto pricing and cost advice

See which vendors are best for you

Use our free recommendation engine to learn which Mobile App Testing Tools solutions are best for your needs.

See recommendations

885,667 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

15%

Outsourcing Company

12%

Computer Software Company

Consumer Goods Company

Financial Services Firm

21%

Computer Software Company

Construction Company

Manufacturing Company

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

No data available

By reviewers
Company Size	Count
Small Business	1
Midsize Enterprise	1
Large Enterprise	23

Comparisons

OpenText Functional Testing Lab for Mobile and Web vs AWS Device Farm

Compared 16% of the time

Eggplant Test vs AWS Device Farm

Compared 15% of the time

Kobiton Mobile Device Testing vs AWS Device Farm

Compared 14% of the time

pCloudy vs AWS Device Farm

Compared 14% of the time

Tricentis Tosca vs AWS Device Farm

Compared 13% of the time

More AWS Device Farm Competitors

BrowserStack vs Perfecto

Compared 17% of the time

Sauce Labs vs Perfecto

Compared 13% of the time

Appium vs Perfecto

Compared 5% of the time

TestMu AI (Formerly LambdaTest) vs Perfecto

Compared 5% of the time

OpenText Functional Testing vs Perfecto

Compared 4% of the time

More Perfecto Competitors

Product Reports

Buyer's Guide

Mobile App Testing Tools

March 2026

Download AWS Device Farm product report

Buyer's Guide

Perfecto

March 2026

Download Perfecto product report

Also Known As

No data available

Perfecto Mobile, Perfecto Web

Overview

AWS Device Farm is an application testing service that lets you improve the quality of your web and mobile apps by testing them across an extensive range of desktop browsers and real mobile devices; without having to provision and manage any testing infrastructure. The service enables you to run your tests concurrently on multiple desktop browsers or real devices to speed up the execution of your test suite, and generates videos and logs to help you quickly identify issues with your app.

Amazon Web Services (AWS)

Perfecto is a cloud-based mobile app testing tool that is designed to help test applications on different operating systems and devices. The solution lets users automate processes related to advanced test scenarios and access browser versions and devices according to individual requirements. With Perfecto’s smart test execution capabilities, teams can manage testing across web and mobile platforms using a single script, conduct parallel testing for large test suites, and design advanced user-based test scenarios to accelerate app release cycles. The solution is also helpful for IT departments, providing insights into biometrics, device vitals, audio injection, network throttling, packet loss, and rotation data to meet desired end-user conditions that align with business priorities.

Perfecto Features

Perfecto has many valuable key features. Some of the most useful ones include:

Live Stream analysis
Reporting/analytics
Activity dashboard
Action-word testing
Bug tracking
Debugging
BDD & codeless automation
Model-based testing
Real-time monitoring
Role-based permissions
User management
Test failure analysis
Real user simulation

Perfecto Benefits

There are many benefits to implementing Perfecto. Some of the biggest advantages the solution offers include:

Streamlined test creation: When you use Perfecto, test creation is easy for your teams. Testing frameworks, like Appium, allows you to scale automated test scripts without any issues.

Scalable test execution: Perfecto enables you to accelerate your mobile app testing and is elastically-scaled with no single point of failure, so you can get the testing cadence you need. In addition, the solution makes it possible for you to execute tests from within IDEs as well as through CI servers like Jenkins.

Superior application quality for mobile: By using Perfecto, you can maximize continuous testing and shift quality by combining the solution with BlazeMeter. Together, these two solutions can help you measure mobile user experience, produce high-quality test data on demand, and create realistic mock services.

AI-driven test automation dashboards: The solution’s unique dashboards and heatmaps give you high-level visibility with timelines and trends.

Cloud-based lab: Perfecto’s Smart Testing Lab gives you the tools you need to quickly test your mobile app against thousands of permutations.

Reviews from Real Users

Perfecto is a solution that stands out when compared to many of its competitors. Some of its major advantages are that it has fantastic testing, reporting, and automation capabilities.

Roland C., QA Lead at BMO Financial, says, “The most valuable would be their Live Stream analysis, where I can see the live analysis of all the executions on a single device or multiple devices as well as track them. The live analysis and reporting would be the single most valuable feature.”

Andy B., Systems Engineer at a financial services firm, writes, “I really love the interaction it has with mobile devices, the testing capabilities, as well as reporting capabilities that we get from the application. Perfecto is excellent when it comes to executing cross-platform testing.”

A Director, QE Automation & Analytics at a financial services firm, says, “The most valuable feature is cloud-based automation and testing.”

Another PeerSpot reviewer, Kristina B., Product Manager at a manufacturing company, states, “The solution allows us to do seamless cross-platform testing, saves time, and comes with excellent customer service.”

Perforce

Sample Customers

NFL, Etsy, Tableau, Gannett, Miniclip, Allstate, Rainforest, goibibo, mysmartprice, Zillow

Virgin Media, Paychex, Rabobank, R+V, Discover

Buyer's Guide

AWS Device Farm vs. Perfecto

March 2026

Free Report: AWS Device Farm vs. Perfecto

Find out what your peers are saying about AWS Device Farm vs. Perfecto and other solutions. Updated: March 2026.

DOWNLOAD NOW

885,667 professionals have used our research since 2012.

See our AWS Device Farm vs. Perfecto report.

See our list of best Mobile App Testing Tools vendors.

We monitor all Mobile App Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.