AWS Device Farm vs SmartBear TestComplete Mobile comparison

Amazon Web Services (AWS) and SmartBear are both solutions in the Mobile App Testing Tools category. Amazon Web Services (AWS) is ranked #6 with an average rating of 7.0, while SmartBear is ranked #10 with an average rating of 8.0. Amazon Web Services (AWS) holds a 2.3% mindshare in MTT, compared to SmartBear’s 0.5% mindshare. Additionally, 50% of Amazon Web Services (AWS) users are willing to recommend the solution, compared to 100% of SmartBear users who would recommend it.

AWS Device Farm

Read 2 AWS Device Farm reviews

833 Views
379 Comparison Views

50% willing to recommend

SmartBear TestComplete Mobile

Read 3 SmartBear TestComplete Mobile reviews

86 Views
42 Comparison Views

100% willing to recommend

AWS Device Farm

SmartBear TestComplete Mobile

Comparison Buyer's Guide

Download the report

Executive SummaryUpdated on Mar 4, 2025

SmartBear TestComplete Mobile and AWS Device Farm serve in the mobile application testing category. AWS Device Farm generally has the upper hand with its robust cloud infrastructure and device coverage, despite SmartBear offering more budget-friendly pricing.

Features: SmartBear TestComplete Mobile includes strong scripting capabilities, compatibility with numerous programming languages, and smooth integration with development tools. AWS Device Farm offers scalable cloud testing with broad real-device support, enabling diverse testing scenarios and extensive device coverage.

Ease of Deployment and Customer Service: SmartBear TestComplete Mobile provides straightforward on-premises deployment and responsive customer support, ideal for teams focused on localized solutions. AWS Device Farm's cloud-based deployment allows flexible remote testing and wider device access, providing unmatched scalability.

Pricing and ROI: SmartBear TestComplete Mobile is cost-effective with accessible pricing, optimizing budget and delivering satisfactory ROI. AWS Device Farm has higher initial costs due to its premium cloud infrastructure, but offers long-term returns with extensive features. While SmartBear has a price advantage, AWS Device Farm's comprehensive features justify the investment.

To learn more, read our detailed AWS Device Farm vs. SmartBear TestComplete Mobile Report (Updated: April 2025).

Buyer's Guide

AWS Device Farm vs. SmartBear TestComplete Mobile

April 2025

Download the complete report

Helped 850,028 peers since 2012

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Categories and Ranking

AWS Device Farm

Ranking in Mobile App Testing Tools

6th

Average Rating

6.6

Reviews Sentiment

6.6

Number of Reviews

Ranking in other categories

No ranking in other categories

SmartBear TestComplete Mobile

Ranking in Mobile App Testing Tools

10th

Average Rating

8.0

Reviews Sentiment

6.7

Number of Reviews

Ranking in other categories

No ranking in other categories

Mindshare comparison

As of May 2025, in the Mobile App Testing Tools category, the mindshare of AWS Device Farm is 2.3%, down from 5.5% compared to the previous year. The mindshare of SmartBear TestComplete Mobile is 0.5%, up from 0.4% compared to the previous year. It is calculated based on PeerSpot user engagement data.

Mobile App Testing Tools

Featured Reviews

AshishSingh11

Automation Test Lead at Cap Gemini

A stable solution used for malware testing and APM that needs to improve its performance

The setup phase was fine because AWS had given the whole tree structure on their website. So, basically, if we go here and there apart from that tree structure, it does not support it. So they have a very sophisticated tree structure. So that is the only tree structure that we have to follow. Else, there will be problems. I rate the setup process a seven out of ten, with ten being the easiest setup. Since I had to study the solution, it took me a week to properly deploy it. I just followed the instructions given by AWS to deploy the solution. So on their website, whatever the steps they had given, I simply kept on following it.

Read full review

AhmedAllalen

Development team leader / APPR at a government with 501-1,000 employees

Clicking playback and detecting application needs improves functionality

There are complaints about not detecting all objects in the browser. I have to check and verify, and sometimes I have to bypass certain steps, which is a problem. I need to check the solution to understand why it's too detailed to detect or think of the browser. I use Chrome. Sometimes in Chrome, it doesn't detect certain elements in the web application. That's the problem. Also, when I run tests, I cannot export different types of logs in the same document. When I run different tests, it provides different logs, and these logs cannot be put in the same document. I have to compile them manually. Additionally, the tool can manage WinRamp scripts. I would say SilkTest also allows me to run tests, and I can challenge the sequencing, but it doesn't always do this correctly.

Read full review

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:

Pros

"What I like best about AWS Device Farm is that it offers actual physical devices that let you do more accurate testing because physical devices depict the live testing scenarios much better as opposed to emulated devices. AWS Device Farm is a pretty nice solution. Because it's an AWS service, you can use the CLI to tie in several steps that can create the pipeline, and run it efficiently. AWS Device Farm also gives you monitoring ability, observability, logging, etc., so I'm pretty satisfied with the solution."

"I rate the stability an eight out of ten."

"It is very effective for detecting breaks and also for verifying the needs of the application before deploying it or when introducing a new product."

"I like that it offers internal methods for supported controls. It is very easy to code the tests. Object Spy is also a good feature."

"The features I find most valuable is the automatic remapping of aliases, because it is really helpful."

Cons

"An area for improvement in AWS Device Farm is that it lacks a lot of features that would tie it in with other AWS services. The solution doesn't have great connectivity with other services offered by AWS, for example, AWS Secrets Manager. This should be improved because a lot of times, that missing functionality hampers the quality and engineering standards in terms of deploying the full AWS suite of services. What I'd like to see in the next version of AWS Device Farm is for it to link better, or have some type of enrollment that would tie it in with other AWS services, such as EventBridge, Lambda, Secrets Manager, and any other new service from AWS."

"It is slow. It is super slow. Performance is an area that can be improved."

"The mapping is pretty complicated because there are a lot of controls that are the same and if you have a long name with the object mapping it is easy to get confused."

"It is very difficult to use the aliases on old software."

"There are complaints about not detecting all objects in the browser."

Pricing and Cost Advice

"AWS Device Farm is an expensive service overall. You pay per device, and the cost for each device isn't cheap. My company paid for a device slot. It's a yearly subscription for a single device slot, so that's more cost-effective for my company. On a scale of one to five, where one is very expensive and five is very cheap, I'd give AWS Device Farm a two. It's on the more expensive side."

Information not available

See which vendors are best for you

Use our free recommendation engine to learn which Mobile App Testing Tools solutions are best for your needs.

See recommendations

850,028 professionals have used our research since 2012.

Top Industries

By visitors reading reviews

Financial Services Firm

27%

Computer Software Company

10%

Insurance Company

Manufacturing Company

No data available

Company Size

By reviewers

Large Enterprise

Midsize Enterprise

Small Business

No data available

Questions from the Community

What do you like most about AWS Device Farm?

I rate the stability an eight out of ten.

See all answers

What needs improvement with AWS Device Farm?

It is slow. It is super slow. Performance is an area that can be improved. Whenever we upload our Zip files to that particular platform, you know, it takes quite some time, especially if the file i...

See all answers

What is your primary use case for AWS Device Farm?

We have used the solution for malware testing and APM.

See all answers

What needs improvement with SmartBear TestComplete Mobile?

See all answers

What is your primary use case for SmartBear TestComplete Mobile?

The application is smaller than the transaction applications. It's a very delicate, complex application. Now I use it, however, it's just a test function for functional testing. I use TestComplete ...

See all answers

What advice do you have for others considering SmartBear TestComplete Mobile?

It's straightforward to use. I'd rate the solution eight out of ten.

See all answers

Comparisons

Perfecto vs AWS Device Farm

Compared 45% of the time

Tricentis Tosca vs AWS Device Farm

Compared 27% of the time

OpenText UFT Digital Lab vs AWS Device Farm

Compared 27% of the time

More AWS Device Farm Competitors

Eggplant Test vs SmartBear TestComplete Mobile

Compared 100% of the time

More SmartBear TestComplete Mobile Competitors

Product Reports

Buyer's Guide

Mobile App Testing Tools

March 2025

Download AWS Device Farm product report

Buyer's Guide

Mobile App Testing Tools

March 2025

Download SmartBear TestComplete Mobile product report

Overview

AWS Device Farm is an application testing service that lets you improve the quality of your web and mobile apps by testing them across an extensive range of desktop browsers and real mobile devices; without having to provision and manage any testing infrastructure. The service enables you to run your tests concurrently on multiple desktop browsers or real devices to speed up the execution of your test suite, and generates videos and logs to help you quickly identify issues with your app.

Amazon Web Services (AWS)

AUTOMATE UI TESTING FOR ANY IOS OR ANDROID APP

Use script-free record and replay or choose from six languages, including Python and JavaScript, to create test automation scripts. Record repeatable and consistent gestures across any mobile device. Get full device control when creating automated UI tests. There is no modify or jail-break the app.

Separate the UI object identification from the test logic to build stable, easy-to-maintain automated tests. Seamless integration available with build server, source control systems, and defect management tools allows you to run automated mobile UI tests around the clock.

SmartBear

Sample Customers

NFL, Etsy, Tableau, Gannett, Miniclip, Allstate, Rainforest, goibibo, mysmartprice, Zillow

Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit

Buyer's Guide

AWS Device Farm vs. SmartBear TestComplete Mobile

April 2025

Free Report: AWS Device Farm vs. SmartBear TestComplete Mobile

Find out what your peers are saying about AWS Device Farm vs. SmartBear TestComplete Mobile and other solutions. Updated: April 2025.

DOWNLOAD NOW

850,028 professionals have used our research since 2012.

See our AWS Device Farm vs. SmartBear TestComplete Mobile report.

See our list of best Mobile App Testing Tools vendors.

We monitor all Mobile App Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.