We performed a comparison between AWS Device Farm and SmartBear TestComplete Mobile based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Mobile App Testing Tools."I rate the stability an eight out of ten."
"What I like best about AWS Device Farm is that it offers actual physical devices that let you do more accurate testing because physical devices depict the live testing scenarios much better as opposed to emulated devices. AWS Device Farm is a pretty nice solution. Because it's an AWS service, you can use the CLI to tie in several steps that can create the pipeline, and run it efficiently. AWS Device Farm also gives you monitoring ability, observability, logging, etc., so I'm pretty satisfied with the solution."
"I like that it offers internal methods for supported controls. It is very easy to code the tests. Object Spy is also a good feature."
"The features I find most valuable is the automatic remapping of aliases, because it is really helpful."
"It is slow. It is super slow. Performance is an area that can be improved."
"An area for improvement in AWS Device Farm is that it lacks a lot of features that would tie it in with other AWS services. The solution doesn't have great connectivity with other services offered by AWS, for example, AWS Secrets Manager. This should be improved because a lot of times, that missing functionality hampers the quality and engineering standards in terms of deploying the full AWS suite of services. What I'd like to see in the next version of AWS Device Farm is for it to link better, or have some type of enrollment that would tie it in with other AWS services, such as EventBridge, Lambda, Secrets Manager, and any other new service from AWS."
"The mapping is pretty complicated because there are a lot of controls that are the same and if you have a long name with the object mapping it is easy to get confused."
"It is very difficult to use the aliases on old software."
Earn 20 points
AWS Device Farm is ranked 5th in Mobile App Testing Tools with 2 reviews while SmartBear TestComplete Mobile is ranked 14th in Mobile App Testing Tools. AWS Device Farm is rated 6.6, while SmartBear TestComplete Mobile is rated 8.0. The top reviewer of AWS Device Farm writes " A stable solution used for malware testing and APM that needs to improve its performance". On the other hand, the top reviewer of SmartBear TestComplete Mobile writes "We are facing sometimes the situation when we have some issues with our automated tests". AWS Device Farm is most compared with Perfecto, Tricentis Tosca, Kobiton Mobile Device Testing, OpenText UFT Digital Lab and pCloudy, whereas SmartBear TestComplete Mobile is most compared with OpenText UFT Digital Lab.
See our list of best Mobile App Testing Tools vendors.
We monitor all Mobile App Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.