We performed a comparison between AWS Device Farm and HeadSpin based on real PeerSpot user reviews.
Find out in this report how the two Mobile App Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."What I like best about AWS Device Farm is that it offers actual physical devices that let you do more accurate testing because physical devices depict the live testing scenarios much better as opposed to emulated devices. AWS Device Farm is a pretty nice solution. Because it's an AWS service, you can use the CLI to tie in several steps that can create the pipeline, and run it efficiently. AWS Device Farm also gives you monitoring ability, observability, logging, etc., so I'm pretty satisfied with the solution."
"I rate the stability an eight out of ten."
"The most valuable feature is that this is the first connected intelligence all-in-one platform."
"The most valuable feature of HeadSpin it's the integration with other solutions. It is great. I can search for an element or do a quick debugging on the application right on HeadSpin. It's very useful."
"It has an interesting feature called AV box testing. A lot of companies that are in the OTT segment don't really understand what their streaming is like. They can't test for streaming quality. There are restrictions where you cannot simulate live streaming. For example, on Netflix, you can't simulate how a movie is being streamed on a remote device. That's why HeadSpin has got this AV box testing feature. It is a patented feature. They send an AV box to your location, and you can test live streaming, which is something that no other company does."
"The technical support is really helpful because we can set up direct calls with them if we want to. We can use Zoom or Google Meet to interact with them directly, and if there is an issue in our system, they will help us by reproducing the issue in their machines and trying to figure out a solution. The support is really smooth, and we like that they're very supportive."
"The most valuable features of the product are the performance parameters it gives us."
"The initial setup of HeadSpin was very easy and user-friendly. It was easy to configure and write a script."
"It is slow. It is super slow. Performance is an area that can be improved."
"An area for improvement in AWS Device Farm is that it lacks a lot of features that would tie it in with other AWS services. The solution doesn't have great connectivity with other services offered by AWS, for example, AWS Secrets Manager. This should be improved because a lot of times, that missing functionality hampers the quality and engineering standards in terms of deploying the full AWS suite of services. What I'd like to see in the next version of AWS Device Farm is for it to link better, or have some type of enrollment that would tie it in with other AWS services, such as EventBridge, Lambda, Secrets Manager, and any other new service from AWS."
"They should automate their onboarding. A lot of things are still manual. They can create a video assistant or something like that to completely automate the entire process."
"Sometimes, devices go offline and some features are not functioning on some devices, specifically on iOS."
"If you want to do some testing or check the devices manually or check the application in a particular device manually, it is really laggy. That's a disappointment because sometimes we would like to do manual testing when our local devices are not available."
"HeadSpin needs to improve the hardware. With the mobile, the battery life reduces and must be continuously charged."
"HeadSpin could improve on the user interface because it is very poor. The checks that are done on the iOS devices are very difficult, but for Android, it runs great. For all iOS devices, the user interface and how it interacts with the device are very poor."
"Support and pricing could be improved."
AWS Device Farm is ranked 5th in Mobile App Testing Tools with 2 reviews while HeadSpin is ranked 7th in Mobile App Testing Tools with 6 reviews. AWS Device Farm is rated 6.6, while HeadSpin is rated 8.0. The top reviewer of AWS Device Farm writes " A stable solution used for malware testing and APM that needs to improve its performance". On the other hand, the top reviewer of HeadSpin writes "It fulfills everything from automation to manual performance". AWS Device Farm is most compared with Perfecto, Tricentis Tosca, Kobiton Mobile Device Testing, OpenText UFT Digital Lab and Digital.ai Continuous Testing, whereas HeadSpin is most compared with Perfecto, Sauce Labs, BrowserStack, Tricentis Tosca and Selenium HQ. See our AWS Device Farm vs. HeadSpin report.
See our list of best Mobile App Testing Tools vendors.
We monitor all Mobile App Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.