We performed a comparison between Sauce Labs, Visual Studio Test Professional, and Zeenyx AscentialTest based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."The insights section provides a great overall state of the automation suite and can identify trends relatively quickly. If we see a dip in our passing rate over time, we can look at what changed when the test started failing to find the root cause rather than doing a quick fix to find that the test fails a short time later."
"I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"The most valuable feature is the cross-browser feature, it has many android and iOS devices both simulators and real devices. It's easy to integrate. I also like video recording too."
"It has a wide assortment of platforms."
"I have found the live test section with Sauce Labs to be extremely valuable. When you can't quite figure out why a test is failing, you can go to the live test results section within their tool and launch your test (specifying a given OS/browser, or device) manually and step through the test to see the issue more clearly, usually opening up the developer's tool console and watching the network calls and console (within Chrome) to usually find the underlying issue."
"It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers."
"From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams."
"One of the best documentation in the world."
"It is very easy to use. You can handle a lot of things together at once in one package, which is a good point for us."
"The product is good to create big or small projects fastly. It is one of the leaders in the area."
"The most valuable features of the solution are its ease of use and availability."
"The solution is easy to use and they have also integrated with Microsoft."
"The tool has highly detailed debugging features."
"Easy to use and easily scalable."
"Visual Studio is an exemplary integrated development environment that stands out due to its exceptional features. It allows for the seamless selection of the appropriate programming language for the specific development tasks at hand. This facilitates a swift and effortless transition between languages, providing a highly efficient development experience."
"AscentialTest's object recognition in snapshots is a robust feature that goes beyond standard elements, even accurately identifying objects within Datawindows."
"The most valuable feature of AscentialTest for us is that it fully supports PowerBuilder."
"It’s been really easy to automate the same application TestComplete struggled with. I have been able to automate two of our key applications in just a few months. I haven’t even taken their training."
"If you use the PowerBuilder application, do choose AscentialTest without thinking twice."
"The testing process is difficult. I need to prove the complete competency of the tool, and I am finding that challenging."
"Another feature that could still be improved on is more error clarity. Sometimes when running automated scripts the test will fail on the device side instead of the script and errors only show a 500 try again message instead of a detailed script that could of a been a timeout error from the code."
"One of the challenging areas for us is the reporting and the matrix. It should be based on roles, but right now it is only available for the admin role. The admin role can really do a lot of stuff, but our infrastructure team, which holds the admin role, is not ready to hand it over to us on the testing team. If Sauce Labs had permissions associated with roles, where this role could do this activity and that role could do that activity, it would be easier for us."
"I would like to see improved network connectivity and it should allow playback for native apps."
"The one issue I have is the 14-day trial that a new user gets for free. I understand the concept of the trial period; however, I think this could be revamped to a free 30-minute run time every few months or after a significant update once the trial period has ended."
"Sometimes pasting text while using "text object" does not seem to work, and it slows down testing times quite a bit."
"The ability to configure the memory and CPU for the test machines should be included."
"Every time that we run scenarios where we need to discover the geolocation of our customers, by default it shows as Palo Alto, California. That's a problem for us and we need a workaround for those cases... It would be helpful if we could enter a latitude and longitude into Sauce Labs configuration and say, "When you run a virtual Chrome device or an iPhone, make this your default location. Then, provide me that device so I can run my scenarios," because we have stores in different regions across the United States."
"The integration with Git needs improving because it is a bit disjointed and unpredictable."
"The solution's documentation could be improved because it keeps disappearing from the solution."
"The price is reasonable, but it's not the best."
"One of the problems with this solution is you need to be highly technically skilled to operate it, it is not for everyone."
"The tool crashes and has high memory consumption."
"It needs more integration with other tools for monitoring. Microsoft also needs to make it more modern to make it work with microservices and the cloud. It is a bit outdated currently."
"It could be available for multiple platforms and other operating systems like Mac with a native port."
"The solution should be cheaper."
"Classes are not as object-oriented as I would like, but I am a programmer and not QA so I expect a lot."
"Streamlining the retrieval of results from individual test set runs would be beneficial."
"The only thing I can't wait for is for Zeenyx to add automating Mobile apps."
"I would like to see an improvement in the User Interface."
More Visual Studio Test Professional Pricing and Cost Advice →
