We performed a comparison between Sauce Labs, Selenium HQ, and Zeenyx AscentialTest based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"It has a wide assortment of platforms."
"Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"It has significantly enhanced our testing accuracy by approximately 50%."
"The Failure Analysis feature is really important for us, one of the most important aspects. What is the root cause? Is it because we have a defect or is it that we have a test case that we need to fix or modify? The Failure Analysis is one of the main functionalities that I am exploring all the time in Sauce Labs... The Failure Analysis helps us to discover which test cases we need to work on."
"Since this is an all-in-one testing site, we are able to take advantage of the browser OS combinations, mobile emulators and simulators, and real mobile devices. This is important to us since we have a variety of users, browsers, OS, etc."
"Sauce Labs provides us with more combinations to test, so we can keep adding platforms and devices to our network. That's been a very seamless experience. Let's say there's an iOS or a private device we need. Sauce Labs has helped get all those set up when needed."
"I like its simplicity."
"The solution is very easy to use. Once you learn how to do things, it becomes very intuitive and simple."
"What I like the most about this product is that it gives us a lot of freedom to code anything, there is no restriction on the type of function you can do."
"Our platform runs into several thousand screens and a few thousand test cases, something which would typically take months to test manually. As of today, the entire process takes a little over two days to run."
"The main characteristic that is useful is that the tool is completely free."
"The most valuable features of Selenium HQ are it is open-source, has a good interface, and integrates well."
"My customer previously validated every file and it would take almost 15-20 minutes for a document. They used to randomly select and test only 100 out of the thousands, maybe 85,000, files, to pick up sampling. Each file would take around 20 to 25 minutes, so we were not able to do it manually, but with the help of Selenium, we were able to test all the files in two days. It saves a lot of time."
"The solution is free to use."
"The most valuable feature of AscentialTest for us is that it fully supports PowerBuilder."
"It’s been really easy to automate the same application TestComplete struggled with. I have been able to automate two of our key applications in just a few months. I haven’t even taken their training."
"AscentialTest's object recognition in snapshots is a robust feature that goes beyond standard elements, even accurately identifying objects within Datawindows."
"If you use the PowerBuilder application, do choose AscentialTest without thinking twice."
"Sauce Labs needs to be improved in the different platforms for farm testing, like iOS and Android farm testing and farm testing web browsers."
"One of the challenging areas for us is the reporting and the matrix. It should be based on roles, but right now it is only available for the admin role. The admin role can really do a lot of stuff, but our infrastructure team, which holds the admin role, is not ready to hand it over to us on the testing team. If Sauce Labs had permissions associated with roles, where this role could do this activity and that role could do that activity, it would be easier for us."
"An image comparison would be a nice feature to include in the Sauce Labs product."
"This product is not super scalable, because you have a very specific number of VMs that you can use."
"We have had some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt."
"Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time."
"Better and programmatic controls on request/response recordings and sharing with developers."
"Unable to segregate reports for tests that are currently being developed, and might not be returning useful results."
"The drawback is the solution is not easy to learn."
"We can only use Selenium HQ for desktop applications which would be helpful. We are only able to do online based applications."
"I would like for the next release to support parallel testing."
"Selenium HQ could have better interaction with SAP products."
"The initial setup of Selenium HQ is difficult in many areas, such as the framework."
"It would be very helpful to be able to write scripts in a GUI, rather than depend so heavily on the command line."
"It would be better if we could use it without having the technical skills to run the scripting test."
"The latest versions are often unstable."
"I would like to see an improvement in the User Interface."
"The only thing I can't wait for is for Zeenyx to add automating Mobile apps."
"Streamlining the retrieval of results from individual test set runs would be beneficial."
"Classes are not as object-oriented as I would like, but I am a programmer and not QA so I expect a lot."
Earn 20 points