We performed a comparison between Sauce Labs, SmartBear TestComplete, and Zeenyx AscentialTest based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."The abundance of device, platform, and browser combinations/versions that can be used in parallel."
"It provides a comprehensive selection of browsers and platform versions for our test automations and CI/CD pipeline process. It also provides a comprehensive set of virtual mobile devices, which we can configure for our automation and availability. These features are valuable for us when it comes to testing our applications. We have a website and mobile applications that we want to test and diversify to various browsers and mobile devices as well as restore various versions. This helps us to find bugs that users might be facing and correct them."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"The custom capabilities that can be provided to Sauce Labs VMs during automated testing sessions are a valuable option for experimental or niche testing."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They also provide real devices, so you just provide the URL and test your application."
"Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."
"The ease-of-use and quality of the overall product are above average."
"The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment."
"The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them. The are other features that SmartBear TestComplete has but the competition widely has them as well."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"The ability to run a whole suite of tests automatically (which we did overnight)."
"TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications."
"It is a strong automation tool for desktop, browser, and API testing."
"I like the cross browser compatibility. It saves a lot of time re-writing scripts to accommodate different browsers."
"If you use the PowerBuilder application, do choose AscentialTest without thinking twice."
"AscentialTest's object recognition in snapshots is a robust feature that goes beyond standard elements, even accurately identifying objects within Datawindows."
"The most valuable feature of AscentialTest for us is that it fully supports PowerBuilder."
"It’s been really easy to automate the same application TestComplete struggled with. I have been able to automate two of our key applications in just a few months. I haven’t even taken their training."
"When we were in development, it was a bit of a pain because we have onshore and offshore development. One of our development shops is in India, and we were running tests over there. When some of the users tried to log in, it was slow for them or we didn't have enough licenses. That was during the core development before we even launched."
"Another aspect that could be improved is having the virtual devices boot up a little quicker. Sometimes we wait up to a minute before a device is available. It would be nice if that was 30 seconds or so."
"With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the Selenium scripts, we require web locators. We have to capture them from the local and execute the script on Sauce Labs. If Sauce Labs can provide a solution where we can inspect any of the mobile devices online, it will be very helpful for us."
"They could improve the platform's customer support services."
"As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again."
"Multi-domain SSO is a big concern for us right now, especially as we've been merged into a larger company. I suddenly have teams coming from 20 different domains, and because the main master Sauce Labs account is locked down to one SSO domain, there are teams that can't run a test right now. I've heard they're working on a solution and they've been very communicative with us about it. A solution to that would help us a lot."
"We have had some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt."
"I would like for there to be more detail in regards to the quality of our code i.e. how many failures occurred, how many passed based on industry standard metrics, etc."
"Right now, the product only supports Windows."
"The test object repository needs to be improved. The hierarchy and the way we identify the objects in different applications, irrespective of technology, needs adjustments. The located and test objects are not as flexible compared to other commercial tools."
"The integration tools could be better."
"Right now, when you buy the solution, you need to pay for one solution. You receive one set up and you install it and it's just in that one machine. It would be ideal if they could offer one subscription where you can connect to different machines with a group subscription."
"At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced Optical Character Recognition (OCR) capability. This introduction has reduced the challenges to some extent, as we can now utilize OCR if the normal method doesn't work. Nevertheless, there is still significant potential for improvement in TestComplete's ability to identify various object elements. I don't have any specific concerns to mention. I have observed significant improvements in TestComplete over the past few years, especially in its support for highly dynamic object elements used in products like Salesforce Dynamics 365. In earlier versions, there were numerous challenges, but the current version is far superior to its predecessors."
"This solution could be improved by making it easier to visualize where there is a failure without having to look at it in detail."
"Product is not stable enough and it crashes often."
"If that engine could better identify more XPaths automatically and make the process more flexible, that would be better."
"Streamlining the retrieval of results from individual test set runs would be beneficial."
"The only thing I can't wait for is for Zeenyx to add automating Mobile apps."
"I would like to see an improvement in the User Interface."
"Classes are not as object-oriented as I would like, but I am a programmer and not QA so I expect a lot."
Earn 20 points
