We performed a comparison between Sauce Labs, SmartBear TestComplete, and Worksoft Certify based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers."
"With only a few clicks, it gives us the availability to use any browser and OS combination whenever we want."
"It provides zero maintenance browser instances."
"Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs."
"The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud."
"Running tests in parallel."
"Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."
"Runs in different remote machines. We have multiple versions of the software being tested."
"You can record your actions and play them back later."
"TestComplete is simple, it's a very easy-to-use tool."
"The solution is mainly stable."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"When compared to other tools, it is very simple."
"The initial setup is pretty easy and it's quick to deploy."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"The most valuable feature is its time saving. Once development is complete, the short time that it takes to execute a test is invaluable. It saves a number of dollars and man-hours."
"One big advantage of Worksoft Certify is its integration with SAP Solution Manager..."
"It's module based and it's giving functionality."
"Certify integrates with other tools and it works very well with other machine testing applications."
"We have been able to save on a lot of manual work for some very high skilled, expensive resources. This has been able to free up a significant amount of their time so they can spend more time on innovation and more creative, value-add activities. That's been one of the more rewarding things that we've done, and the most appreciated."
"We prefer Worksoft over other platforms because it's a low-code solution"
"Mostly in the area of project testing, the most immediate benefit is when you historically have manual testers do a certain job, and a full regression testing was previously done 100 percent manually. We have had cases where the release testing for an entire region would take around 12 weeks. With Worksoft, we are now down to two to three weeks. So, that is one use case where we have had success."
"The ease of use is superior to anything on the market. It's very easy to integrate. We've been very impressed with the tool. Because we primarily use the configuration with SAP, the integration is pretty seamless. But we have used our own in-house VB app as well, and it's worked very well with that."
"Unable to segregate reports for tests that are currently being developed, and might not be returning useful results."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"Integration with Github, as well as several other similar tools, could be improved."
"With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the Selenium scripts, we require web locators. We have to capture them from the local and execute the script on Sauce Labs. If Sauce Labs can provide a solution where we can inspect any of the mobile devices online, it will be very helpful for us."
"The real concern is the load time of applications or real devices when we start our tests. It takes some time to load the application or web browser. Sometimes, it is frustrating too. Since they are real devices, we understand it takes some time to load. However, if it were to improve, then that would be a great asset to the solution. So, we would like better responsive times when opening applications and running tests."
"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable."
"Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time."
"We have faced challenges with the availability of mobile devices. There was once or twice where there were no mobile devices available."
"If that engine could better identify more XPaths automatically and make the process more flexible, that would be better."
"The integration tools could be better."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"Product is not stable enough and it crashes often."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
"The artificial intelligence needs to be improved."
"The way objects are added and used when utilizing descriptive programming could be improved. It is a little unwieldy, compared to UFT."
"The pricing is the constraint."
"Performance on the web UI part, especially with some of the more comprehensive Fiori features, like the complex tables that are being used, could be improved. In those cases we have noticed a lot of execution-time increase with regards to the Certify solution."
"Pricing is a bit high and we would like to have the availability of a trail environment for beginners and training would be great to have and easier to expand and use by more and more consultants."
"It would be great if our business testers could develop their own automated test cases. With every release you do, you have to go back and touch your old test cases and bring them up to speed, or develop new test cases. In the beginning, that is a challenge because you have to have someone who is certified in the tool to help you develop these test cases."
"Web UI testing was difficult in the beginning, as we had a homegrown product, and we had to do the proper object naming."
"The web application should be more robust."
"Our interactions with technical support has not been the best always and there is room for improvement especially with respect to the time taken to respond to cases. However, with the right contacts and reasonable escalations we have always managed to get quick attention on our cases."
"With one of our applications where we do check-in, Worksoft is not able to identify the Java-based application. We raised the ticket, but we were unable to resolve this using Worksoft."
"The primary area for improvement is the support service."
