We performed a comparison between Sauce Labs and SmartBear TestLeft based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."It helped to integrate our performance testing and UAT, which helped to deliver a bug free software for our customers."
"One of the most valuable features is that we do not have to have the cross-platform testing vehicles in-house. Sauce Labs gives us the ability to test across platforms and that really helps give us confidence in our products."
"The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They also provide real devices, so you just provide the URL and test your application."
"Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."
"So far, the stability has proven to be quite good."
"I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"I find that the multitude of browser and OS versions are very helpful for broadening testing scope."
"The most valuable features are test executor and development."
"As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again."
"I would like to see improved network connectivity and it should allow playback for native apps."
"With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the Selenium scripts, we require web locators. We have to capture them from the local and execute the script on Sauce Labs. If Sauce Labs can provide a solution where we can inspect any of the mobile devices online, it will be very helpful for us."
"Another feature that could still be improved on is more error clarity. Sometimes when running automated scripts the test will fail on the device side instead of the script and errors only show a 500 try again message instead of a detailed script that could of a been a timeout error from the code."
"I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management."
"One of the challenging areas for us is the reporting and the matrix. It should be based on roles, but right now it is only available for the admin role. The admin role can really do a lot of stuff, but our infrastructure team, which holds the admin role, is not ready to hand it over to us on the testing team. If Sauce Labs had permissions associated with roles, where this role could do this activity and that role could do that activity, it would be easier for us."
"It should provide more examples of script code."
"I would like for there to be more detail in regards to the quality of our code i.e. how many failures occurred, how many passed based on industry standard metrics, etc."
"TestLeft captures a lot of space in terms of memory, which is one issue that can be improved."
Earn 20 points
Sauce Labs is ranked 11th in Functional Testing Tools with 112 reviews while SmartBear TestLeft is ranked 33rd in Functional Testing Tools. Sauce Labs is rated 8.8, while SmartBear TestLeft is rated 7.0. The top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". On the other hand, the top reviewer of SmartBear TestLeft writes "Simple to set up and the test execute feature is helpful, but the cost could be reduced". Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, OpenText UFT One and Bitbar, whereas SmartBear TestLeft is most compared with SmartBear TestComplete and Tricentis Tosca.
See our list of best Functional Testing Tools vendors.
We monitor all Functional Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.