We performed a comparison between BrowserStack, Sauce Labs, and SmartBear TestComplete based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."I like that it offers full device capability."
"Testing across devices and browsers without maintaining that inventory is invaluable."
"The most valuable feature is that it provides parallel and cross-browser testing. It enables us to run tests on multiple browsers or devices simultaneously."
"The most valuable feature is the variety the solution offers around the different types of devices, especially mobile devices."
"The most valuable features are the variety of tools available."
"I've worked on testing integrations with BrowserStack, particularly with a platform called IT. This involves testing the registration process, including receiving verification codes on devices and phones. BrowserStack has been excellent for testing these integrations, providing a seamless workflow development experience."
"We like the model device factory for iOS and Android devices."
"It is a scalable solution."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"The Failure Analysis feature is really important for us, one of the most important aspects. What is the root cause? Is it because we have a defect or is it that we have a test case that we need to fix or modify? The Failure Analysis is one of the main functionalities that I am exploring all the time in Sauce Labs... The Failure Analysis helps us to discover which test cases we need to work on."
"Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market."
"They update for the latest browsers and mobile phones and support a lot of combinations. They have 1,000-plus desktop combinations and browser versions, which is really great. We need that at Applause. The all-in-one testing suite aspect of it is really important because most of our clients prefer to go to one place."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"Allows us to do JIRA Cloud and BambooHR Integration."
"The custom capabilities that can be provided to Sauce Labs VMs during automated testing sessions are a valuable option for experimental or niche testing."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications."
"TestComplete is simple, it's a very easy-to-use tool."
"The solution helps improve the stability of our product. It also decreases the work of our manual quality assurance engineers."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"It is a strong automation tool for desktop, browser, and API testing."
"Complete works perfectly with CUTE. That includes all dialogues, right-click menus, or system dialogues, etc., which are handled well."
"The product has many features."
"The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them. The are other features that SmartBear TestComplete has but the competition widely has them as well."
"We are having difficulty with the payment system for the BrowserStack team, as they only accept credit cards and we are encountering some issues."
"I haven't seen AI in BrowserStack, making it in an area where improvements are required in the product."
"If you are inactive for 30 minutes, the solution will close."
"BrowserStack is scalable, but cost is significant for those living in Mexico."
"Customer support could be better. We tried to implement and explore this product with the vendor or reseller's help, but we haven't had any good response about the product."
"Occasionally, there are disruptions in the connection which can interfere with our testing processes, especially when testing on phones."
"One of the biggest issues with BrowserStack is that if you don't have your network set up by the book, it's hard to get it to work with local desk machines."
"Sometimes BrowserStack is really slow and devices are not loading. it is really annoying and that's why we bought several newer devices because sometimes it's affecting us a lot."
"Integration with Github, as well as several other similar tools, could be improved."
"I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management."
"I would like to see improved network connectivity and it should allow playback for native apps."
"The testing process is difficult. I need to prove the complete competency of the tool, and I am finding that challenging."
"Another aspect that could be improved is having the virtual devices boot up a little quicker. Sometimes we wait up to a minute before a device is available. It would be nice if that was 30 seconds or so."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"The real concern is the load time of applications or real devices when we start our tests. It takes some time to load the application or web browser. Sometimes, it is frustrating too. Since they are real devices, we understand it takes some time to load. However, if it were to improve, then that would be a great asset to the solution. So, we would like better responsive times when opening applications and running tests."
"Lacks the ability to start multiple tests simultaneously."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
"Right now, when you buy the solution, you need to pay for one solution. You receive one set up and you install it and it's just in that one machine. It would be ideal if they could offer one subscription where you can connect to different machines with a group subscription."
"It is very hard to read the test log generated by TestComplete Executor if the log file is very big. TestComplete Executor is a small tool for just running the TestComplete test framework (not for developing)."
"In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical."
"Error handling features in the tool are a little limited."
"The solution needs Mac OS support. Right now, the solution has only been developed to accommodate Windows OS."
"The integration tools could be better."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
