We performed a comparison between OpenText Silk Test, Sauce Labs, and Selenium HQ based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."The major thing it has helped with is to reduce the workload on testing activities."
"Scripting is the most valuable. We are able to record and then go in and modify the script that it creates. It has a lot of generative scripts."
"The ability to develop scripts in Visual Studio, Visual Studio integration, is the most valuable feature."
"The statistics that are available are very good."
"The scalability of the solution is quite good. You can easily expand the product if you need to."
"A good automation tool that supports SAP functional testing."
"The feature I like most is the ease of reporting."
"The most valuable feature is cross-browser, cross-OS, cross-mobile device testing."
"They offer a large number of devices and browser/operating system combinations for real device tests"
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"Sauce Labs provides us with more combinations to test, so we can keep adding platforms and devices to our network. That's been a very seamless experience. Let's say there's an iOS or a private device we need. Sauce Labs has helped get all those set up when needed."
"I find that the multitude of browser and OS versions are very helpful for broadening testing scope."
"Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."
"It provides a comprehensive selection of browsers and platform versions for our test automations and CI/CD pipeline process. It also provides a comprehensive set of virtual mobile devices, which we can configure for our automation and availability. These features are valuable for us when it comes to testing our applications. We have a website and mobile applications that we want to test and diversify to various browsers and mobile devices as well as restore various versions. This helps us to find bugs that users might be facing and correct them."
"From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams."
"I like that it is a robust and free open source. There is a lot of community support available, and there are a lot of developers using them. There's good community support."
"The ability to present your tests on a wiki page and hooking them up to the scripts/fixtures."
"The main characteristic that is useful is that the tool is completely free."
"The stability of the solution has been good, it is reliable we have not had any bugs."
"We can run multiple projects at the same time and we can design both types of framework, including data-driven or hybrid. We have got a lot of flexibility here."
"Selenium has helped to complete tests in less time, which would not be possible relying on manual testing only."
"I like the record and playback features. We also appreciate that it's not just writing on a script that we create. While we were browsing our web application, it automatically records all the clicks and movements of points. We also appreciate the fact that it provides screenshots of everything in the output."
"It's available open-source and free. To install it, I just have to download it. It also doesn't require too many hardware resources compared to Micro Focus."
"They should extend some of the functions that are a bit clunky and improve the integration."
"The solution has a lack of compatibility with newer technologies."
"The pricing is an issue, the program is very expensive. That is something that can improve."
"Everything is very manual. It's up to us to find out exactly what the issues are."
"We moved to Ranorex because the solution did not easily scale, and we could not find good and short term third-party help. We needed to have a bigger pool of third-party contractors that we could draw on for specific implementations. Silk didn't have that, and we found what we needed for Ranorex here in the Houston area. It would be good if there is more community support. I don't know if Silk runs a user conference once a year and how they set up partners. We need to be able to talk to somebody more than just on the phone. It really comes right down to that. The generated automated script was highly dependent upon screen position and other keys that were not as robust as we wanted. We found the automated script generated by Ranorex and the other key information about a specific data point to be more robust. It handled the transition better when we moved from computer to computer and from one size of the application to the other size. When we restarted Silk, we typically had to recalibrate screen elements within the script. Ranorex also has some of these same issues, but when we restart, it typically is faster, which is important."
"Could be more user-friendly on the installation and configuration side."
"The support for automation with iOS applications can be better."
"They should provide a JIRA integration plugin so that we can easily log issues."
"Latency, due to Sauce Labs being a cloud-based solution, has been a concern. We work in different continents and countries, but last time I checked, Sauce Labs was only offering two data centers, one in the EU and another in the US. If you're not in either of those two places, you would have latency and issues running your test cases."
"On a rare occasion, I will come into a ticket where a customer will have reached out to me after reaching out to Sauce Labs, saying, "Sauce Labs doesn't understand what I am going through. They are not being very helpful." So, I try to do clean up there. Outside of those extremely rare occasions, I have only had one or two of those support issues."
"Running tests in the SauceCloud can take longer than running in a local environment."
"They could improve the platform's customer support services."
"The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports."
"User account management needs an overhauls, allowing for user groups rather than just a hierarchy structure."
"If I had to speak of an area that could be improved it would probably have to be the speed of interaction with the devices. There is at times a considerable amount of lag while using some of the virtual and at times even physical device farm"
"The reporting part can be better."
"It would be awesome if there was a standalone implementation of Selenium for non-developer users."
"I would like for the next release to support parallel testing."
"We can only use Selenium HQ for desktop applications which would be helpful. We are only able to do online based applications."
"Selenium uses a layer-based approach that is somewhat slower than Eggplant when it comes to executing code."
"Selenium could offer better ways to record and create scripts. IDE is available, however, it can be improved."
"Selenium Grid set-up is bit complex."
"They should add more functionality to the solution."
Earn 20 points