We performed a comparison between ReadyAPI, Sauce Labs, and Selenium HQ based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools.
"When you are working in sprints, you need to have continuous feedback. ReadyAPI definitely helps in automating very fast and rapidly. We have less coding, and we can more easily define our assertions. We don't use it for full-blown performance testing, but normally if you are doing your functional testing, it gives you the request and response time. Anybody who is doing functional testing can see what the request and response times are and raise a flag based upon their business affiliates, that is, whether it is meeting their affiliates. You can identify this during functional testing."
"The initial setup is straightforward."
"The performance testing capabilities are very good."
"I haven't seen any other tool that offers both types of tests. This is very helpful for us, and it's one of the main reasons why we chose this service."
"The most valuable features of ReadyAPI are its robust functionality and collaboration capabilities."
"For anyone who does not have experience with automation, ReadyAPI provides a sense of comfort, especially for testers who find it hard to go directly into coding."
"The interface is ok and they have the ability to re-load tests so that you can reuse them."
"The Excel sheet feature is good."
"The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They also provide real devices, so you just provide the URL and test your application."
"Testing subscription videos for on-demand software, making them better quality and bug free for our customers."
"Sauce Labs provides us with more combinations to test, so we can keep adding platforms and devices to our network. That's been a very seamless experience. Let's say there's an iOS or a private device we need. Sauce Labs has helped get all those set up when needed."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"It provides zero maintenance browser instances."
"The abundance of device, platform, and browser combinations/versions that can be used in parallel."
"The most valuable feature is the cross-browser feature, it has many android and iOS devices both simulators and real devices. It's easy to integrate. I also like video recording too."
"Our machines are mostly Windows. Being able to test with Safari, on a Mac, and other types of browser pieces without having to manage all the infrastructure is the biggest feature that our team enjoys."
"It is compatible with and supports multiple languages, such as Java and Python. It is open source, and it is widely used."
"The most valuable feature of Selenium HQ is the ability to create automatic tests that can replicate human behavior."
"It supports most of the actions that a user would do on a website."
"Selenium HQ's most valuable feature is its online community support, which is comprehensive and easy to access."
"The plugins, the components, and the method of the library with Selenium is very user defined."
"My customer previously validated every file and it would take almost 15-20 minutes for a document. They used to randomly select and test only 100 out of the thousands, maybe 85,000, files, to pick up sampling. Each file would take around 20 to 25 minutes, so we were not able to do it manually, but with the help of Selenium, we were able to test all the files in two days. It saves a lot of time."
"Our platform runs into several thousand screens and a few thousand test cases, something which would typically take months to test manually. As of today, the entire process takes a little over two days to run."
"The solution is free to use."
"There are lots of options within the solution, however they are not upfront or user-friendly."
"It doesn't have connectors to the NoSQL database. This is one of the things where they do not have a very solid strategy today. Other solutions have an in-built mechanism where I can directly and easily connect. An API is more around a user submitting a request on the frontend. It then hits the backend, puts the data, and responds back. If I am hitting MongoDB or NoSQL databases, I do not have ready-made inbuilt solutions in ReadyAPI that can easily help me in automating it faster. In our organization, we deal with NoSQL databases, and therefore, we need Groovy. We just cannot have a connector from ReadyAPI to do that. I have to write Groovy scripts. If you have themes that are predominantly using MongoDB, it leads to more maintenance and support activity because we are introducing more code into our commission. In terms of additional features, it can have cloud support. This is one of the things where we are getting into cloud support. We'll see how it works, but it is one of the doubts that we still have."
"The reporting in ReadyAPI could be better. It can become sloppy, sometimes it works and other times it does not."
"What needs improvement in ReadyAPI is its load testing feature because there was a hiccup when my team performed some load testing on the tool. My team had meetings with the ReadyAPI team and tried to get that issue fixed, but it still hasn't improved. This is a shortcoming of the tool, especially when you compare it with HP LoadRunner."
"If ReadyAPI had more integration with all of the big tools on the market then this would be very useful."
"Can be improved by including an inherent feature for UI automation."
"There is a lot of room for improvement, mainly from the point of view of integrating ReadyAPI into the CI pipelines, and also the scripting aspect into Bitbucket."
"To generate a test suite in API, I had to create a separate one each time because otherwise it was just override the test. Each API had to be added separately. I thought I could just have one and then create different methods, but I had to add each API separately to create the test for that. That is an area that could be improved."
"Another feature that could still be improved on is more error clarity. Sometimes when running automated scripts the test will fail on the device side instead of the script and errors only show a 500 try again message instead of a detailed script that could of a been a timeout error from the code."
"It should provide more examples of script code."
"I would like for there to be more detail in regards to the quality of our code i.e. how many failures occurred, how many passed based on industry standard metrics, etc."
"We have faced challenges with the availability of mobile devices. There was once or twice where there were no mobile devices available."
"When we were in development, it was a bit of a pain because we have onshore and offshore development. One of our development shops is in India, and we were running tests over there. When some of the users tried to log in, it was slow for them or we didn't have enough licenses. That was during the core development before we even launched."
"Unable to segregate reports for tests that are currently being developed, and might not be returning useful results."
"The ability to install profiles on iOS real mobile devices should be included."
"Sauce Labs has room for improvement with its price point. Using a real mobile device, and having that dedicated to your team, costs more than actually purchasing a mobile device. We haven't tried the real devices yet. This is because of their price point."
"We do not have enough resources or enough people to employ and hire. So, I'm hiring whoever I find, and they don't always have enough technical knowledge to operate Selenium."
"It would be very great if Selenium would provide some framework examples so newcomers could get started more quickly."
"The initial setup of Selenium HQ is difficult in many areas, such as the framework."
"There should be standardized frameworks to build automation."
"Selenium HQ doesn't support Windows-based applications, so we need to integrate with the third-party vendor. It would be great if Selenium could include Windows-based automation. You need to integrate it with a third-party tool if you want to upload any files. When we interact with a Windows application, we usually use Tosca."
"To simplify the development process, everyone needs to do a Selenium Framework to acquire the web application functions and features from Selenium methods."
"There's no in-built reporting available."
"The drawback is the solution is not easy to learn."
