We performed a comparison between Parasoft SOAtest, Ranorex Studio, and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools."The testing time is shortened because we generate test data automatically with SOAtest."
"Good write and read files which save execution inputs and outputs and can be stored locally."
"If you want something that’s not provided out of the box, then you can write it yourself and integrate it with SOAtest."
"Automatic testing is the most valuable feature."
"We have seen a return on investment."
"The solution is scalable."
"Generating new messages, based on the existing .EDN and .XML messages, is a crucial part or the testing project that I’m currently in."
"Technical support is helpful."
"The most valuable feature of Ranorex Studio is the capture and replay tool. You don't need to do script testing. When you launch any application from Ranorex Studio it automatically captures these test case steps. The next time you can replay the tool the flow automatically happens again. For example, when you do the logging and all the activity will be captured by the tool, and re-execute the same step by using automatization."
"The most valuable feature of Ranorex Studio is its user-friendly interface."
"Object identification is good."
"The solution is intuitive and pretty self-sustaining. You don't need a lot of help with it in terms of setup or assistance."
"This is a powerful, reliable and versatile all-around application testing suite."
"The scalability is very good. It's probably one of the better tools I've seen on the market."
"The solution is stable."
"I'm from a UFT background, so Ranorex Studio has a similar feel in terms of how it handles objects. It just felt familiar even though I'd never seen it before. However, it doesn't have all the bells and whistles of UFT, but it's a pretty good start, and it's cost-effective."
"The most valuable feature is the cross-browser feature, it has many android and iOS devices both simulators and real devices. It's easy to integrate. I also like video recording too."
"From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams."
"Running tests in parallel."
"Sauce Labs provides us with more combinations to test, so we can keep adding platforms and devices to our network. That's been a very seamless experience. Let's say there's an iOS or a private device we need. Sauce Labs has helped get all those set up when needed."
"Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."
"It provides zero maintenance browser instances."
"Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"Compatibility with HTTP 1.1 and TLS 1.2 needs to be improved."
"From an automation point of view, it should have better clarity and be more user friendly."
"The feedback that we received from the DevOps of our organization was that the tool was a little heavy from the transformation perspective."
"Tuning the tool takes time because it gives quite a long list of warnings."
"Reporting facilities can be better."
"UI testing should be more in-depth."
"Enabling/disabling an optional element of an XML request is only possible if a data source (e.g., Excel sheet) is connected to the test. Otherwise, the option is not available at all in the drop-down menu."
"During the process of working with SOAtest and building test cases, the .TST files will grow. A negative side effect is that saving your changes takes more time."
"The object detection functionality needs to be improved."
"The automation of the SAP application could perhaps be improved to make it much simpler."
"I would like to be able to customize the data grids. They are currently written in Visual Basic and we are unable to get down to the cell level without hard-code."
"One of the areas the service could be improved would be to have the training in Italian."
"The solution's technical support team could be responsive."
"There were a lot of issues we faced. One notable improvement would be better API integration within the tool itself, as we still rely on external tools like Postman."
"Binding to other sources is very good but the object recognition in .NET desktop applications often doesn't work."
"When Ranorex is upgraded, the compatibility with other projects, in version control, in-house or on-premise, fails on occasion. However, overall, the stability is good."
"The real concern is the load time of applications or real devices when we start our tests. It takes some time to load the application or web browser. Sometimes, it is frustrating too. Since they are real devices, we understand it takes some time to load. However, if it were to improve, then that would be a great asset to the solution. So, we would like better responsive times when opening applications and running tests."
"Sometimes pasting text while using "text object" does not seem to work, and it slows down testing times quite a bit."
"I would like for there to be more detail in regards to the quality of our code i.e. how many failures occurred, how many passed based on industry standard metrics, etc."
"The only drawback is the speed, it will be good if we have a server in Asia too. It will be great if we can improve speed while initialization and execution."
"Speeds up the time it takes to run end-to-end user interface (UI) tests inside their virtual machines (VMs)."
"Integration with Github, as well as several other similar tools, could be improved."
"Lacks the ability to start multiple tests simultaneously."
"An image comparison would be a nice feature to include in the Sauce Labs product."
