We performed a comparison between Ranorex Studio, Sauce Labs, and Tricentis Tosca based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools."The solutions's regression testing is very important for our company, as is the continuous integration process."
"Data security was prime for us. Being able to download and run tests on our local machines was a big plus. The flexibility Ranorex offers in terms of customization is outstanding."
"I'm from a UFT background, so Ranorex Studio has a similar feel in terms of how it handles objects. It just felt familiar even though I'd never seen it before. However, it doesn't have all the bells and whistles of UFT, but it's a pretty good start, and it's cost-effective."
"The most valuable feature of Ranorex Studio is the capture and replay tool. You don't need to do script testing. When you launch any application from Ranorex Studio it automatically captures these test case steps. The next time you can replay the tool the flow automatically happens again. For example, when you do the logging and all the activity will be captured by the tool, and re-execute the same step by using automatization."
"The solution is fast and includes built-in libraries that record and playback."
"Easy integration with CI Tools like Jenkins, TFS, and TeamCity."
"The most valuable feature of Ranorex Studio is its user-friendly interface."
"Code Conversion is one of the great features because sometimes, the automation tool doesn't have the capability of maneuvering around two specific evaluations."
"The Failure Analysis feature is really important for us, one of the most important aspects. What is the root cause? Is it because we have a defect or is it that we have a test case that we need to fix or modify? The Failure Analysis is one of the main functionalities that I am exploring all the time in Sauce Labs... The Failure Analysis helps us to discover which test cases we need to work on."
"Sauce Labs is optimized for automation and integration with the major CI/CD platforms and developer tools. We have an integration with App Center that we're working on. They have a storage API that lets us retrieve APK and IPA, iOS and Android builds off the phone, so that we can continue testing with CI/CD. They integrate with Jenkins, and Jenkins is the main CI/CD."
"Easy to integrate with the other platform for tracking purposes."
"Testing my app on cloud has really helped us with save time and resources to procure various hardware and software, and set those up."
"I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"It has significantly enhanced our testing accuracy by approximately 50%."
"Testing across multiple devices and environments is now possible to do quickly and effectively."
"Sauce Labs provides us with more combinations to test, so we can keep adding platforms and devices to our network. That's been a very seamless experience. Let's say there's an iOS or a private device we need. Sauce Labs has helped get all those set up when needed."
"The feature that I have found the most valuable is the recovery and cleanup process. Suppose there is a list of test cases and one test case has failed, it should not impact the other test cases. We can reuse the same test case. We can change the configuration of parameters and then use the test cases on the same thing. So, that's a useful thing. Otherwise, we have to use the cleanup process. Another useful feature is to have our own library files. We can create our objects in the libraries and reuse them. There is no need to create duplicate data for that. They have been giving some enhancements recently which means integration is also there. They've integrated with different software like Jenkins, Bamboo. So, we can also create pipeline points. They have recently given SAP and everything, which is very useful."
"It's been very helpful to have connectivity with mobile. The tool also identifies some of the actual changes from the recordings on the actual testing suite. That is something that I really like."
"It is easy to maintain and easy to automate. No coding skills are required to automate. It is also easy in terms of transferring knowledge and skills. Many of my team members shifted over the past one and a half years, and there was no big issue with respect to knowledge sharing. It is a good tool that enables me to re-automate my scripts and update my scripts as quickly as possible. Looking at the amount of rework and maintenance activity that we had done for our scripts, it might have been a nightmare with some other scripting tool."
"This solution is easy to use for everybody, including those who are not IT-educated."
"To me, what stands out the most about Tricentis Tosca is that even if I'm not a technical tester, I could pick up on how to use it very quickly because of the mechanisms of the tool, for example, its scanning mechanism. I'm not so technical, but I'm able to maneuver through Tricentis Tosca and derive capability. It's a user-friendly tool. It's not very complex."
"The low code is the best feature."
"Image recognition: It has allowed us to automate a GUI section of our product which involves drawing different topologies."
"What I find valuable is that Tricentis is always refining the test methodology. They listen to feedback from the analysts about what the testing tool should do, and then Tricentis always implements it. So all the necessary testing functions are already implemented in their tools."
"I would like to be able to customize the data grids. They are currently written in Visual Basic and we are unable to get down to the cell level without hard-code."
"If there are many queries on the web page, Ranorex will not render the page correctly. I had about 1,000 queries on the page, and the solution was not able to handle it."
"Part of the challenge is that Ranorex's support is over in Europe, so we can't get responses on the same day. If we had support in the United States that was a bit more timely, that would be helpful."
"Ranorex is used in Windows while other solutions, for example, Katalon Studio, are cross-platform. (But in my opinion, overall, Ranorex is better)."
"I'd like to know their testing strategies and to know what they can automate and what they can't. It can become pretty frustrating if you're trying to automate something that changes on a monthly or weekly basis."
"We are mainly working for manufacturing OEMs but the integration is not available. It would be a benefit if they built one integration tool for all the Teamcenter home servers and software as the main PLM data source. It is a simple process at this time, the integration could be made easier."
"When Ranorex is upgraded, the compatibility with other projects, in version control, in-house or on-premise, fails on occasion. However, overall, the stability is good."
"The solution's technical support team could be responsive."
"They should provide a JIRA integration plugin so that we can easily log issues."
"User account management needs an overhauls, allowing for user groups rather than just a hierarchy structure."
"We had some specific features that we opened tickets on, although they were not earth-shattering. For example, the way the menus scroll could be improved because it does not have a bar, the way that people are used to, where you can move up and down."
"Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable."
"The pricing model of Sauce Labs could be more flexible. Sauce Labs has just one price for the type of solution and a set number of devices. Other solutions have a fee for the base solution and an additional cost per device. If you're a smaller organization, you have to consider your needs. Some smaller companies still need to test various devices, so my advice is to start small and scale up as needed. We had initially planned to start big, but that would have been a big waste."
"On a rare occasion, I will come into a ticket where a customer will have reached out to me after reaching out to Sauce Labs, saying, "Sauce Labs doesn't understand what I am going through. They are not being very helpful." So, I try to do clean up there. Outside of those extremely rare occasions, I have only had one or two of those support issues."
"The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports."
"Better and programmatic controls on request/response recordings and sharing with developers."
"Tricentis Tosca currently does not support any mobile testing and can be improved."
"I would like a better user interface."
"In Tosca, I see that there are no user guides."
"There have been some setbacks because of upgrades. While Tosca has been around for a while, Tricentis has catered to smaller clients and I don't think they have done such a large, at-scale transition or transformation before or worked with a company like ours, which is doing an enterprise-wide transformation. When we go to their customer advisory-board meetings, upgrades have been an issue. They have been working a lot to make upgrades seamless."
"The Test Management options are still weak - improvement is outlined, but not yet visible. I"
"The source controls that are in Tricentis Tosca have some problems. For example, if you use Selenium or use Java-based application, it's easy to match code from two developers. However, if you're a developer and going to look at Tricentis Tosca, it's very difficult to use the source control measure."
"Tosca's reporting features could be better. Tricentis had a reporting tool called Analytics, but it didn't function properly after they reworked it. After that, they tried a new approach with key-tracing, and that didn't work."
"First, Tricentis could improve Tosca's Linux scripting. We can automate Linux scripting, but there are a few commands that Tosca doesn't support. DVS support and the object identification mechanism could also be better."
