We performed a comparison between Katalon Studio, Sauce Labs, and Visual Studio Test Professional based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Regression Testing Tools."The most valuable features of Katalon Studio are its user-friendliness and the AI smart healing capabilities."
"I like the feature where you can define a model that represents your website and then reuse the components from the model. It makes creating more test cases easy."
"It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help."
"The most valuable feature is its automation security capabilities."
"It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."
"This is a product that is well ahead of its immediate competition in features and functionality."
"It is a good tool and provides all the essential features for our business requirements."
"The tool is easy to use. The product gives me the flexibility to use Selenium. I can also use my Java capabilities in the solution."
"The most valuable feature is the ability to run concurrent automated tests up to a specified value, depending on what we are currently paying for."
"Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs."
"Sauce Labs provides us with more combinations to test, so we can keep adding platforms and devices to our network. That's been a very seamless experience. Let's say there's an iOS or a private device we need. Sauce Labs has helped get all those set up when needed."
"I have found the live test section with Sauce Labs to be extremely valuable. When you can't quite figure out why a test is failing, you can go to the live test results section within their tool and launch your test (specifying a given OS/browser, or device) manually and step through the test to see the issue more clearly, usually opening up the developer's tool console and watching the network calls and console (within Chrome) to usually find the underlying issue."
"The most valuable feature is the ability to easily test multiple browsers and versions, as well as off-loading our local environments using the SauceCloud."
"Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market."
"I find that the multitude of browser and OS versions are very helpful for broadening testing scope."
"Our machines are mostly Windows. Being able to test with Safari, on a Mac, and other types of browser pieces without having to manage all the infrastructure is the biggest feature that our team enjoys."
"Customization is the most powerful feature of this product."
"The initial setup is easy. It's easy to configure."
"Visual Studio is highly powerful. It's probably the best software development tool on the market."
"The user interface is very friendly."
"The most valuable features of the solution are its ease of use and availability."
"Visual Studio is the easiest to use."
"The product is good to create big or small projects fastly. It is one of the leaders in the area."
"The interface is easy to use."
"It is difficult to identify elements on websites that use Angular or ReactJS because they don't have an option to view source code."
"One improvement would be if it could support more programming languages such as JavaScript or Python. Right now, it is only on Groovy, which I think is not a too popular language."
"The product is comparatively slow."
"It should start working on Silverlight automation."
"Katalon Studio's pricing is expensive."
"Katalon Studio should improve its usability, it still needs some improvement where users can easily use it to build their automation suite. It requires some initial work to set it up. There should be more keywords in the library to limit the coding requirements, this will allow a non-technical person easily start using it, which would be better."
"I can say that in my company, we struggle a lot with iOS automation."
"There is not much support offered for the free version, which is something that could be improved."
"The pricing model of Sauce Labs could be more flexible. Sauce Labs has just one price for the type of solution and a set number of devices. Other solutions have a fee for the base solution and an additional cost per device. If you're a smaller organization, you have to consider your needs. Some smaller companies still need to test various devices, so my advice is to start small and scale up as needed. We had initially planned to start big, but that would have been a big waste."
"Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time."
"Speeds up the time it takes to run end-to-end user interface (UI) tests inside their virtual machines (VMs)."
"Every time that we run scenarios where we need to discover the geolocation of our customers, by default it shows as Palo Alto, California. That's a problem for us and we need a workaround for those cases... It would be helpful if we could enter a latitude and longitude into Sauce Labs configuration and say, "When you run a virtual Chrome device or an iPhone, make this your default location. Then, provide me that device so I can run my scenarios," because we have stores in different regions across the United States."
"When we were in development, it was a bit of a pain because we have onshore and offshore development. One of our development shops is in India, and we were running tests over there. When some of the users tried to log in, it was slow for them or we didn't have enough licenses. That was during the core development before we even launched."
"Running tests in the SauceCloud can take longer than running in a local environment."
"The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports."
"I would like for there to be more detail in regards to the quality of our code i.e. how many failures occurred, how many passed based on industry standard metrics, etc."
"The solution is quite expensive."
"The solution should be cheaper."
"The product must provide more integration."
"Its UI could be better."
"The server that we use is very slow so that is concerning for us."
"Sometimes, the solution hangs, so its performance could be improved."
"The solution can improve the startup time."
"We would like to be able to easily integrate this solution with our continuous integration tools, such as Jenkins."
More Visual Studio Test Professional Pricing and Cost Advice →
