We performed a comparison between Galen Framework, IBM Rational Functional Tester, and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools."What I like most about Galen Framework are its advantages, particularly its spec language and the spec file feature."
"IBM Rational Functional Tester is very contextual."
"Test automation is most valuable because it saves a lot of time."
"It is compatible with all sorts of Dark Net applications. Its coverage is very good."
"The most valuable feature is the UI component tester."
"Maintaining many environments for test is a bear. These guys make it so easy with their CI integration that you can have tests going in after a few hours."
"Supplying devices to a testing team of possibly close to one thousand testers and developers is a great undertaking but Sauce Labs has made this very easy and a welcomed solution."
"Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs."
"With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"It offers the single best solution for integrating deep automated browser testing in a CI/CD pipeline."
"The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They also provide real devices, so you just provide the URL and test your application."
"It has significantly enhanced our testing accuracy by approximately 50%."
"There don't seem to be functions available for automatically generating Galen values based on the specifications in the spec file, and this could be a potential improvement for Galen Framework."
"They need to do a complete revamp so that even a non-technical person can manage the tool."
"If the solution is running on Linux, there are some issues around application compatibility."
"As many of our products are moving from PC to mobile, the most important thing that this solution needs is mobile app support."
"The latest version has increased load time before testing can be run."
"We have had some issues with the Sauce Connect Proxy on our Jenkins servers failing to start, which makes the optimal CI/CD pipeline come to a halt."
"The one issue I have is the 14-day trial that a new user gets for free. I understand the concept of the trial period; however, I think this could be revamped to a free 30-minute run time every few months or after a significant update once the trial period has ended."
"Overall, I think Sauce Labs provides us with a valuable tool and resource. As far as what could be improved, I would say the overall test execution time. Some of the calls take a bit longer than I expect, for example in web browser tests; while the execution time isn't obnoxious, it could be improved so that overall tests/test suites finish faster."
"The only drawback is the speed, it will be good if we have a server in Asia too. It will be great if we can improve speed while initialization and execution."
"I would like for there to be more detail in regards to the quality of our code i.e. how many failures occurred, how many passed based on industry standard metrics, etc."
"Start execution time as each time a set of tests start, it will launch a new VM so it takes a bit of time."
"The pricing model of Sauce Labs could be more flexible. Sauce Labs has just one price for the type of solution and a set number of devices. Other solutions have a fee for the base solution and an additional cost per device. If you're a smaller organization, you have to consider your needs. Some smaller companies still need to test various devices, so my advice is to start small and scale up as needed. We had initially planned to start big, but that would have been a big waste."
"Progress towards reducing application testing time can be made."
More IBM Rational Functional Tester Pricing and Cost Advice →