OpenText LoadRunner Cloud vs Sauce Labs comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

OpenText LoadRunner Cloud
Average Rating
8.2
Number of Reviews
40
Ranking in other categories
Performance Testing Tools (6th), Load Testing Tools (6th)
Sauce Labs
Average Rating
8.8
Number of Reviews
113
Ranking in other categories
Functional Testing Tools (11th), Test Automation Tools (13th)
 

Mindshare comparison

As of June 2024, in the Performance Testing Tools category, the mindshare of OpenText LoadRunner Cloud is 8.0%, down from 10.1% compared to the previous year. The mindshare of Sauce Labs is 3.8%, down from 4.4% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Performance Testing Tools
Unique Categories:
Load Testing Tools
7.1%
Functional Testing Tools
6.3%
Test Automation Tools
3.0%
 

Featured Reviews

Abbasi Poonawala - PeerSpot reviewer
Nov 19, 2023
Offers good record and playback and endurance features
The performance has really improved in terms of running test cycles. The product used to crash on-premises and when it had a lot of trades being pumped in. Because it is memory intensive, it used to crash if it was running out of memory. That was the limitation of the on-premises thing. Running those states and cycles in the cloud is much faster. Everything is frozen in the cloud. The RAM, CPU, compute, and storage are provisioned in the cloud, which is becoming easier for running these test cycles. Test cycles are highly effective. Of course, you need to have a test strategy, like volume-based load testing. Configure some test cases and run those test cases in cycles. Cloud performance is much faster. Volume-based endurance testing is easier in the cloud.
AnupKumar4 - PeerSpot reviewer
Apr 9, 2024
Offers good stability and robust but lacks generative AI capabilities
Technical support is equally very important. If you talk about anything deployed to production, and the project is live, customers are using that, and they might face some issues, some functional issues. That's when support people play a role in identifying the fix or the incident. Based on that, we create an incident based on the customer defect or whatever. Once the incident gets raised, the support will play a role in working on that particular incident. If it's a code-based incident, administration, or integration issue, support people play a big role in resolving those issues before reaching the exact developers.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The fact that the solution supports multiple protocols such as open source, VuGen, TruWeb, TruClient, and SAP is very important because these protocols help us to concentrate on what is really needed to produce performance tests. If something is not supported, you have to use other tools or find other ways of assimilating loads."
"The most valuable feature is that you can create an infrastructure on-demand and do performance testing with it."
"It is feature-rich. It supports most protocols, which is important because I am in charge of a team at the bank, and we do performance testing for all kinds of different applications. We have tons of them. We even do video streams."
"This solution is SaaS based so we can utilize cloud technology, which is less time consuming and saves a lot of of money."
"The solution can scale."
"The solution is easy to use."
"The most valuable feature is having load generators in countries where we don’t have access to them."
"The most valuable feature is that we do not have to accommodate the load-testing infrastructure in our own data center."
"I like the dashboard and seeing the test results. As a manager, I like to see the insights of the people using it, understanding the total path and run. I can see all of that as a manager. I also know team members love seeing the dashboard and seeing the test results in real-time."
"One of the most valuable features is that we do not have to have the cross-platform testing vehicles in-house. Sauce Labs gives us the ability to test across platforms and that really helps give us confidence in our products."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"Testing my app on cloud has really helped us with save time and resources to procure various hardware and software, and set those up."
"Sauce Labs provides us with more combinations to test, so we can keep adding platforms and devices to our network. That's been a very seamless experience. Let's say there's an iOS or a private device we need. Sauce Labs has helped get all those set up when needed."
"I find that the multitude of browser and OS versions are very helpful for broadening testing scope."
"With only a few clicks, it gives us the availability to use any browser and OS combination whenever we want."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
 

Cons

"It should have a feature to report with a 99.9 percentile success rate."
"CI/CD integration could be a little bit better. When there's a test and if you see that there are high response times in the test itself, it would be great to be able to send an alert. It would give a heads-up to the architect community or ops community."
"I would like for there to be better integration with other tools so that when you do load testing you can also do a security check."
"I'd like to see more ability to dive more deeply into the configuration."
"Sometimes, you are utilizing one of the low generators, then all of a sudden if you discontinue from one project, it actually deletes the entire low generator."
"We are trying to put it into a complete CI/CD pipeline, but there are still some challenges when you try to run it through different protocols. The challenges are around how you can containerize applications. There are some limitations to some protocols, such as desktop. And when it comes to database testing, there are some things that we can't do through CI/CD."
"Their documentation is not technical enough for us. We would like to have much deeper technical documentation so that we can self-serve without constantly having to go back to them and ask."
"In terms of new features, they can natively integrate with Chaos engineering tools such as Chaos Monkey and AWS FIS. With LoadRunner, we can generate load, and if Chaos tools are also supported natively, it will help to get everything together."
"Lacks the ability to start multiple tests simultaneously."
"The Jenkins Sauce OnDemand plugin could have more options available to tap into more of the custom capabilities Sauce Labs actually supports."
"We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements."
"I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management."
"We have faced challenges with the availability of mobile devices. There was once or twice where there were no mobile devices available."
"User account management needs an overhauls, allowing for user groups rather than just a hierarchy structure."
"Unable to segregate reports for tests that are currently being developed, and might not be returning useful results."
"Every time that we run scenarios where we need to discover the geolocation of our customers, by default it shows as Palo Alto, California. That's a problem for us and we need a workaround for those cases... It would be helpful if we could enter a latitude and longitude into Sauce Labs configuration and say, "When you run a virtual Chrome device or an iPhone, make this your default location. Then, provide me that device so I can run my scenarios," because we have stores in different regions across the United States."
 

Pricing and Cost Advice

"There is no monthly or yearly cost but rather, the fees are based on the amount of traffic that you use."
"It's a very expensive solution"
"LoadRunner always had expensive pricing. At my company, we used to evaluate LoadRunner, but we stuck with Silk Performer because its pricing was always better in the past. I do feel that I got a fair deal this time. Our value-added reseller and our sales guy worked hard to give us a fair deal. I feel that we got a fair deal. We did not go for the pay-as-you-go deal. I did an upfront package. I prefer that. I want to know what my costs are."
"It is neither costly nor cheap. It is not too high and not too low. I know the price of other tools, and LoadRunner Cloud's price is in the medium range."
"Pricing is dependent on what you're referring to. If you're talking about the cloud, it's likely competitive. However, if you're talking about the on-premise version, professional or enterprise licenses are required. Prices are on the high side. They are not cheap."
"The pricing for OpenText LoadRunner Cloud is average."
"The solution’s price is considerably high."
"We make use of virtual user hours. We buy time in the LoadRunner Cloud. It costs around $80,000."
"It is an expensive tool."
"​Now that we have an enterprise license, we no longer have to worry about minutes each month!​"
"The pricing is definitely on the higher end, and there are other options that are more cost-effective."
"We pay for a specific number of VMs."
"Their pricing is incredibly competitive."
"We have an enterprise account; it has worked great for our needs."
"Trial the product and see if it suits your needs."
"They could improve on the pricing because it seems pretty expensive. I'm sure it's justified, but it's expensive."
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
787,779 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
21%
Computer Software Company
14%
Manufacturing Company
10%
Government
8%
Financial Services Firm
19%
Computer Software Company
16%
Healthcare Company
7%
Retailer
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

Do you recommend Micro Focus LoadRunner Cloud?
I absolutely recommend Micro Focus LoadRunner Cloud. In fact, I consider it to be one of the best performance testing tools. I like it because it provides many benefits. Some of the ones I find to...
What do you like most about Micro Focus LoadRunner Cloud?
One of LoadRunner's standout features is its extensive support for various TechStacks and protocols.
What is your experience regarding pricing and costs for Micro Focus LoadRunner Cloud?
The solution is a bit expensive. The pay-as-you-go model offered by LoadRunner Cloud is important to us, especially when considering the cost-effectiveness of performance testing.
What do you like most about Sauce Labs?
It has significantly enhanced our testing accuracy by approximately 50%.
What needs improvement with Sauce Labs?
Sauce Labs can include new technologies like generative AI, which can reduce the human effort in writing test cases. For example, in my current project, we reduced the time it took to complete user...
What is your primary use case for Sauce Labs?
I work as an automation engineer using Selenium WebDriver with Java, and API automation using Rest Assured with Java. I have also worked with Docker integration on AWS. Additionally, I have experie...
 

Also Known As

Micro Focus LoadRunner Cloud, StormRunner Load, LoadRunner Cloud, and Micro Focus StormRunner Load
No data available
 

Overview

 

Sample Customers

Alfa Bank, N Brown Group, University of Copenhagen, McGraw-Hill, Cognizant
Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools. Updated: June 2024.
787,779 professionals have used our research since 2012.