OpenText LoadRunner Cloud Reviews

We use the solution primarily for executing the load tests.

We are able to see the analysis component, and it automatically generates a report from the tool itself after completing the load test. I like that feature. It has great automated reporting features where the report will be generated from the tool itself.

It's user-friendly and it supports a lot of protocols.

The solution can scale.

The stability is good. 

While executing the test it automatically refreshes and I need to see the downwards component, however, it's not allowing me to see that. since it's automatically refreshing, I'm unable to see all the lines in that tool that we are seeing in the editor window.

We did have some challenges with the initial implementation.

I've used the solution for about one year.

I like the product. It's very stable. There are no bugs or glitches. It doesn't crash or freeze. It is reliable.

We can scale the product as needed. It's very easy to do. 

It's also good for any size of the company, from small to enterprise. 

Right now, I'm the only person that uses the solution in our organization. However, we use it to execute the tests with 800 users.

I use it daily. It's used for a quarterly test. For every quarter we'll be executing the testing required.

Technical support has been good. We find them to be quite helpful and responsive. 

Positive

We initially had some problems with the setup as we had an issue while configuring load generators with the tool. In the end, everything went well. We raised it with the Micro Focus team, and they resolved our issue.

I'd rate the initial setup a four out of five in terms of the ease of implementation. 

We handled the initial setup in-house. We didn't need any outside assistance. 

I'm not aware of the cost. I don't handle that aspect of the product.

My understanding, however, is that it is a little bit pricey. 

We have looked into other tools and find that this tool, although expensive, has many useful features. 

We are just a customer and end-user of the product. 

Even though the cost is expensive, there are good features when compared to all other tools. I'd recommend it to others as something they should use. Of course, it does depend on the applications a company uses. 

I'd rate the solution nine out of ten. 

We use a warehouse management system, my company is like a Dutch Amazon. We use LoadRunner to performance test the warehouse management system for peak load. So if Valentine's Day, Christmas, or whatever comes up, we try to run all functional loads through LoadRunner Cloud and make sure the peak count can be handled by the WMS. We use it almost daily. We have peak periods where the testing will increase, but nowadays it's so busy that throughout the year, it's almost the same. It's the same high load every day and we're testing continuously.

The amount of load on the system wasn't that large a couple of years ago for us to test. So the business case for performance testing wasn't pointing to investing in it, but now we have such huge, increasing numbers and increasing load that it's worthwhile setting up a structured and automated performance test and to invest in something like LoadRunner Cloud.

We use the cloud. The controllers and the dashboard servers are in the Micro Focus cloud. But we use our own load generators, which are on-premise. So we use a hybrid setup.

Before LoadRunner, we weren't even testing performance and now we're performance testing. So we now do performance testing as part of the delivery of a new release, which is an improvement compared to a couple of years ago. 

The TruClient feature is the most valuable for us. An application with testing can only be scripted using TruClient, so it's part web-based, but it also has its own protocol combined with HTTP and HTML. So many other tools do not recognize this specific proprietary protocol. Using TruClient, we can still create scripts that cover everything that we need to cover.

It supports multiple protocols, which is important to us. We also use JMeter open source combined in LoadRunner Cloud. In our company, we also use open-source performance testing tools like JMeter, Gatling, and Locust. It's important to be able to embed those scripts as well into a LoadRunner-based performance test. So it would really help us to have a single place for all kinds of test scripts and the open-source ones.

It's also very important to us that LoadRunner allows full integration into the ACI pipeline. We were focusing on a shift left on not only functional testing but also performance testing. And we're trying to integrate the performance testing in our CI/CD pipelines currently. So the better it supports this, the better and easier it is for us.

Reporting and analysis need improvement. Compared to the old school LoadRunner Windows application, the reporting and analysis are mediocre in LoadRunner Cloud.

I've been using LoadRunner since I started at this company one and a half years ago but the company has been using it for longer. 

We don't have any issues with stability. 

When it comes to efficient and cost-effective scalability, it can be expensive. It is efficient, but also expensive. So the balance would then be just okay.

It's used intensively by the three performance engineers, daily. We have plans to have other teams also use LoadRunner Cloud. So we hope it will increase.

We do our own maintenance on the on-premise part and Micro Focus does the maintenance on the cloud part.

We don't call customer support but we do online requests. We have put in service requests. They're helpful and the replies are quick and valuable. It helps us out.

We make use of virtual user hours. We buy time in the LoadRunner Cloud. It costs around $80,000.

I don't think there are any additional costs to standard licensing.

We tried Neoload and looked at JMeter. We chose LoadRunner because that was the only performance testing tool that had something like TruClient.

We're thinking about using LoadRunner Developer integration. We want to hand over the performance testing responsibility from our performance testing guilds to the actual feature teams, to the scrum teams, so they can do it themselves. The developers do their own performance testing in an early stage, and maybe that is a solution for that.

My advice would be to look at whether you need on-premise load generators or fully on the cloud. Invest in training. It can be complex. You need some training to get started.

I would rate LoadRunner an eight out of ten. 

It is all about load testing. We have to do a lot of load testing in our IT environment. In the investment banking space, you do a lot of end-to-end endurance testing, to see how to benchmark performance based on resources and the CPU memory. So, we will have to benchmark the performance based on trade volumes. Trade volumes are the basic KPI.

Endurance testing needs to be done to see how many trades can be pumped in my environment. I do endurance testing. 

better decision making was done Business KPI & technical KPI can be set by automating loy of endurance testing where given resources thresholds capacity can be measured against  business kpis

The record and playback feature is the most valuable feature. It's all driven by the script, so it's a script-based tool where the background tracing starts. Java's background process does a lot of tracing. The process starts in the background. It sees what peaks of volumes the process can handle. It's easy to use because it's script based, record and playback. I play certain tests. I record those tests, see how they pass through the entire environment, and see how many breaks I get. 

Then we repeat that for multiple numbers. If the first time, I pumped in 1 million trades, and get 5% of the failures, then I try with 2 million trades and I see that there is a 7% failure. These scenarios are easy to do in the LoadRunner. LoadRunner has been the best tool for more than 20 years in the market.

You can do endurance testing, you can do load testing. These are the different types of load testing. It lets you see how much volume you can benchmark in your entire environment, given the resources like CPU and RAM. 

The record and playback is the best feature. You need to use a console. You log in to your console and see the dashboard with how many trades failed and how many trades passed, what the peak loads endurance load were. 

The performance has really improved in terms of running test cycles. The product used to crash on-premises and when it had a lot of trades being pumped in. Because it is memory intensive, it used to crash if it was running out of memory. That was the limitation of the on-premises thing. Running those states and cycles in the cloud is much faster. 

Everything is frozen in the cloud. The RAM, CPU, compute, and storage are provisioned in the cloud, which is becoming easier for running these test cycles. Test cycles are highly effective. Of course, you need to have a test strategy, like volume-based load testing. Configure some test cases and run those test cases in cycles. Cloud performance is much faster. Volume-based endurance testing is easier in the cloud.

It is an old solution, around 20 years old. It was called once Mercury LoadRunner and then it was acquired by HP, it became HP QTP. That was around 2007, it was known as Hewlett-Packard HP QTP. Since then it has been acquired by OpenText.

It is very stable.

We have around 100 users, they are functional experts who use this for load testing.

The people who have been responsible for setting the KPIs will decide if we will expand the solution. They are the end-users. It will depend on the dashboard and the results of the load testing.

LoadRunner is a very old product in this industry. It was a little difficult to get to the right support team. Now there's a professional service group that is better than they were before. 

If scaling becomes a problem, then we have to involve the support, the right kind of support to actually fine-tune and troubleshoot the entire configuration. But with the cloud version, that risk is minimized. It has adequate storage available.

It's a subscription-based, pay-per-user license. I wouldn't say it's expensive. 

Because it was an on-premise license, it was a costly affair. Only certain stakeholders could use it. Now, it is enterprise-wide, we can have any number of cloud users performing the load testing because it is pay-per-user.

I would recommend LoadRunner. It is an industry-leading tool. You can benchmark the volumes on the dashboard and it is easy to use.

I would definitely recommend it for investment banks and certain businesses like OTC derivatives.

I would rate LoadRunner an eight out of ten. It has good documentation. The recording and playback scripts can be easily done. I would like for there to be better integration with other tools so that when you do load testing you can also do a security check.

We use LoadRunner Cloud for functional testing, where we can log in online using the portal.

Our primary use case is load testing, where we can simulate a scenario with more than 100 users accessing the system at the same time. This shows us things such as the performance of the system and how it reacts when multiple people are using it.

The most valuable feature is that we do not have to accommodate the load-testing infrastructure in our own data center. Normally for load testing, you have to have your own hardware and tools on-premises. With LoadRunner Cloud, the testing will be done remotely using their resources.

There are three modules in the system that are different products packaged into one, and they can sometimes be difficult to figure out, so they should be better integrated with each other.

The current support model is something that can be improved.

We have been using this product for five years.

This is a stable product and as far as we're concerned, there is no other choice on the market.

We are just in the process of scaling now. Our intention is to expand but it will take time to do so. We are using it for five projects right now and we need to acquire more licenses.

At this time, Micro Focus is handling the support, which is kind of messy compared to going directly to HP. There is no single point of contact between sales and support.

Sometimes, if you open a ticket with technical support then we might be waiting for a week. It is not always this way, but in general, it is not what we would expect.

We also use HP ALM for functional testing.

The initial setup of the cloud version is easy compared to using it on-premises. In the on-premises deployment, you have to set up all of the servers starting with bare metal and it will take no less than three months to deploy. However, with LoadRunner Cloud, all you have to do is buy the resources and execute it from there.

There is no monthly or yearly cost but rather, the fees are based on the amount of traffic that you use. It is difficult to predict the costs until after you have begun using it.

My advice for anybody who is implementing LoadRunner Cloud is to make sure that when you buy the package, it is comprehensive. All of the modules should be there, including the support package. Otherwise, it will be hard to use.

In summary, all of the features that we need are there and it does everything that it is supposed to it. That said, the integration of modules and support are still in need of improvement.

I would rate this solution a seven out of ten.

I have been using the solution for testing Salesforce and a few other applications.

The solution has improved the performance of the software.

The solution is intuitive, easy to use and navigate.

They should minimize the use of coding for the solution. Also, they should include features to import other scripts without rewriting them.

I have been using the solution since 2019.

It is a stable solution.

The solution is scalable. I rate its scalability between a seven and nine out of ten.

The solution's technical support has been good.

Positive

We have used StormRunner and JMeter before. Also, we are doing a proof-of-concept for NeoLoad.

The solution's setup process was easy. Although, we encountered a few issues sometimes.

The solution is expensive. There should be a version that optimizes the price-to-performance ratio for the service package.

The solution is costly. I rate it a nine out of ten.

Our primary use case for the solution is performance testing, validation and baseline testing. We deploy the solution on the cloud.

We find the ease of infrastructure maintenance and the enhanced capabilities of the cloud version, such as browser metrics, valuable.

The product price could be more affordable compared to similar products.

We have been using the solution for approximately three years.

The solution is stable.

The solution is scalable.

The initial setup was straightforward, and it took approximately a day.

I rate the solution a nine out of ten. My advice to users considering this solution is to pay attention to scheduling.

I have been using LoadRunner Cloud for performance testing.

LoadRunner Cloud allows us to do performance testing without having to create our own physical infrastructure and set up a load generator. Normally, these steps would be required.

The most valuable feature is that you can create an infrastructure on-demand and do performance testing with it. There is no need to create physical infrastructure.

Using this solution does not require the use of a load generator.

Improvements to the reporting would be good.

Technical support can be improved.

I have used LoadRunner Cloud in only one project so far, for a period of about three months.

I have found this to be a very stable product.

I only needed to simulate 40,000 users for my project but I understand that it will work for up to 2,000,000 users. That is huge and I can say that scalability is very good.

This vendor, Micro Focus, is not very good at technical support.

I have used some open-source tools and LoadRunner Cloud is more straightforward to use.

The initial setup is normal and I have not found any complexity with it.

I would rate this solution an eight out of ten.

We use it to get response times around the world for external applications. We use it on top of our own virtual users for remote site testing. We include it in our scenarios in our performance center and use the results in the LoadRunner analysis tool.

We can determine response times for our external applications, from most places around the world, for a small fee.

The most valuable feature is having load generators in countries where we don’t have access to them.

An area for improvement is analytics on why response times are slow from certain countries. Slowness can be caused by the laptop, the connection, the VPN, the internal network, the country's internet, etc.

It has been stable every time I have used it. We don’t put much stress on it since we have our own performance center and load generators.

In terms of integration and configuration of the product in our AWS environment, it is the easiest Micro Focus tool I have ever used.

The pricing is very reasonable and the licensing is straightforward.

You decide on the number of virtual users you will need to support multiple runs or for a year and purchase that quality of virtual-user hours. We chose to procure this solution via the AWS Marketplace because of remote site testing and low cost.

I rate this solution a ten out of ten. It addresses a need in performance testing tools and is easy to purchase and use.