Based on the requirements, we use Micro Focus LoadRunner Professional. Our clients have their licenses and access. So, we execute in the client environment itself, which involves, basically, running a load test or stress test using the tool and analyzing the system performance with different metrics like server session and clientset.
Micro Focus LoadRunner Professional improved our organization's functioning. However, the cost is very high, and the support system is very low. If you ask for one ticket, like, you create a case, and they'll come back in one week of time. Then, they keep asking for most of the access to the environment, which is, like, the client's environment, and we can't provide access to the support. So there are a lot of challenges with those things. Upgrading to the new versions has a lot of challenges. The tool, access, and features they are building meet industry standards and are very helpful.
When you speak about its integration capabilities, especially when we talk about the latest version and not the older version that we had integrated with Dynatrace. So, we are integrating the current version with a tensor database and Grafana dashboards. So we can directly communicate it. The current version also integrates with DataDot, where whatever execution is there, we can collate results in DataDot itself and analyze the server-side metrics with that time duration so that everything is in one single place.
The kind of protocols that the current version supports is good since it's improved when compared to Version 12.55. I am very much happy with the tool and its process. The cost and the support lakhs a lot.
The support and price are the downsides of the solution. Micro Focus should decrease the cost. So, I'll explain one scenario. So, I work for multiple different clients to whom I provide support on the subject matter. Regarding the cost, if you consider 20,000 virtual user hours, if a user uses it for ten minutes, one virtual user is down. And if a user uses, like, 100 users for ten minutes, 100 virtual user hours are gone. So, instead of 100 multiplied by ten, it should be the number of minutes that get converted into hours, and that is the number of virtual hours that should be gone. In pay-per-use, the cost is more, and the unlimited license, like, an unlimited number of executions, costs even more. And mobile solutions, like earlier, could be integrated with the mobile center. Now mobile centers are very costly. So, doing it per device and testing has become challenging. I need to depend on other tools where I need to convert those scripts to LoadRunner and then run the test on this tool. So I need to pay two different software techs for licenses to solve mobile performance testing. In short, if that is done within that system, it could be helpful for us.
The licensing system is not very convenient for me. I would like to increase the number of working hours per license. Also, performance testing on mobile devices could be better.
Performance testing on mobile devices requires external software. You have many tools, and you have other tools which support on-device performance testing. So that tools can be integrated with LoadRunner. But, then the cost becomes high. So, if LoadRunner has some specific specialty, like, any on-device testing would be of a single user. If I connect my USB to a laptop and execute the test on a device, and test the application using the number of, like, one user running it for a certain duration of time, then it would be helpful for me to calculate the response time as well as the well device-level metrics like CPU memory or battery consumption. Right now, LoadRunner is lacking in the aforementioned areas.
Testing your kind of WebRTC protocols, like if you have a streaming application, and I want to join 5,000 concurrent user sessions. So, it is a one-session ID for 5,000 users joining that video session, and there is a tutor who is, like, teaching the lessons to the students. So this is a scenario. It's a kind of video conversation. I just want to analyze the number of users, the user behavior, video quality, audio quality, and how many users get dropped from the call. I think the latest version for 2023 doesn't support a few particular things causing lagging issues. It has an MQTT protocol, and executing a test on the Kafka messaging queue, I don't think we need to write a custom Java code and then we need to build those Java JAR files or load agents, and then, normally, we can run it. So there is a dependency. So there are a lot of Java JAR files we need to substitute and run. So instead of that, if LoadRunner itself has that entire tool set installed in their location, and if you can just plug and play the request, it would be good. If you go to Apache JMeter, it's simple, so if you go for ActiveMQ, I give the configuration details and then give a custom message. It is a simple step where I can execute and push thousands to ten thousands of messages to the queue. But in LoadRunner, it is a complex thing.
It's been three years since we tried to migrate from Micro Focus LoadRunner Professional Version 12.55 to LoadRunner Enterprise 2023, but there is no active support from the team. We did not deploy because of a lack of support. We need a license bundle if all things are to be migrated. We have one TB of data that needs to be migrated to the new system.
For maintenance, I think one person is required, and sometimes to update, like, if you do hundreds of activations and browse the tools, which overall has a slowness in general. So maintaining and creating tables and all those stuff requires
support, and I think one resource is required. The person should preferably be an administrator, and he should be aware of the database, repository file system, networking, and all such stuff.
I have been using Micro Focus LoadRunner Professional for ten years. I am an end-user of the solution. I am using Micro Focus LoadRunner Professional Version 12.55, and sometimes for some projects, we use Micro Focus LoadRunner Enterprise 2022.
Stability-wise, I rate the solution a nine out of ten.
Scalability-wise, I rate the solution a nine out of ten. Scalability is good. I can generate the number of user loads while adding a number of cloud instances and execute them anytime. I didn't see any issues with the tool while trying to scale at a large level.
Around 10 to 15 performance engineers are using the solution in my company. Also, the solution is used daily, and I mostly use it in the client environment.
So, it's currently used at its maximum rate.
On a scale of one to ten, where one is low, and ten is high-quality technical support, I rate the support a one.
Previously, we were using HP. Though the tool's functionalities remain the same, its ownership keeps getting changed. We go with multiple open-source solutions like JMeter and all.
I rate the initial setup a seven or eight on a scale of one to ten, where one is difficult and ten is easy. Considering my impressions of the product, I understand that it is a commercial tool, and it is very stable and of good quality. In general, it is very good. But, there are multiple factors where we can reject it because of its cost, support, and considering that anything that is very new can be done in the open-source tool. So rather than this particular thing, we need Micro Focus to put in extra effort. So, green screen applications are not supported by the solution. Also, ActiveMQ won't be supported in the solution. So for that, I need to write a custom code. I need to build different Java JAR files. Then, it doesn't support Java 64-bit, which is very poor. It supports only Java 32-bit version. For ActiveMQ and Kafka messaging queues, Java 64-bit is more dependable. So, that is completely redundant.
In the organization part, we have it deployed on-prem. But most of the tool licensing that we use is on the client side itself since the client purchases the tool, and so in their environment, we do the test.
On a scale of one to ten, where one is low and ten is a high price, I rate the solution a five. So, many things can be done with open-source solutions rather than Micro Focus LoadRunner Professional. But LoadRunner provides scalability and stability, which helps save the money of our customers.
If you have enough money, then you can go ahead with the solution.
Overall, I rate the solution an eight out of ten.