We performed a comparison between Apache JMeter, OpenText LoadRunner Cloud, and ReadyAPI based on real PeerSpot user reviews.
Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools."We like that Apache JMeter has different features and different plugins and that they are free of charge."
"Very user-friendly and easy to use."
"What I like best about Apache JMeter is its user-friendly GUI because even if you don't have very good coding knowledge or understanding, or even if you don't come from a development background, you can still use the solution with just a few clicks. This is what's unique about Apache JMeter, in comparison with other tools in the market. As Apache JMeter is open source, when there's a missing feature, you can search in several community blogs for plugins that you can use to modify Apache JMeter to meet your requirements, and this is another advantage."
"It is very quick and user-friendly."
"The recording and playback functionality is helpful."
"It is open source as well as relatively extendable. It allows us to extend and add additional functionality and features. Its deployment is also very easy."
"It's open source, so I like that about the product. And there's a lot of community support for it."
"Apache JMeter is well-known and widely used among developers, particularly on popular developer forums. While it may not have the most user-friendly interface, it offers strong support through official manuals and various articles from companies providing load testing services. The tool is free, has a substantial community, and serves as a fundamental choice for testers, especially those new to performance testing. While other tools like K6 may be more developer-oriented, JMeter's affordability and accessibility make it suitable for those without extensive performance testing experience."
"The initial setup was straightforward."
"Keeping up with DevOps, thus the best feature of StormRunner is that we don't have to build and maintain infrastructure anymore."
"OpenText LoadRunner Cloud eliminates the need for our own testing infrastructure when running tests."
"The most valuable feature is that you can create an infrastructure on-demand and do performance testing with it."
"The reports are very relevant to the customers’ expectations."
"The product supports a wide variety of technology compared to any other tool."
"It's a fast product, so you don't have much trouble in terms of maintenance overhead. You don't want to just look into configuring load generators, look for upgrades, and end up having that take up a lot of your time. With this solution, you just log in and you start using it. This means that there is a huge benefit in terms of the overhead of maintaining the infrastructure and the maintenance effort."
"This solution is SaaS based so we can utilize cloud technology, which is less time consuming and saves a lot of of money."
"It can create stress tests very fast, and some features help you do it fast."
"For anyone who does not have experience with automation, ReadyAPI provides a sense of comfort, especially for testers who find it hard to go directly into coding."
"The most valuable feature has been the assertion as a test step as this has allowed us to increase the scope of testing and validation."
"One of the features of ReadyAPI that's worth mentioning is that it allows you to parameterize. I'm working with more than two hundred resources, so I don't have to go and make a small change at each point every time. I have the option to just parameterize in one place for the changes to reflect everywhere. Another valuable feature of ReadyAPI is that it provides a customized environment. In my company, you work in different environments, such as QA, UAT, and LT, so the URLs for every environment are different. In ReadyAPI, you can customize your environment, set it up, then start working on it. Another feature worth mentioning that's offered in ReadyAPI is automating your test value as the tool allows Groovy scripting. In your test case, you can use a Groovy script that says that in a particular test case, you have ten resources, but you just want to exhibit five and that you don't want to exhibit the remaining five. You can write a small Groovy script that lets you execute just five resources out of the ten resources. I also like that ReadyAPI allows you to read the data from CFC and Excel. It also allows you to create or customize your data, but that only works at a certain point because every application has its specific data. ReadyAPI cannot generate every data, but when I'm posting and I want to generate a random name, such as a first name, I can do it in ReadyAPI. The tool also has many different features which I find valuable, including Git integration."
"It's great for those that don't have as much exposure to programming."
"When we are doing API testing we have found it to be very efficient to receive results. Additionally, you are able to do tests directly from the API."
"The great thing about ReadyAPI is that it has a wide variety of functions. You can test any API that you come across. You are not limited to one type of API. It supports many APIs."
"The most valuable feature is being able to run each version for test suites."
"Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult."
"At present, if the number of virtual users increases beyond 10,000 when testing, then it results in a Java heap which causes the solution to crash."
"Apache JMeter's UI can be made more colorful."
"We're like the solution to be more user-friendly."
"The solution could use some sort of educational features to offer tips and hints to help users navigate it better. They should improve the manuals and help files."
"The reporting section of the solution can be better."
"I sometimes found the documentation to be not as explanatory as I would've liked it. In the cases that I can think of, I was looking for a rather hand-holding approach with Step A, B, and C, but then I realized that with a product that is open source like this, you can't do handholding. That is because there are so many different uses and different unique environments and setups for it, but I remember thinking a few times that if they only just said this."
"The initial setup is complex and needs to be upgraded."
"It doesn't provide custom reports. You can only use the default reports which contain irrelevant data or is missing data that we need."
"It should have a feature to report with a 99.9 percentile success rate."
"I don't know of any features that should be added. The solution isn't lacking anything at this point."
"Its scripting features need improvement."
"CI/CD integration could be a little bit better. When there's a test and if you see that there are high response times in the test itself, it would be great to be able to send an alert. It would give a heads-up to the architect community or ops community."
"The product must provide agents to monitor servers."
"There are three modules in the system that are different products packaged into one, and they can sometimes be difficult to figure out, so they should be better integrated with each other."
"Their documentation is not technical enough for us. We would like to have much deeper technical documentation so that we can self-serve without constantly having to go back to them and ask."
"If ReadyAPI had more integration with all of the big tools on the market then this would be very useful."
"It doesn't have connectors to the NoSQL database. This is one of the things where they do not have a very solid strategy today. Other solutions have an in-built mechanism where I can directly and easily connect. An API is more around a user submitting a request on the frontend. It then hits the backend, puts the data, and responds back. If I am hitting MongoDB or NoSQL databases, I do not have ready-made inbuilt solutions in ReadyAPI that can easily help me in automating it faster. In our organization, we deal with NoSQL databases, and therefore, we need Groovy. We just cannot have a connector from ReadyAPI to do that. I have to write Groovy scripts. If you have themes that are predominantly using MongoDB, it leads to more maintenance and support activity because we are introducing more code into our commission. In terms of additional features, it can have cloud support. This is one of the things where we are getting into cloud support. We'll see how it works, but it is one of the doubts that we still have."
"The reporting is not very robust and needs to be improved."
"The Property Transfer capability could be more user friendly because it is a bit difficult to understand."
"ReadyAPI can improve because it is limited to only SOAP and REST services. They should update the solution to include more protocols so that other people are not limited to SOAP and REST services. Other than would be able to utilize it."
"The UI should be flexible. Currently, the UI isn't."
"Better compatibility or more support for the older versions would be helpful."
"There is room for improvement in ReadyAPI, particularly in the user interface."
