We performed a comparison between Apache JMeter and ReadyAPI based on real PeerSpot user reviews.Find out in this report how the two Performance Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
"We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."
"I use all the tools, but one feature that stands out is JMeter's ability to test when services are sending a particular kind of request. We are using specific ports to send queries, and assess the performance based on the time it takes these queries to respond. You can use it with stuff other than the web performance."
"We appreciate that the solution is free to use, as an open-source tool."
"The performance of the solution is excellent."
"The most valuable feature of this solution is being able to launch many requests and scheduling simulating human interactions with the application."
"It's a free tool."
"A lot of things are valuable. It is free. It has a lot of features, such as report generation and integration with CI/CD, which makes it very competitive with the other paid solutions available in the market. It is a good solution."
"Apache JMeter is stable."
"The great thing about ReadyAPI is that it has a wide variety of functions. You can test any API that you come across. You are not limited to one type of API. It supports many APIs."
"The initial setup of ReadyAPI is straightforward."
"ReadyAPI's best features are user-friendliness, smooth integration with Postman, the speed of creating test cases, and integration with customer data."
"The most valuable feature has been the assertion as a test step as this has allowed us to increase the scope of testing and validation."
"The most valuable features of ReadyAPI are the drag-and-drop options and the integration with versioning tool solutions, such as Git."
"It's easy to learn how to use it."
"ReadyAPI's best features are that it's user-friendly and its behavior-driven development is flexible."
"This solution is very intuitive. Once you finish your first few testing cases, you can change several parameters and create lots of testing cases. You could use the same testing cases for different purposes such as automation, performance and screen testing."
"What needs improvement in Apache JMeter is the very high load requirements when you want to scale it beyond certain thresholds. For example, small to mid-range testing is very easily done with Apache JMeter, but if you scale and increase the load, then it would be a problem because the tool consumes a lot of resources, probably because Apache JMeter provides an enriched UI experience, so it consumes a lot of memory and requires high CPU usage. This means you have to manage your infrastructure, or else you'll have high overhead expenses. As Apache JMeter is a heavyweight tool, that is an area for improvement, though I'm unsure if Apache can do something about it because it could be a result of the way it's architected. What I'd like to see from Apache JMeter in the future is for it to transition to the cloud, as a lot of cloud technologies emerge around the globe, and a lot of people prefer cloud-based solutions or cloud-native tools. Even if a company has a legacy system, it's still possible to transition to the cloud. I've worked with a company that was an on-premise company that moved to the cloud and became cloud-native. If Apache JMeter could transition to the cloud, similar to k6, then it could help lessen the intense resource consumption that's currently happening in Apache JMeter."
"If the solution was GUI based, I believe that it would be more versatile."
"Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly."
"The solution needs more metrics for reporting."
"It should start supporting the presentation layer. It currently provides performance testing specifically at the application and API level. It can be extended to the presentation layer, which includes mainly Angular and React frameworks. It should also be easy to use and easy to train people."
"It will be much easier, and beneficial for the individual to run it on their own machines rather than having a high-end infrastructure, more CPUs, or more memory that has been consumed by Apache JMeter."
"At present, if the number of virtual users increases beyond 10,000 when testing, then it results in a Java heap which causes the solution to crash."
"JMeter should be more stable. Every time there is a new release coming up, a lot of its older functionalities or the new functionalities that are brought in are not very well-documented. It should be documented properly, and there should be proper use cases."
"ReadyAPI could improve by having dynamic validation information."
"It is challenging doing upgrades and patches because sometimes the environmental variables or suits in the projects get erased."
"The initial setup could be less complex."
"ReadyAPI could improve by adding a conversion tool from one file type to another. Import support for multiple file types would be beneficial."
"ReadyAPI's customer support isn't that great, particularly their response time."
"What needs improvement in ReadyAPI is its load testing feature because there was a hiccup when my team performed some load testing on the tool. My team had meetings with the ReadyAPI team and tried to get that issue fixed, but it still hasn't improved. This is a shortcoming of the tool, especially when you compare it with HP LoadRunner."
"Areas for improvement include the security files, endpoints, and process sessions."
"Can be improved by including an inherent feature for UI automation."
Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.
You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.
What protocols does JMeter support?
How does JMeter work?
JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.
There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.
Apache JMeter Key Features
Apache JMeter Benefits
The JMeter extensible core has numerous benefits:
Reviews from Real Users
Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."
"I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.
A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”
ReadyAPI is an all-in-one automated testing platform that allows teams to create, manage, and execute automated functional, security, and performance tests in one centralized interface.
Some of ReadyAPI’s key features include:
Some of the benefits of using ReadyAPI include:
Reviews from Real Users
Below are some reviews and helpful feedback written by Dell EMC Unity users.
PeerSpot user Vallalarasu P., Test Architect at a tech services company, states, “ReadyAPI is one of the best tools for API testing because they have made a single platform for functional testing, load testing security, and also service actualization. We also have virtual work that can be an add-in within ReadyAPI. For integration for CACD, they have something called TestEngine, which can also be an add-on for ReadyAPI. We use Python request library and things like that but if you're a bigger organization with hundreds of APIs, then ReadyAPI is a one-stop solution for complete API testing. If you consider TestComplete and other products for an equivalent outcome, you might get something nearly comparable, butReadyAPI is the outstanding product.”
An IT Manager at an insurance company says the solution has “Fast automation, less coding, and is pretty lightweight. When you are working in sprints, you need to have continuous feedback. ReadyAPI definitely helps in automating very fast and rapidly. We have less coding, and we can more easily define our assertions. We don't use it for full-blown performance testing, but normally if you are doing your functional testing, it gives you the request and response time. Anybody who is doing functional testing can see what the request and response times are and raise a flag based upon their business affiliates, that is, whether it is meeting their affiliates. You can identify this during functional testing."
Balamurugan A., Manager at a financial services firm, comments, “We like the user interface. The most valuable features are the integration with Jira and the test management tools.
They have interfaces with our performance tools, so we were able to leverage all of these integrations and plugins. It is very good from an integrative solution standpoint.”
Apache JMeter is ranked 1st in Performance Testing Tools with 41 reviews while ReadyAPI is ranked 4th in Performance Testing Tools with 21 reviews. Apache JMeter is rated 7.4, while ReadyAPI is rated 7.8. The top reviewer of Apache JMeter writes "It's a free, scalable tool that's good for checking backend services". On the other hand, the top reviewer of ReadyAPI writes "Allows you to parameterize in one place for the changes to reflect everywhere and lets you customize the environment, but its load testing feature needs improvement, and costs need to be cheaper". Apache JMeter is most compared with Postman, BlazeMeter, Micro Focus LoadRunner Professional, Tricentis NeoLoad and Katalon Studio, whereas ReadyAPI is most compared with ReadyAPI Test, SmartBear TestComplete, Tricentis Tosca, Katalon Studio and Micro Focus LoadRunner Professional. See our Apache JMeter vs. ReadyAPI report.
See our list of best Performance Testing Tools vendors.
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.