Find out what your peers are saying about Apache, Perforce, Tricentis and others in Performance Testing Tools.
With Apache JMeter, I have gained great statistics for performance and server metrics.
I have seen an ROI from this tool, as it provides enormous value.
With AI models ChatGPT, troubleshooting issues has become very easy for us.
The support for Apache JMeter is excellent.
Apache JMeter has strong support through its vast Java-based community on platforms like Stack Overflow.
The customer service and technical support for OpenText Enterprise Performance Engineering (LoadRunner Enterprise) is reasonable, not impressive, but provides adequate assistance.
SmartBear had an ALM tool that helped manage project documentation, including Jira-related specifications, test plans, and test cases.
JMeter is highly scalable, easily handling increased loads through the use of multiple servers.
This restricts the number of users and necessitates increasing load agents or distributing the script across multiple machines.
For backend automation and performance testing with web services, web APIs, and queue management systems, I would rate Apache JMeter's scalability as between eight and nine.
I rate the scalability of OpenText Enterprise Performance Engineering (LoadRunner Enterprise) as ten when using a scale from one to ten, with one being low.
I rate ReadyAPI between five to six for scalability due to complexities associated with scripting.
ReadyAPI's performance testing capabilities can impact API scalability assessments.
JMeter performs exceptionally well, especially in non-GUI mode, which supports high loads efficiently.
Several necessary features still need improvements, specifically in terms of reports and additional functionalities compared to other commercial tools.
Previous versions of Apache JMeter were a little unstable, but the new versions are very stable.
However, it remains quite stable.
Once all configurations and preparations are done, it is very stable.
With AI becoming more prominent, they can implement features where it can generate code by itself based on the results or provide suggestions.
Currently, we need to use multiple separate JMeter instances to simulate reductions in load, which isn't ideal.
The tool needs improvements related to client-side metrics, integrating with tools like YSlow or HTTP Watch, and enhancing mobile testing capabilities.
It could be much better, especially with modern AI capabilities.
One issue I found with ReadyAPI is related to event listeners compared to JMeter or SoapUI.
I'm considering the use of AWS and its Lambda functionalities prepared by the vendor.
Using JMeter helps us avoid additional costs for high-load testing since it is open-source and allows for unlimited virtual users at no extra cost.
It's a cost-effective solution.
Apache JMeter is completely free as it is open-source.
It is neither cheap nor expensive.
The pricing of ReadyAPI is reasonable, considering its functionality compared to other tools in the market.
Currently, we don't extensively use the performance testing due to license costs.
JMeter facilitates scripting capabilities, which include options for Groovy scripts.
It's useful for both the person conducting the test and the higher management, like project managers or senior executives, who may not know about the test.
Despite being open source, it offers features comparable to paid tools.
The best features of this solution are easy scripting and broad platform support.
It also aids in faster feedback to developers, allowing them to implement developments in a sprint without the need for extensive testing afterwards, thus improving our time to market metrics.
ReadyAPI is valuable for web service automation and allowing us to generate test cases and automate processes.
I consider ReadyAPI a cost-effective solution because it covers three verticals without needing to purchase separate tools for security, performance, or functional testing.
| Product | Market Share (%) |
|---|---|
| Apache JMeter | 16.1% |
| OpenText Enterprise Performance Engineering (LoadRunner Enterprise) | 5.7% |
| ReadyAPI | 3.1% |
| Other | 75.1% |
| Company Size | Count |
|---|---|
| Small Business | 27 |
| Midsize Enterprise | 24 |
| Large Enterprise | 55 |
| Company Size | Count |
|---|---|
| Small Business | 12 |
| Midsize Enterprise | 9 |
| Large Enterprise | 73 |
| Company Size | Count |
|---|---|
| Small Business | 5 |
| Midsize Enterprise | 5 |
| Large Enterprise | 28 |
Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.
You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.
What protocols does JMeter support?
How does JMeter work?
JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.
You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.
There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.
Apache JMeter Key Features
Apache JMeter Benefits
The JMeter extensible core has numerous benefits:
Reviews from Real Users
Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."
"I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.
A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”
OpenText Enterprise Performance Engineering (LoadRunner Enterprise) provides robust performance testing capabilities with scalable and user-friendly tools. It supports multiple protocols for diverse applications, ensuring reliable and comprehensive performance metrics for organizations.
Designed for extensive performance testing, OpenText Enterprise Performance Engineering offers advanced integration features and global testing capabilities. Users value its ease of scheduling, detailed analysis, and efficient resource management. It simulates real-world scenarios to deliver valuable metrics across industries. Its intuitive interface, while needing smoother navigation, aligns with its flexibility and versatility. Enhanced reporting and cloud-based integration, especially with AWS, are potential growth areas alongside improved third-party tool integration and technical support.
What are the key features of OpenText Enterprise Performance Engineering?OpenText Enterprise Performance Engineering is implemented in banking, healthcare, and retail industries, assisting in load, stress, and performance testing. Organizations utilize its capabilities for validating web, API, cloud, ERP, and Citrix applications, ensuring reliability with comprehensive metrics for large-scale user handling.
ReadyAPI is an all-in-one automated testing platform that allows teams to create, manage, and execute automated functional, security, and performance tests in one centralized interface.
ReadyAPI Features
Some of ReadyAPI’s key features include:
ReadyAPI Benefits
Some of the benefits of using ReadyAPI include:
Reviews from Real Users
Below are some reviews and helpful feedback written by Dell EMC Unity users.
PeerSpot user Vallalarasu P., Test Architect at a tech services company, states, “ReadyAPI is one of the best tools for API testing because they have made a single platform for functional testing, load testing security, and also service actualization. We also have virtual work that can be an add-in within ReadyAPI. For integration for CACD, they have something called TestEngine, which can also be an add-on for ReadyAPI. We use Python request library and things like that but if you're a bigger organization with hundreds of APIs, then ReadyAPI is a one-stop solution for complete API testing. If you consider TestComplete and other products for an equivalent outcome, you might get something nearly comparable, butReadyAPI is the outstanding product.”
An IT Manager at an insurance company says the solution has “Fast automation, less coding, and is pretty lightweight. When you are working in sprints, you need to have continuous feedback. ReadyAPI definitely helps in automating very fast and rapidly. We have less coding, and we can more easily define our assertions. We don't use it for full-blown performance testing, but normally if you are doing your functional testing, it gives you the request and response time. Anybody who is doing functional testing can see what the request and response times are and raise a flag based upon their business affiliates, that is, whether it is meeting their affiliates. You can identify this during functional testing."
Balamurugan A., Manager at a financial services firm, comments, “We like the user interface. The most valuable features are the integration with Jira and the test management tools.
They have interfaces with our performance tools, so we were able to leverage all of these integrations and plugins. It is very good from an integrative solution standpoint.”
