Find out what your peers are saying about Apache, Perforce, Tricentis and others in Performance Testing Tools.
With Apache JMeter, I have gained great statistics for performance and server metrics.
LoadRunner Cloud helps with risk elimination by reducing performance degradation in production, ensuring a better end-user experience.
The ROI is not necessarily cost savings. Sometimes a customer wants to use OpenText LoadRunner Cloud, or it's the only tool that will solve the problem depending on the application.
With AI models ChatGPT, troubleshooting issues has become very easy for us.
The support for Apache JMeter is excellent.
Apache JMeter has strong support through its vast Java-based community on platforms like Stack Overflow.
I faced issues with OpenText LoadRunner Cloud support when a problem took three to four months to resolve, which negatively impacted our project, especially when key team members were unavailable during leave periods.
It's important to note that OpenText has recently taken over Micro Focus.
SmartBear had an ALM tool that helped manage project documentation, including Jira-related specifications, test plans, and test cases.
JMeter is highly scalable, easily handling increased loads through the use of multiple servers.
This restricts the number of users and necessitates increasing load agents or distributing the script across multiple machines.
For backend automation and performance testing with web services, web APIs, and queue management systems, I would rate Apache JMeter's scalability as between eight and nine.
It is very scalable, and on the cloud, it's even more scalable, potentially unlimited.
With load generators available, it is easily scalable to meet our needs.
The solution is highly scalable, which is its main feature.
I rate ReadyAPI between five to six for scalability due to complexities associated with scripting.
ReadyAPI's performance testing capabilities can impact API scalability assessments.
JMeter performs exceptionally well, especially in non-GUI mode, which supports high loads efficiently.
Several necessary features still need improvements, specifically in terms of reports and additional functionalities compared to other commercial tools.
Previous versions of Apache JMeter were a little unstable, but the new versions are very stable.
OpenText LoadRunner Cloud is extremely stable for our use case.
Once all configurations and preparations are done, it is very stable.
With AI becoming more prominent, they can implement features where it can generate code by itself based on the results or provide suggestions.
Currently, we need to use multiple separate JMeter instances to simulate reductions in load, which isn't ideal.
The tool needs improvements related to client-side metrics, integrating with tools like YSlow or HTTP Watch, and enhancing mobile testing capabilities.
In-depth analysis tools found in the standalone LoadRunner analysis, such as graph merging and setting granularity, would be beneficial.
The technical personnel are not able to fix issues quickly, which becomes problematic during critical situations.
I expect an improvement in the cloud location offering to better serve local applications, particularly to enhance testing accuracy for users in regions like Thailand.
One issue I found with ReadyAPI is related to event listeners compared to JMeter or SoapUI.
I'm considering the use of AWS and its Lambda functionalities prepared by the vendor.
Using JMeter helps us avoid additional costs for high-load testing since it is open-source and allows for unlimited virtual users at no extra cost.
It's a cost-effective solution.
Apache JMeter is completely free as it is open-source.
OpenText LoadRunner Cloud pricing is flexible, offering a more affordable solution compared to the more expensive on-premise LoadRunner.
It's delivering functionality, but we also use JMeter, which is free.
The pricing of ReadyAPI is reasonable, considering its functionality compared to other tools in the market.
Currently, we don't extensively use the performance testing due to license costs.
JMeter facilitates scripting capabilities, which include options for Groovy scripts.
It's useful for both the person conducting the test and the higher management, like project managers or senior executives, who may not know about the test.
Despite being open source, it offers features comparable to paid tools.
OpenText LoadRunner Cloud can scale in a cloud-based environment to support up to ten thousand concurrent users without capacity loss, which is not possible with on-premise solutions on personal machines.
Its LoadRunner functionality allows us to record a solution's networking protocol and replay them.
A significant difference is in its depth of analysis.
It also aids in faster feedback to developers, allowing them to implement developments in a sprint without the need for extensive testing afterwards, thus improving our time to market metrics.
ReadyAPI is valuable for web service automation and allowing us to generate test cases and automate processes.
I consider ReadyAPI a cost-effective solution because it covers three verticals without needing to purchase separate tools for security, performance, or functional testing.
| Product | Market Share (%) |
|---|---|
| Apache JMeter | 16.1% |
| OpenText Core Performance Engineering (LoadRunner Cloud) | 9.3% |
| ReadyAPI | 3.1% |
| Other | 71.5% |
| Company Size | Count |
|---|---|
| Small Business | 27 |
| Midsize Enterprise | 24 |
| Large Enterprise | 55 |
| Company Size | Count |
|---|---|
| Small Business | 6 |
| Midsize Enterprise | 8 |
| Large Enterprise | 29 |
| Company Size | Count |
|---|---|
| Small Business | 5 |
| Midsize Enterprise | 5 |
| Large Enterprise | 28 |
Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.
You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.
What protocols does JMeter support?
How does JMeter work?
JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.
You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.
There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.
Apache JMeter Key Features
Apache JMeter Benefits
The JMeter extensible core has numerous benefits:
Reviews from Real Users
Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."
"I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.
A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”
OpenText Core Performance Engineering offers scalable and efficient load testing using a cloud-based architecture, eliminating the need for physical infrastructure and supporting a wide range of users and testing scenarios.
OpenText Core Performance Engineering supports seamless integration with popular tools and delivers real-time anomaly detection and performance insights. With an intuitive interface, it supports scripting protocols and provides tests for cloud-hosted and on-premise applications. The platform streamlines performance testing and infrastructure management, addressing the needs of diverse sectors like banking, retail, and IT. However, it requires enhancements in reporting, integration, documentation, and support for older scripts.
What are the key features?Organizations in banking, retail, and IT sectors implement OpenText Core Performance Engineering for performance testing, integrating it within CI/CD pipelines. It suits public server application testing and enterprise systems like SAP and Salesforce, meeting diverse industry demands for app stability and responsiveness testing.
ReadyAPI is an all-in-one automated testing platform that allows teams to create, manage, and execute automated functional, security, and performance tests in one centralized interface.
ReadyAPI Features
Some of ReadyAPI’s key features include:
ReadyAPI Benefits
Some of the benefits of using ReadyAPI include:
Reviews from Real Users
Below are some reviews and helpful feedback written by Dell EMC Unity users.
PeerSpot user Vallalarasu P., Test Architect at a tech services company, states, “ReadyAPI is one of the best tools for API testing because they have made a single platform for functional testing, load testing security, and also service actualization. We also have virtual work that can be an add-in within ReadyAPI. For integration for CACD, they have something called TestEngine, which can also be an add-on for ReadyAPI. We use Python request library and things like that but if you're a bigger organization with hundreds of APIs, then ReadyAPI is a one-stop solution for complete API testing. If you consider TestComplete and other products for an equivalent outcome, you might get something nearly comparable, butReadyAPI is the outstanding product.”
An IT Manager at an insurance company says the solution has “Fast automation, less coding, and is pretty lightweight. When you are working in sprints, you need to have continuous feedback. ReadyAPI definitely helps in automating very fast and rapidly. We have less coding, and we can more easily define our assertions. We don't use it for full-blown performance testing, but normally if you are doing your functional testing, it gives you the request and response time. Anybody who is doing functional testing can see what the request and response times are and raise a flag based upon their business affiliates, that is, whether it is meeting their affiliates. You can identify this during functional testing."
Balamurugan A., Manager at a financial services firm, comments, “We like the user interface. The most valuable features are the integration with Jira and the test management tools.
They have interfaces with our performance tools, so we were able to leverage all of these integrations and plugins. It is very good from an integrative solution standpoint.”
