Apache JMeter and Tricentis NeoLoad are key contenders in performance testing, each with unique advantages. Tricentis NeoLoad seems to have an edge in addressing enterprise-scale testing needs with better integration and support services.
Features: Apache JMeter offers an all-in-one GUI, a wide variety of plugins, and open-source availability, making it adaptable for different testing scenarios. Tricentis NeoLoad stands out for its ease in creating load tests, generating graphical reports, and seamlessly integrating with cloud environments. It supports various protocols and provides advanced features like infrastructure monitoring and auto-correlation, catering to complex enterprise needs.
Room for Improvement: Apache JMeter struggles with large-scale test stability and lacks advanced reporting without customization. It presents a steep learning curve and lacks built-in support for certain protocols. Tricentis NeoLoad could enhance its reporting capabilities and simplify enterprise-level tasks and third-party tool integration. Both tools could benefit from better scalability and UI improvements.
Ease of Deployment and Customer Service: Apache JMeter is versatile, supporting deployment across on-premises and various cloud settings. However, it relies heavily on community support. Tricentis NeoLoad also offers similar cloud deployment options but provides structured customer service, offering better support than JMeter's community-driven model.
Pricing and ROI: Apache JMeter is free, offering substantial cost savings, though it might require investments for extended functionality through plugins and support. Tricentis NeoLoad provides a flexible licensing structure, which is often less expensive than alternatives like LoadRunner but remains costlier than JMeter, justifying the investment for organizations needing comprehensive performance testing.
With Apache JMeter, I have gained great statistics for performance and server metrics.
With AI models ChatGPT, troubleshooting issues has become very easy for us.
The support for Apache JMeter is excellent.
Apache JMeter has strong support through its vast Java-based community on platforms like Stack Overflow.
JMeter is highly scalable, easily handling increased loads through the use of multiple servers.
This restricts the number of users and necessitates increasing load agents or distributing the script across multiple machines.
For backend automation and performance testing with web services, web APIs, and queue management systems, I would rate Apache JMeter's scalability as between eight and nine.
JMeter performs exceptionally well, especially in non-GUI mode, which supports high loads efficiently.
Several necessary features still need improvements, specifically in terms of reports and additional functionalities compared to other commercial tools.
Previous versions of Apache JMeter were a little unstable, but the new versions are very stable.
With AI becoming more prominent, they can implement features where it can generate code by itself based on the results or provide suggestions.
Currently, we need to use multiple separate JMeter instances to simulate reductions in load, which isn't ideal.
The tool needs improvements related to client-side metrics, integrating with tools like YSlow or HTTP Watch, and enhancing mobile testing capabilities.
The effect of the new license policy is that NeoLoad becomes more and more unattractive for smaller companies, and only bigger companies are interested or find the license fee fair.
Using JMeter helps us avoid additional costs for high-load testing since it is open-source and allows for unlimited virtual users at no extra cost.
It's a cost-effective solution.
Apache JMeter is completely free as it is open-source.
JMeter facilitates scripting capabilities, which include options for Groovy scripts.
It's useful for both the person conducting the test and the higher management, like project managers or senior executives, who may not know about the test.
Despite being open source, it offers features comparable to paid tools.
Most graphs can be configured with drag-and-drop, which is handy, and you get graphs suitable for reporting issues.
| Product | Market Share (%) |
|---|---|
| Apache JMeter | 14.8% |
| Tricentis NeoLoad | 11.6% |
| Other | 73.6% |
| Company Size | Count |
|---|---|
| Small Business | 27 |
| Midsize Enterprise | 24 |
| Large Enterprise | 55 |
| Company Size | Count |
|---|---|
| Small Business | 5 |
| Midsize Enterprise | 12 |
| Large Enterprise | 49 |
Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.
You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.
What protocols does JMeter support?
How does JMeter work?
JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.
You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.
There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.
Apache JMeter Key Features
Apache JMeter Benefits
The JMeter extensible core has numerous benefits:
Reviews from Real Users
Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."
"I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.
A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”
Tricentis NeoLoad is a performance testing tool that provides developers and testers with automatic test design, test maintenance, realistic simulation of user behavior, fast root cause analysis, and built-in integrations with the entire SDLC toolchain. With NeoLoad’s plugins, teams can reuse and share test assets and results from functional testing tools, analytics, metrics, and APM tools in order to catch performance issues early. With NeoLoad’s full tech stack support, users can test the range of mobile, web, and desktop apps.
Tricentis NeoLoad Features
Tricentis NeoLoad has many valuable key features. Some of the most useful ones include:
Tricentis NeoLoad Benefits
There are many benefits to implementing Tricentis NeoLoad. Some of the biggest advantages the solution offers include:
Reviews from Real Users
Tricentis NeoLoad stands out among its competitors for a number of reasons. Some of these include its price, its user-friendly UX, its API support, and its scalability. PeerSpot users take note of the advantages of these features in their reviews:
Patrik B., Technical Lead at a tech services company, writes, “The licensing cost is very less for NeoLoad. It is user-friendly and easy to understand because they have created so many useful functionalities. When I started working with this tool, we just had to do the initial assessment about whether this tool will be able to support our daily work or not. I could easily understand it.”
A Global Delivery Head at a consultancy firm notes, “The API support is much better with this solution, compared with the competition. Pricing for it is also more affordable than its competitor. We have used Tricentis NeoLoad and we find it scalable.”
We monitor all Performance Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
