Apache JMeter Room for Improvement
We're like the solution to be more user-friendly.
As freeware, not everything is readily available. You can't play around with everything. That's just due to the fact that it's not a paid tool. When you pay for tools, you get a bit more.
Not everything is supported by JMeter. It's limited.
With JMeter, with banking encryption, we have struggled a lot. It's not as good as other paid tools that provide support and configuration capabilities that JMeter lacks.
The solution doesn't really have good documentation, and, if you run into issues you can't simply raise a ticket. There's no help available to you.
There are certain protocols that you can get on other solutions, such as LoadRunner, that you can't get on JMeter.View full review »
Quality Engineering Delivery Leader at a financial services firm with 10,001+ employees
The user interface could be improved. If they had better UI, it might make it easier to use.
You really need a technical team in order to really utilize the product.
The scalability could be better, or the process of scaling itself could be a bit more clear.View full review »
Global IT Digital Test Manager at a healthcare company with 501-1,000 employees
The GUI could be improved. When we go into GUI mode, there are occasions where it will not sync with our expectations. There are crashes that happen that will stop the solution from performing. It seems we get minor glitches when we go into GUI mode.
The data client architecture that we have isn't so great. If we are to consume the data, it won't clear because there is tech running on different agents.
When I need to pull the reports from different agents, it's not user-friendly. The reporting can be difficult to handle. It's hard to increase it if you are working on a client's architecture.
It's not easy to get the data from one place or to do customizations.
There are other solutions that allow users to model their load and structure with them. You can't do that on JMeter.
On other solutions, like Silk Performer, you can do network packeting, which you can't do on JMeter. They should add this to the solution as a capability in the future.
The support management needs improvement. Support is coming from consultants; you will not be able to get on-premise support from all of their agents in one place. On Silk Performer, for example, they have the capability where you can basically have a summarized report from different agents.View full review »
I sometimes found the documentation to be not as explanatory as I would've liked it. In the cases that I can think of, I was looking for a rather hand-holding approach with Step A, B, and C, but then I realized that with a product that is open source like this, you can't do handholding. That is because there are so many different uses and different unique environments and setups for it, but I remember thinking a few times that if they only just said this.
If I were going to be Mr. Selfish and say anything I want, I'd say a full feature GUI that lets me drag and drop different modules in line. It could have a simple-to-use GUI.View full review »
We have some scenarios for diameter load testing where TPS requirements are very high, 30K or 40K TPS. In the telco area, this is for simulating mobile usage. However, diameter load testing can be difficult in J Meter. The only way to imitate Diameter requests and process the responses of these requests is to implement them in the code of JSR223 samplers. JMeter generally provides synchronous calls. It's something that could maybe be improved in the future, because for achieving that very high kind of TPS, more than 30K, 40K requires a asynchronous solution. It's not a common thing, it's really very specific to the telco domain and a very few projects.View full review »
This is a difficult question to answer. On one side, JMeter is very flexible and allows for a high amount of customization. On the other, some tasks are common enough that it merits simplifying the process.
Authentication for API testing could use improvement. Currently, it is a multi-step process to call, extract, and utilize a bearer token securely for API calls. This process is becoming a common enough task that a "wizard" for creating and consuming popular authentication models is merited.
Quality Assurance Test Manager at a printing company with 5,001-10,000 employees
The reporting is not very good.
When we run with multiple users, it takes a lot of memory.
With respect to the recording and playback functionality, the auto-correlation parameterization is not easy and should be improved.View full review »
Founder and Principal Consultant at a tech services company with 11-50 employees
The installation needs some work. It could be simplified.
When compared with LoadRunner, LoadRunner is a more mature product.View full review »
Performance Engineer at a tech services company with 10,001+ employees
There are issues with the plug-ins which you need for reporting purposes as they make the reports quite heavy so you have to run them in non-GUI mode. If you go above the 200 user mark, the application creates a bottleneck and that's one of its major drawbacks. It means you have to run with a master-slave configuration with one system being the master, and multiple slave systems. It's not ideal and I think it could be simplified with a UI that provides direct configuration. In addition, the solution doesn't support SIP applications and some other protocols.
Programmatore software at a tech services company with 201-500 employees
Currently, the integration pipeline is implemented by using Jenkins or a similar tool platform. These are continuous integration tools. As far as I know, integration is done by using custom scripts. It would be good if the integration with a continuous integration pipeline, like Jenkins or Hudson, can be done out of the box without using a script.View full review »
When we are testing with too many threads then the solution hangs.
Automation is difficult in JMeter.View full review »
This solution should support the Ruby programming language for scripting.
JMeter should support dynamic throughput so that we can reduce or increase it during the execution of the scripts.
For performance testing, we would like to be able to select different bandwidths such as 3G or 4G.
The interface could be made more user-friendly.View full review »
Performance Specialist at a renewables & environment company with 1,001-5,000 employees
They can improve it a little bit in terms of distribution load testing. We struggled with it during the distribution.
In terms of reporting, runtime monitoring is not currently included, and it should be included. They can also improve it on the reporting side in terms of the comparison of the reports.
They can also focus more on integration with CI/CD. Currently, people are using their own customized tools. It would be nice if Apache can provide some standard tools and procedures for integration with CI/CD tools like DPR. There are some tools, but it would be nice if official standard tools and procedures are available.View full review »
It should start supporting the presentation layer. It currently provides performance testing specifically at the application and API level. It can be extended to the presentation layer, which includes mainly Angular and React frameworks.
It should also be easy to use and easy to train people.
Technical Specialist at a financial services firm with 10,001+ employees
I think it has some proxy-based dependencies which require specific proxies to be set up or disabled, which causes problems when we are working in certain specific environments that have a proxy setup. When we want it to do a record with some new scripts, there are some challenges there.View full review »
Performance Analyst at a tech services company with 10,001+ employees
The solution needs to improve reporting. Currently, there is not enough automation involved with the feature. For example, there should be an automatic way of saving reports. I have also found the recording should be improved too. When you are entering a launch in the controller the recording request should be inside it. Lastly, if they could make the technology better in terms of speed, this would help us.View full review »