Fatih Mehmet HARMANCI - PeerSpot reviewer
Software Testing Services Manager at a tech services company with 51-200 employees
Real User
Top 5
Free and not difficult to set up, but it is difficult to test APIs and model a test
Pros and Cons
  • "We are using it just for load testing. We are using its free version, and it is scalable."
  • "Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult."

What is our primary use case?

We are using it for load testing. We test other companies' programs.

What is most valuable?

We are using it just for load testing. We are using its free version, and it is scalable.

What needs improvement?

I am not satisfied with this solution. Its UI side is not so easy to use for beginners. It should be easier. 

Modeling a test is difficult. If you don't have much knowledge, you won't be able to do it easily. Testing APIs is also difficult.

For JSON, you can use tools such as JSONBuddy, but they are difficult to get in JMeter. It should be easy to get JSONBuddy from the website. I have to use BlazeMeter only to get JSONBuddy.

For how long have I used the solution?

It has been about five months.

Buyer's Guide
Apache JMeter
April 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,886 professionals have used our research since 2012.

What do I think about the stability of the solution?

It is not so stable.

What do I think about the scalability of the solution?

It is scalable.

How are customer service and support?

Their support is fine. There are not many Apache documents, but you can find other documents on the web.

How was the initial setup?

It is not so difficult.

What's my experience with pricing, setup cost, and licensing?

We are using the free version.

What other advice do I have?

I would rate it a seven out of 10.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Lead SDET at Unify Technologies
Real User
Good reporting, but it should be more user-friendly, support Ruby, and support dynamic throughput
Pros and Cons
  • "The most valuable features are the integration with Jenkins and the reporting."
  • "The interface could be made more user-friendly."

What is our primary use case?

We are writing scripts using various tools in multiple environments. We have tests set up where you have to pass the credentials in to get a session ID, and it sets and checks the cookies. Then, we check the response values and pass them on to the next function.

We have this solution integrated with Jenkins and we also use it for database performance testing.

What is most valuable?

The most valuable features are the integration with Jenkins and the reporting.

JMeter allows us to automate performance testing and raise diagnostic functions.

What needs improvement?

This solution should support the Ruby programming language for scripting.

JMeter should support dynamic throughput so that we can reduce or increase it during the execution of the scripts. 

For performance testing, we would like to be able to select different bandwidths such as 3G or 4G.

The interface could be made more user-friendly.

For how long have I used the solution?

I have been working with Apache JMeter for the past three months.

What do I think about the stability of the solution?

We have not had any problems with stability.

What do I think about the scalability of the solution?

So far, I haven't had any issues with scalability when performance testing.

How are customer service and technical support?

We have not yet been in contact with technical support.

Which solution did I use previously and why did I switch?

I have also started working with BlazeMeter. One of the differences is that the automation is not possible in BlazeMeter. However, BlazeMeters allows for the selection of different bandwidths, it takes less time to write tests, and it is more user-friendly.

How was the initial setup?

The initial setup is straightforward. We have not yet completed our full deployment with all of the tests.

What about the implementation team?

Our internal team was responsible for the implementation.

Which other solutions did I evaluate?

We are currently comparing the differences between Apache JMeter and BlazeMeter.

What other advice do I have?

JMeter is a good solution but it requires writing manual scripts and takes longer than BlazeMeter. It takes longer to cover the same number of use cases and is not as user-friendly.

I would rate this solution a four out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Apache JMeter
April 2024
Learn what your peers think about Apache JMeter. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
768,886 professionals have used our research since 2012.
PeerSpot user
Head of Performance with 51-200 employees
Vendor
Good for vanilla web testing, less so for more complex requirements.
A mature opensource toolset that has been available for many years. Good for vanilla web testing, less so for more complex requirements. Like most opensource offerings it has relatively poor analytics and limited integration with analytics tools like APM although it is relatively easy to extend with plug-ins and there are quite of these available for free download. A good choice where budget is tight and the tech-stack requirement is straight-forward.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user100902 - PeerSpot reviewer
it_user100902Head of Performance with 51-200 employees
Vendor

Hi Kobi,

JMeter is not well suited for this sort of requirement as you are likely to have to deal with some sort of API. If however the API is web service based then should be ok. Something more proprietary would be better dealt with scripting in C# in my experience so some other tool choice would be better suited.

KR
Ian

See all 10 comments
Test Team Lead at Passed Informatikai Kft.
Real User
A free solution that's stable and easy to use
Pros and Cons
  • "The solution is free. You don't need to worry about licensing costs."
  • "The user interface is a little bit tricky."

What is our primary use case?

We primarily use the solution for performance download testing.

What is most valuable?

It's a solution that's easy to use. It's a bit different from SoapUI and LoadUI.

What needs improvement?

The user interface is a little bit tricky.

For how long have I used the solution?

I've been using the solution for three to four years.

What do I think about the stability of the solution?

The solution is very stable.

What do I think about the scalability of the solution?

It's not 100% scalable like LoadUI, but LoadUI is very expensive. We're an outsourcing company, so we have approximately ten users. We may have plans to expand in the future.

How are customer service and technical support?

The solution doesn't have technical support. If we need answers, we look for them on the internet.

Which solution did I use previously and why did I switch?

Previously, we used the basic version of LoadUI. We switched because LoadUI is very expensive and Apache JMeter is free.

How was the initial setup?

The initial setup was complex. We did have it done in a day. It took approximately one hour. We have about five to six people that manage the solution.

What's my experience with pricing, setup cost, and licensing?

The solution is free. You don't need to worry about licensing costs.

Which other solutions did I evaluate?

We didn't evaluate other options before choosing this solution.

What other advice do I have?

We are using the private cloud version of the solution.

I would rate this solution eight out of ten. If it had a bit of a better user interface, I would rate it higher.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Technical Leader with 501-1,000 employees
Real User
Reporting feature can be improved but allows us to simulate a load of concurrent users on our application

What is most valuable?

Almost all features provided by JMeter are helpful.

How has it helped my organization?

We have a solution called Service Quality Manager portal and is a web based solution to do service management. We do performance testing of this solution using JMeter. It allows us to simulate a load of concurrent users on our application and find out performance bottlenecks in the application.

What needs improvement?

Reporting feature can be improved to provide better test results.

For how long have I used the solution?

We have been using JMeter for 5 years.

What was my experience with deployment of the solution?

I did not encounter any issue while deploying JMeter.

What do I think about the stability of the solution?

I did not encounter any issue with stability.

What do I think about the scalability of the solution?

Yes, While running with a large number of simulated users, sometimes we got thread exceptions and we restarted our testing simulation.

How are customer service and technical support?

As such there is no customer service provided by Apache for JMeter. This software is free to use under Apache licensing system.

Which solution did I use previously and why did I switch?

We tried BadBoy but it lacked features.

How was the initial setup?

Initial setup of JMeter is simple. A user can go ahead and start using it just by following it's documentation.

What about the implementation team?

We implemented JMeter using our own in-house team.

What was our ROI?

I am not sure yet.

What's my experience with pricing, setup cost, and licensing?

As it is java based software an can run on any platform supporting JVM.

What other advice do I have?

I would suggest to verify one's own business need and evaluate certain parameters first like Feasibility and Reliability of Automation, Ease in maintenance of automated test cases, Time saving in Manual or Automated Testing.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user326337 - PeerSpot reviewer
it_user326337Customer Success Manager at PeerSpot
Consultant

How would you suggest improving the reporting features?

See all 2 comments
PeerSpot user
Senior Software Engineer at a tech vendor with 51-200 employees
Vendor
JMeter helps me in measuring performance of my product very effectively

What is most valuable?

I think CSV data config, regular expressions extractor, reporting and distribution testing are the strengths of JMeter.

How has it helped my organization?

It makes life easier by simulating production scenario to check the performance under heavy load. We are able to find out the bottleneck in our system with the results.

What needs improvement?

Better way to handle dynamic elements, to handle session id, browser cookie and cache manager.

For how long have I used the solution?

I have used JMeter for around 6-8 months.

What do I think about the scalability of the solution?

No, distributed testing was helpful for scaling the users in JMeter.

How are customer service and technical support?

Customer Service: 3 out of 5Technical Support: 3 out of 5

Which solution did I use previously and why did I switch?

I never used any performance tool before.

How was the initial setup?

Yes, the initial setup IS easy after following the blogs or Apache JMeter page.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user254718 - PeerSpot reviewer
it_user254718Principal QA Engineer at a tech company with 10,001+ employees
Real User

I have started using JMeter recently, I am confused with the sampler number, I ran a simple Login test of 50 threads for 10 min, I see sampler numbers around 3000. Does that mean 3000 users are doing logins or 50 threads have done 3000 requests so far?

See all 2 comments
it_user1428 - PeerSpot reviewer
Architect at a tech vendor with 10,001+ employees
Vendor
Powerful open source with wide community support. Needs experience to match commercial alternatives.

Pros:
Open source, powerful, wide community of support - it works.

Cons:
Experience needed to build custom tools around Jmeter in order to match capabilities of most commercial alternatives.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Programmatore software at a tech services company with 201-500 employees
Real User
A stable solution with a lot of connectors and easy setup
Pros and Cons
  • "The features that I appreciate are quite basic. It is easy to ramp up the threads and start calling the application. A lot of connectors can already be found within Apache JMeter, but we are not using the entire set because the integration between the customers and platform is based on HTTP. We are just going to produce lots of HTTP sequences."
  • "Currently, the integration pipeline is implemented by using Jenkins or a similar tool platform. These are continuous integration tools. As far as I know, integration is done by using custom scripts. It would be good if the integration with a continuous integration pipeline, like Jenkins or Hudson, can be done out of the box without using a script."

What is our primary use case?

We are using Apache JMeter for profiling and stress testing the application. It is a part of our delivery architecture to stress test the application. It is a part of the build chain. It is not just something that we use internally to verify what we are going to use or going to do.

In terms of a specific use case, we are using Apache JMeter to simulate user engagement. Our software is about customer engagement, and we use JMeter to simulate the customers and engage them on our platform as aggressively as we can.

What is most valuable?

The features that I appreciate are quite basic. It is easy to ramp up the threads and start calling the application. A lot of connectors can already be found within Apache JMeter, but we are not using the entire set because the integration between the customers and platform is based on HTTP. We are just going to produce lots of HTTP sequences.

What needs improvement?

Currently, the integration pipeline is implemented by using Jenkins or a similar tool platform. These are continuous integration tools. As far as I know, integration is done by using custom scripts. It would be good if the integration with a continuous integration pipeline, like Jenkins or Hudson, can be done out of the box without using a script.

For how long have I used the solution?

I have about two years of experience with JMeter. I started to use it two years ago with a new job.

What do I think about the stability of the solution?

It, for sure, is stable. Apache JMeter is a consolidated tool that has survived for several years. 

What do I think about the scalability of the solution?

It is mainly used by automation tools. These automation tools are around whenever needed. We have about 70 people, and this is a spot adoption.

How are customer service and technical support?

I have never tried Apache support.

How was the initial setup?

The initial setup is quite easy because this is just a compressed archive. There is no real installation of the tool. You just need to extract it to integrate with Jenkins Pipelines and automatic tools by using the command-line calls. After you expand the archive, you have to adjust Apache JMeter to its proper configuration, which is not a big issue.

What's my experience with pricing, setup cost, and licensing?

In terms of open-source adoption, it is completely free.

What other advice do I have?

I would recommend this solution. 

I would rate Apache JMeter a ten out of ten. I don't have anything else to compare it with, and I don't know if a competitor can achieve better.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros sharing their opinions.
Updated: April 2024
Buyer's Guide
Download our free Apache JMeter Report and get advice and tips from experienced pros sharing their opinions.