We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The most valuable feature in JMeter is the Thread Group, which helps us to see whether the performance is good."
"User-friendly and open source."
"When there's a high number of TPS I can achieve more transactions per seconds given the hyper-limitations."
"It gives accurate results and recommendations that we can implement to enhance the performance of websites."
"The distributed load testing is very good with Apache JMeter."
"Apache JMeter is stable."
"Due to process automation, I don't have to prepare reports, making it the perfect solution."
"The ease of use is the solution's most valuable feature. Also, the ability to easily create test cases is also very good. It's easy to just ramp up on the solution."
"One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."
"The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options."
"The most valuable feature of Katalon Studio is visual testing. It compares the look and feel of an application which is useful."
"This solution is very user-friendly to learn and implement, and less technical knowledge is required to handle automation."
"It is easy for a non-technical person to use and adopt."
"It is good for API testing. It is also good for continuous integration testing. You can connect it to Jenkins."
"I like the feature where you can define a model that represents your website and then reuse the components from the model. It makes creating more test cases easy."
"Katalon Studio's biggest advantage is its price. It's a good tool for the price, albeit with some limitations when you compare it with tools like Tricentis Tosca."
"If JMeter could provide a web version of editing, that would be good."
"I sometimes found the documentation to be not as explanatory as I would've liked it. In the cases that I can think of, I was looking for a rather hand-holding approach with Step A, B, and C, but then I realized that with a product that is open source like this, you can't do handholding. That is because there are so many different uses and different unique environments and setups for it, but I remember thinking a few times that if they only just said this."
"The interface could be made more user-friendly."
"In terms of setup, it could be nicer, to be honest. Sometimes, I get a little bit lost."
"Automation is difficult in JMeter."
"The solution is not user-friendly, there is no framework for autocorrelation or parameterization."
"In this tool, automation in general is almost non-existent. Everything is done manually."
"Running JMeter in GUI mode uses a lot of memory, which means we need to switch to a non-GUI mode when using a heavy load."
"It would be helpful if they can integrate a feature for performance testing."
"The product’s regression testing time could be reduced."
"Katalon lacks integration with other software, including integrating other languages like .NET and PHP."
"We have had some issues when it comes to stability, which is something that needs to be improved."
"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."
"I can say that in my company, we struggle a lot with iOS automation."
"We have been seeing some error pop-ups that are difficult to understand why they were triggered."
"Katalon Studio could improve having visual testing, but I think they're launching that feature very soon. We would like to see an increase in the usage of AI."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Testim and Eggplant Test. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
