We performed a comparison between Apache JMeter and Katalon Studio based on real PeerSpot user reviews.
Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."Apache JMeter is quite flexible."
"User-friendly and open source."
"We are using it just for load testing. We are using its free version, and it is scalable."
"The most valuable features are the ability to capture the entire traffic of particular pages and the proper readability of entire pages and entire APIs."
"When there's a high number of TPS I can achieve more transactions per seconds given the hyper-limitations."
"It's stable and reliable."
"It is an open-source tool that is easy to use. It can be easily integrated with multiple tools, including Selenium."
"Scripting with the solution is good."
"Smart Wait and XPath healing are valuable features."
"The most important feature is the Jenkins integration; it is pretty straight forward and allows us to run nightly builds."
"The most valuable feature is that the browser and the API testing is available in a single tool, and I don't have to look at other options."
"It has been good so far for API testing on Mac. It is not that hard to learn and use. There is so much support out there, so if anyone wants to start using it, there is enough help."
"One of the features that I like is Object Recognition. It worked very well, and it allowed me to create a dynamic expert based on my requirements."
"The product provides ease of automation for the cloud."
"The recording feature of this product is very valuable for our testing purposes."
"It provides us daily feedback on the status (failing/working) of the core features of our websites."
"JMeter's reporting is extremely rudimentary. The fundamental reporting mechanisms need to be drastically improved. It doesn't utilize an automatic session management mechanism or methods other tools use like parsing cookies and variables. Everything needs to be done manually. There's no automation."
"At times when we overload the application, it gets stuck...After the solution gets stuck due to overloading, we have to restart our computers. In short, the solution keeps crashing."
"The tool should be made a bit more robust, and better support should be made available."
"Self-healing and page rendering for the end-users are not available in Apache JMeter."
"The only thing is the learning curve. It's high."
"The UI needs some work. The first time I used JMeter, I couldn't record the full scenario to mimic the user experience. Since then, they have introduced some plugins and a third-party tool called BlazeMeter."
"We're like the solution to be more user-friendly."
"Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly."
"They need to work on documentation to make it more centralized and easier to find what you are looking for."
"It would be helpful to have an automatic save feature."
"One aspect that can be improved is testing for desktop applications. I would like to see them support more technologies in this area."
"I've seen that our clients are not truly aware of the power behind Katalon."
"Katalon Studio's pricing is expensive."
"Currently, I'm the only one who can use it because I have a Mac. It is giving a hard time to my team members who are on Linux. My team members are using Linux, and Katalon doesn't support Linux very well. It keeps on crashing. It crashes and shuts down almost every time they save their work, so they are not able to use it. It should have good support for Linux. We don't know what the problem is. If the Katalon team can pick up this issue, it will be very helpful."
"The product’s regression testing time could be reduced."
"There is not much support offered for the free version, which is something that could be improved."
Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Katalon Studio is ranked 5th in API Testing Tools with 41 reviews. Apache JMeter is rated 7.8, while Katalon Studio is rated 7.8. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Katalon Studio writes "Useful multiple technology platform, scalable, but usability could improve". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and ReadyAPI, whereas Katalon Studio is most compared with Tricentis Tosca, Postman, OpenText UFT One, Testim and Eggplant Test. See our Apache JMeter vs. Katalon Studio report.
See our list of best API Testing Tools vendors and best Regression Testing Tools vendors.
We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.