Try our new research platform with insights from 80,000+ expert users

Apache JMeter vs Appium comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Apache JMeter
Average Rating
7.8
Reviews Sentiment
7.0
Number of Reviews
96
Ranking in other categories
Performance Testing Tools (1st), Load Testing Tools (1st), API Testing Tools (3rd)
Appium
Average Rating
8.0
Reviews Sentiment
7.4
Number of Reviews
30
Ranking in other categories
Mobile Development Platforms (9th), Regression Testing Tools (6th)
 

Mindshare comparison

Apache JMeter and Appium aren’t in the same category and serve different purposes. Apache JMeter is designed for Performance Testing Tools and holds a mindshare of 11.7%, down 24.0% compared to last year.
Appium, on the other hand, focuses on Mobile Development Platforms, holds 2.7% mindshare, down 4.9% since last year.
Performance Testing Tools Mindshare Distribution
ProductMindshare (%)
Apache JMeter11.7%
OpenText Professional Performance Engineering (LoadRunner Professional)12.7%
Tricentis NeoLoad10.7%
Other64.9%
Performance Testing Tools
Mobile Development Platforms Mindshare Distribution
ProductMindshare (%)
Appium2.7%
OutSystems10.7%
Mendix8.8%
Other77.8%
Mobile Development Platforms
 

Featured Reviews

RR
Principal Performance Architect at Tecnotree Corporation
Have built custom performance test scripts and integrated them into automated pipelines seamlessly
Apache JMeter has its own pros and cons when compared to other tools. It is easy to use the tool and it has open-source capability so we can build our custom scripts and execute them. It provides other capabilities, such as integrating a database and connecting to other application servers for monitoring and related functions. We use dynamic HTML reporting, which helps us in testing analysis by pinpointing the bottlenecks based on the reports. We can identify the specific areas that need attention, troubleshoot them, and report to the development team. The user-friendly GUI for creating and managing tests makes it very easy to drag and drop samplers. For example, if you want the HTTP sampler, you can drag and drop it and use it. For configurations, we have other samplers. For results, we have the view results samplers that we can also drag and drop. The UI is good in comparison with other tools. Regarding integration with CI/CD pipelines, we can create Apache JMeter scripts and use the Docker image. From the image, whatever scripting we have done can be connected. We can use the CI/CD pipelines and connect them with Jenkins tools and GitHub. Then we can create the pipelines and automate the end-to-end flow. For connecting Jenkins to Apache JMeter, JMeter plugins are available, and we have used them. Apache JMeter also has some third-party plugins, which are not native samplers. If we want to use custom test executions, we definitely use all the different plugins available in Apache JMeter. The capability to simulate users has impacted testing resources and outcomes as Apache JMeter is based on Java, which has a limit to the users in a particular load generator. Apache JMeter provides distributed load testing where you can connect multiple PCs in a master and slave concept, allowing you to pump the load with any number of users. In the past, I have done load testing with 10,000 users by connecting the Apache JMeter distributed network in BlazeMeter. There is a cloud version available, the updated BlazeMeter, and I used that. It is very easy to launch load generators in BlazeMeter, and then we can run the test, scaling up beyond 10,000 users.
AS
Independent consultant, at OpenText
Efficient mobile testing with intuitive emulation capabilities and a user-friendly interface
Initial setup for Appium (especially for iOS) is not beginner-friendly.Consumes too much of your host machine's resources, potentially slowing down the machine.Appium Inspector often lacks deep insight or crashes with certain app builds. Improve test flakiness by intelligently selecting robust self-healing locators,simplified installers, better documentation, GUI-based config management,smart wait mechanisms and better failure logs.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"Apache JMeter is quite flexible."
"It is scalable. It is cloud-based."
"It is scalable. You can scale up to 1,000 users in JMeter. If you can put up four slave servers, you can easily ramp up to 1,000 users."
"The most valuable feature of this solution is being able to launch many requests and scheduling simulating human interactions with the application."
"We use Apache JMeter for load testing, where we provide the throughput time."
"Scripting with the solution is good."
"The solution is free. You don't need to worry about licensing costs."
"We really appreciate that the solution comes with a live community, which continuously provided plugins and support protocols."
"The latest versions of the solution are stable."
"We do not need to pay for the solution. It’s free."
"Appium's wide support of programming languages is valuable."
"The most valuable feature of Appium is it supports iOS and AOS and is open-source."
"We develop apps using the React Native framework, and Appium integrates well for testing those apps. The Appium automation framework also has good integration with GitHub Actions and plenty of other tools and frameworks, including BrowserStack."
"Appium's best feature is that it supports multiple frameworks."
"The library is extensive so the driver interacts with most functions or actions on mobile devices."
"What I like about Appium right now is that it's like Cypress in the sense that............. to test the components in the way I want them to be tested."
 

Cons

"JMeter should be more stable. Every time there is a new release coming up, a lot of its older functionalities or the new functionalities that are brought in are not very well-documented. It should be documented properly, and there should be proper use cases."
"Because so much is being done these days with authentication processes, a better system for either getting bearer tokens or some kind of token-based authentication prior to executing APIs would benefit the product. It is there, and you can do things. It is just not real clean at this point. There should be a better authentication process for JMeter or some automation or better guidelines for gaining and utilizing tokens on the fly."
"Currently, the integration pipeline is implemented by using Jenkins or a similar tool platform. These are continuous integration tools. As far as I know, integration is done by using custom scripts. It would be good if the integration with a continuous integration pipeline, like Jenkins or Hudson, can be done out of the box without using a script."
"It's not easy to get the data from one place or to do customizations."
"The installation needs some work. It could be simplified."
"Considering the kinds of tests we are performing here, where we launch several tests at the same time as a batch request, JMeter is not the best tool for the job. Those kinds of things could be done easily with other tools, like T6."
"The stability could be a bit better."
"To the best of my knowledge, the documentation could be improved. It should be enhanced to better support newcomers. Currently, only people with some experience can easily understand the content. Including more sample programs, applications, and use cases would help many more people adapt to using the solution."
"We previously worked with native applications, and there weren't any good mobile app testing tools. We started working with React Native, which works well with Appium, but it would be good to see better integration; the way elements are displayed can be messy. React Native is very popular nowadays, so it's essential to have that compatibility."
"Image recognition could be improved. We have some images in our mobile applications. It should be able to run from the cloud, so we can automate the catcher."
"If it had more facility for configuration it would be a spectacular solution."
"Configuration-wise, there is a lot of room for improvement."
"I rarely use Appium nowadays because I'm now at the managerial level, but the last time I used it, whenever I selected and clicked on an element, Appium was very slow. I tried to debug it, but I still couldn't find the problem, so this is an area for improvement in the solution. Another area for improvement lies with the connector and server. For example, the effort to get into the local machine sometimes causes the emulator to become slow, which then leads to failure in testing, and this is the usual issue I've encountered from Appium. An additional feature I'd like added to Appium in its next release is being able to do automation in iOS without using XPath and the name of the element. In Xcode, you can use previous UI tests for detecting elements, but in Appium, you have to use Xpath and the element name instead of being able to directly put the X-UiPath, which is what you can do in Xcode. In iOS as well, sometimes the element doesn't have a name or a path. Sometimes, there's also no element."
"Stability is an area that needs some improvement."
"One area where I think Appium could improve is in addressing security concerns for our data. Currently, we're unable to use cloud solutions like CloudForm due to security restrictions on our servers. We also face challenges in updating packages for the same reason. It would be beneficial if the solution could provide better support for auto-reporting and easier connections to mobile device farms."
"The user interface needs improvement because there are issues when setting up environment variables."
 

Pricing and Cost Advice

"The solution is open-source."
"It is open source. There are no licensing costs associated. If you need enterprise support, you'll probably end up paying for a license. You would also factor in the infrastructure cost, but that's not significant."
"I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options."
"In terms of open-source adoption, it is completely free."
"We use the open source version."
"Apache JMeter is an open-source solution, so it's free to use."
"Since we are using an outsourced solution, it is not paid for by our company."
"No licensing is required as it is a free, open-source tool."
"We found out that we could explore features of the solution for 30 days trial. We can switch to a permanent license later if we want."
"Appium is free and open-source."
"The solution is open-source."
"This is an open source solution so it does not cost anything for licensing or otherwise."
"It's open source, so it's completely free."
"I'm unsure if there's any cost associated with Appium. I got the free package which includes the server GUI application and the inspector application, and it was free to download, and that's all I need to get my work done. I'm not aware of any additional costs associated with the tool."
"As far as I know, Appium is a free solution. It's not for commercial use."
"The solution is free."
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
884,873 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
15%
Computer Software Company
10%
Manufacturing Company
8%
Insurance Company
6%
Financial Services Firm
16%
Manufacturing Company
11%
Computer Software Company
9%
Comms Service Provider
5%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business27
Midsize Enterprise24
Large Enterprise56
By reviewers
Company SizeCount
Small Business6
Midsize Enterprise6
Large Enterprise19
 

Questions from the Community

How does Postman compare with Apache JMeter?
Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share t...
How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about Apache JMeter?
I appreciate JMeter's simplicity and power for performance testing.
Do you recommend Appium?
I do recommend Appium. It is an open-source solution and completely free of charge. We use Appium and Appium Studio as our base for any type of mobile automation for testing. It has a great interfa...
What is your experience regarding pricing and costs for Appium?
My experience with Appium from a pricing perspective is favorable due to it being open source, making it a cost-effective option.
What needs improvement with Appium?
The deployment process and configuration are quite complex and require improvement. Additionally, the wait time functionality could be enhanced as I experienced failures with longer wait times.
 

Comparisons

 

Also Known As

JMeter
No data available
 

Overview

 

Sample Customers

AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
Nuvizz, Coupa Software, Eventbrite, Evernote
Find out what your peers are saying about Apache, Tricentis, Perforce and others in Performance Testing Tools. Updated: March 2026.
884,873 professionals have used our research since 2012.