PeerSpot user
Senior Director, Software Development and Testing at Softcrylic
Consultant
We can perform test executions on real mobile devices and emulators/simulators.

What is most valuable?

  • Automate tests for native apps, hybris apps and mobile websites
  • Test executions on real mobile devices and emulators/simulators
  • Write automation scripts in any language of your choice Java, C#, PHP, Python and many more
  • Based on Selenium API so there is no steep learning curve to understand Appium

How has it helped my organization?

We provide IT services and solutions, and with this solution we have helped our clients reduce their manual testing efforts to greater level. Our clients have realized benefits by reducing their testing cycle from three days to three hours through Appium.

What needs improvement?

They can improve test reporting, and more importantly on test scripts, by providing less constructs to automate more complex testing scenarios.

For how long have I used the solution?

I've used it for the past three years. We use it alongside Selenium.

Buyer's Guide
Appium
April 2024
Learn what your peers think about Appium. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
769,065 professionals have used our research since 2012.

What was my experience with deployment of the solution?

Deployment is little tricky but with good help from external vendors organizations, we can implement an Appium-based test automation solution in a short period of time.

What do I think about the stability of the solution?

There have been no issues with the stability.

What do I think about the scalability of the solution?

There have been no issues with the scalability.

How are customer service and support?

There is great on-line support from the users community. External vendors have innovative solutions build using these tools where they provide tremendous support.

How was the initial setup?

It was difficult to some extent, but with good documentation from the on-line community we where able to implement the tool.

What about the implementation team?

We did it in-house. If you are implementing it for enterprise level its better to seek external vendor help.

What was our ROI?

We have seen ROI of more than 60%. It's open source.

What other advice do I have?

I would say start lean, gain small wins and incrementally add more. Example: Start automating test cases for one browser and slow expand to multiple browsers.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Deva Veluchamy - PeerSpot reviewer
Deva VeluchamyTest Automation Lead/Consultant at Aspire Systems
Real User

Yes, its very good automation tool for mobile native app and mobile web automation.

Principal Consultant at Plateer
Consultant
Top 20
Open-concept with good documentation but it can run slow
Pros and Cons
  • "We do not need to pay for the solution. It’s free."
  • "The setup and installation were a problem for us at first."

What is our primary use case?

I primarily use the solution for internal testing.

How has it helped my organization?

We can save some workload by using Appium. However, there is a similar workload for the test engineer since we can't reuse the previous test case in the future. A manual test is the same as an automated test in our corporation.

What is most valuable?

Many reference areas on the web can help you understand the product quite well.

The stability is good.

We do not need to pay for the solution. It’s free.

What needs improvement?

I can’t think of an area that needs improvement currently.

The setup and installation were a problem for us at first.

Tests can take a long time.

For how long have I used the solution?

I’ve been using the solution for six months.

What do I think about the stability of the solution?

The solution is stable. It runs well. However, it also runs slow. The test duration takes a long time.

What do I think about the scalability of the solution?

I don't have any scalability experience.

We have two or three people using the solution. There’s a test consultant, engineer, and architect.

We don’t use it at total capacity. We use it about 30% of the time.

How are customer service and support?

I’ve used documentation in the past to help troubleshoot. I do not reach out to them directly for support.

Which solution did I use previously and why did I switch?

I have experience with Appium, Tosca, and Parasoft.

How was the initial setup?

The product was a bit difficult to install. it wasn’t easy. We had issues.

It took us four weeks to implement the product.

I’d rate the solution two or three out of five in terms of ease of setup. It’s moderately complex.

There are two of us that can handle the deployment.

What about the implementation team?

I handled the initial setup myself. I had no assistance from outside resources such as integrators or consultants.

What's my experience with pricing, setup cost, and licensing?

The solution is open-source and free to use.

You can pay to extend certain services. However, we never needed to do that.

Which other solutions did I evaluate?

We are not currently looking into other tools. We also never looked at any other solutions previously.

What other advice do I have?

We are a customer and an end-user.

I’m not sure of the exact version of the solution. It’s likely the latest.

I’d recommend the solution to others. I rate it seven out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Appium
April 2024
Learn what your peers think about Appium. Get advice and tips from experienced pros sharing their opinions. Updated: April 2024.
769,065 professionals have used our research since 2012.
Automation and Nft Manager at a computer software company with 10,001+ employees
Real User
Open-source, scalable, easy to use, and easy to install with good community documentation
Pros and Cons
  • "It's an open-source solution with a very large community and available documentation."
  • "Stability is an area that needs some improvement."

What is our primary use case?

We use Appium and Appium Studio as our base for any type of mobile automation.

We are using Appium on-premises for scripting purposes. 

Our automation testers download Appium for their scripting.

How has it helped my organization?

Mobile app based test automation and Mobile handset experience based telecom scenarios has been automated using appium. This has helped to increase testing efficiency

What is most valuable?

The interface for mobile automation is helpful for scripting and execution. It's scalable and there are many testers who would like to automate. In terms of scripting, scalability is very good.

It's an open-source solution with a very large community and available documentation.

Appium Inspector helps in identifying the elements very easily. 

The ease of converting is good because it's an open-source solution. The programming language is Java, which is easy to consolidate. It also supports Python.

It is very easy to work with, distribute, and consolidate on a rapid basis.

What needs improvement?

Stability is an area that needs some improvement. During execution, the Appium Studio experiences some intermittent disconnection.

There are some paid solutions available on the market that have AI included with self healing, which means with changes in application script would detect automatically. The software is smart enough to show you unexpected changes. It can show you the options to change certain element locator which has changed with recent build.

Maybe this additional feature can be added as a paid feature in future.

For how long have I used the solution?

I have been using Appium for more than one year.

What do I think about the stability of the solution?

There at times during the execution where there are a high number of test scripts that are being initiated, and during that time the Appian Studio gets disconnected. We then have to restart to continue the flow.

What do I think about the scalability of the solution?

Appian is a scalable solution that is being used almost every day, extensively.

We have approximately 30 people developing, executing, and using Appian. They are made up of automation engineers and DevOps-related who are developing and executing, and we have our team for test executing. 

How are customer service and technical support?

The community is very helpful. If you run into an issue, you can easily resolve it with the community documentation, where similar issues are being discussed.

How was the initial setup?

It's easy to install Appium. 

When we work with Android and iOS, it is common to have to install other products such as APK as a pre-requisite for mobile app.

What about the implementation team?

We have an automation team to complete the installation and implementation of Appian. We did not use a vendor team.

What was our ROI?

ROI is good due to ease of scalability.

What's my experience with pricing, setup cost, and licensing?

Appium is open-source, which is not licensed.

Which other solutions did I evaluate?

We had evaluated two other solutions. For certain tools scripting was easy in Android, but for iOS, there are additional requirements such as instrumentation. This would set us back. We want to use something that is consistent throughout the various OS. They are also paid software, with additional features that are an extra fee. It wouldn't justify the ROI.

Most of the testing that we do requires testing in both Android and iOS.

We chose Appium for the scalability and the ease of automation for both Android and iOS. Appium is a good choice, it's standard. We can use most of the scripts.

What other advice do I have?

Appium, Appium Studio, and Appium Inspector are from the same product family.

Appium is the biggest user base that we have today in terms of open-source. It's not difficult to find a solution when we talk about the maintenance of the scripts.

If you are looking for fast scripting and self-healing features, there are other solutions available that you have to pay for.

I would definitely recommend it in cases where you are using integration automation, you have a relaxed timeline, and stability is the main factor.

I would rate Appium an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user377433 - PeerSpot reviewer
Project Manager at a tech services company with 501-1,000 employees
Consultant
I can interact with all the elements in both iOS and Android apps, and it's open-source
Pros and Cons
  • "The way Appium server interacts with mobile apps is fantastic. It provides all the information about the elements inside the app, Android as well as iOS. I can interact with the element quickly, just type some text or get some text values from the element - whether it's a drop-down, or web text, or a native element."
  • "It needs to accommodate applications that use React.js and AngularJS."
  • "An application developed on the Unity platform, such as a gaming application, objects are moving in that case. Interacting with those elements is still lacking in Appium. Appium doesn't have the internal library to play with the Unity platform. That is a huge lack right now."

What is our primary use case?

To automate mobile apps, iOS and Android.

What is most valuable?

The way Appium server interacts with mobile apps is fantastic. It provides all the information about the elements inside the app, Android as well as iOS. I can interact with the element quickly, just type some text or get some text values from the element - whether it's a drop-down, or web text, or a native element.

Initially, Appium had a GUI, for Windows as well as for Mac, and there were some limitations that I couldn't figure out: How to run automated test on multiple iOS devices. However, we figured out that you can run a couple of instances of Appium in parallel, and use them to run tests in parallel, as well as sequentially. 

It's available as open-source for the iOS or Mac, as well as for Windows, so that's a pretty huge feature.

What needs improvement?

It needs to accommodate applications that use React.js and AngularJS.

Also, an application developed on the Unity platform, such as a gaming application, objects are moving in that case. Interacting with those elements is still lacking in Appium. Appium doesn't have the internal library to play with the Unity platform. That is a huge lack right now.

In addition, on Google platforms we can't use Appium to automate, that is a lack. 

So what I'm suggesting is that Appium should develop a newer, generic solution for all kinds of platforms used to develop applications.

For how long have I used the solution?

Three to five years.

What do I think about the stability of the solution?

The stability is there. 

What do I think about the scalability of the solution?

I don't think I have experienced any problems with scalability. The scalability is good.

How are customer service and technical support?

Whenever I have problem, most of the time the solution is available through the  Appium community, as well as through Google searches. I'm an R&D guy so I am able to figure out a solution quickly.

Which solution did I use previously and why did I switch?

We used commercial tools like Experitest. There were a lot of limitations. For example, we had to use iOS Configuration Utility manager before using that tool. We felt Appium was better because it is an open-source tool. It is very competitive with any of the commercial tools, right now.

How was the initial setup?

I didn't see any complexity in setting up Appium.

What other advice do I have?

Overall, Appium is the best. It is not made as a commercial tool.

I would rate Appium as a nine out of 10 because it has the flexibility, simplicity, and it is elegant. It is technically more advanced, and even a beginner can start using Appium very quickly, and master it in less time.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Architect - Automation at DMI (Digital Management, Inc.)
Real User
A single framework solution brings greater efficiency to our development process
Pros and Cons
  • "It runs completely flawlessly and seamlessly every day."
  • "Configuration-wise, there is a lot of room for improvement."

What is our primary use case?

We use this solution for mobile UI automation, and particularly for regression test automation.

We develop complete, end to end test cases, then we automate them and run those test cases in a DevOps process. It's a complete CICD (continuous integration, continuous development) using DevOps methodology.

Our automation job triggers immediately after a successful development build. Upon completion of automated test cases, results are emailed to all stakeholders. This is a completely automated process without any manual intervention.

How has it helped my organization?

This solution has improved our organization in terms of efficiency. We use this tool for one of our mobile applications that supports iOS and Android devices. The application should support all Android devices with OS version 6 and above, whereas the iOS application should be compatible with iOS 9.3 and up. Therefore, it supports multiple OS versions with all of the devices and handsets that are coming to the market.

It becomes very difficult for our regulation team to test the solution, or run their test cases, on all of these platforms and mobile devices. But, with the help of automation, we can create a single script that does so. Not only that, but we can run our tests in a 24/7 model that includes weekends. Our team members cannot work overnight or on the weekend.

This solution continuously generates reports, and the report is the only thing that needs to be analyzed by the testing team. It runs completely flawlessly and seamlessly every day. This makes it very cost effective and productive. That is one of the major benefits for us.

What is most valuable?

Appium is a very good tool because with its help we can automate all of the platforms, Android, iOS, or Windows, and there is a single solution. We can create a single framework for all platforms that can satisfy all of the needs. Being an open source solution it is free of cost.

Otherwise, there are other open source tools for particular platforms, but with the Appium library, we can automate all major platforms.

What needs improvement?

This product is still maturing, so at times there are issues with its stability if your scripts run continuously for more than fifteen to twenty hours. At times, we have witnessed the Appium server stop responding for forty to forty-five minutes. As a result, scripts do not move in this time period. Sometimes the connection resets due to USB or Network issues, which is not an Appium issue.

There is no user interface because it is a complete development solution, and you have to code in Java. I do not see any room to include an interface in the near future, as is the case with other commercial automation tools.

For iOS automation, it is very tedious to install or configure this particular library in your system, and it becomes very difficult to troubleshoot if you are not Mac and Xcode savvy. You require an understanding of the configuration of Xcode projects and you have to troubleshoot a lot of things at times. 

Configuration/Installation-wise, there is a lot of room for improvement in this solution, especially for the iOS platform.

For how long have I used the solution?

Two and a half years.

What do I think about the stability of the solution?

Stability-wise, this tool is still maturing. I have seen improvement over the past two years, with every release. I expect that in another year it will be even more stable.

In our experience, if you are running smaller scripts that execute for two or three hours, then this tool is good enough. If, however, your scripts run continuously for twenty or twenty-four hours then the tool give you issues at times. The connection gets reset or the server hangs in between. These things are normally seen after ten or eleven hours.

What do I think about the scalability of the solution?

In terms of scalability, this tool is doing well. We have automated more than five hundred test cases, which run for twenty to twenty-two hours in one go. In that way, it is doing well, although, sometimes there are cases where the Appium server hangs, and the script does not proceed forward. This has to be ironed out.

We do plan to increase the usage of this solution. Right now, our company has a lot of experience and a lot of people are learning this tool, as well as other open source solutions. We do not use any commercial products. In fact, we have a policy of using open source solutions, as they are in demand. There is nothing challenging the capability of this tool right now.

How are customer service and technical support?

Being an open source project, there is no company that specifically supports this tool.

That said, the open source community is quite strong. If you are having any kind of issues, with your solution or your implementation, there are multiple points that are available and you can ask questions. Most of the time you get your resolution in a very quick time, maybe in a day or sometimes a couple of days. In fact, most of the time, with my experience I can say 95% to 98% of the time, I found a solution which helped us. 

The open source community includes a large user base who are actively using it and sharing their experience, as well as their implementation solutions, over the net. 

Which solution did I use previously and why did I switch?

Before this solution, I only had experience with HPE UFT (Unified functional testing). I, later on, moved to Selenium because we are able to achieve the same results with this open source solution as with any other commercial product, without any one-time or recurring cost for the tool. 

Selenium has matured with time and become a stable solution for Web Application automation. More and more clients are preferring Selenium because of the no-cost factor, and as a result, there are good job opportunities available for people who can work on Selenium. 

These were the major driving forces for me to move towards the Selenium automation solution.

How was the initial setup?

Installation of this particular tool is tedious, and it gives you a good number of challenges at times. You have to resolve them, troubleshoot them every now and then, and you need the right people. You need a good expert with experience who can help you. It is not possible for a novice user, or any user who is new to the team, to do all of these things. There is a steep learning curve.

In order to use this tool for iOS applications, you have to use Xcode and have to install and create profiling for your development solution. For a user who is new to the system, and perhaps not aware of Xcode or profile creation on a Mac machine, it becomes difficult. The majority of developers use Windows-based development systems. In order to automate iOS applications, we have to use Mac-based machines to provide the operating system.

This means that you need to have some kind of experience with Xcode, or at least some experience with iOS application configuration. These are the skills required in order to set Appium up on your Mac machine and use iOS automation.

A Windows-based system can be used for Android applications, but a Mac machine can be used for both iOS and Android. I rely on Windows for Android, but you are certainly free to work on a Mac machine.

There are six people in our team using this solution on all platforms. I have the role of Automation Architect, and the others are Automation Engineers. We have set up a local cloud environment in our office, and we do everything ourselves.

What about the implementation team?

We deployed this solution ourselves and created our own script for Appium installation on an iOS machine. Instead of individual commands, we have created a BASH script which installs & configures the automation development environment. With this, it is easy to install and configure a system for a new developer who is coming to our team. If you do not have such a script then it is a full-day task to complete the setup and configuration on your iOS machine.

What's my experience with pricing, setup cost, and licensing?

This is an open source solution so it does not cost anything for licensing or otherwise.

Which other solutions did I evaluate?

I had evaluated SeeTest before Appium for mobile solution development, but the customer was not willing to invest in a commercial tool. SeeTest is more stable, mature, and easy to install as compared to Appium, but it comes with a significant cost of almost $80,000 per year (number of licenses that we required). This is the reason we decided to move on with Appium.

What other advice do I have?

This solution is one that you need a little bit of time and patience to learn, but once you learn it, it opens the gate to work on many other similar types of tools or wrappers that are created, keeping Selenium at the core. 

Overall, the product is good. On a scale of one to ten, I am only deducting two points because you cannot automate & run the iOS application on the Windows OS. You require Mac machines for iOS automation. Also, installation and configuration are also tedious for new users.

I would rate this solution eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Staff Engineer - Product and Platform Engineering at Altimetrik (Deployed at FORD)
Real User
Top 5
Supports multiple frameworks but problems after iOS updates
Pros and Cons
  • "Appium's best feature is that it supports multiple frameworks."
  • "Appium has problems with automated validations following iOS updates, causing us to have to validate manually."

What is our primary use case?

I use Appium to develop automation scripts for our mobile applications for iOS and Android and test client applications for our FinTech client.

What is most valuable?

Appium's best feature is that it supports multiple frameworks.

What needs improvement?

Appium has problems with automated validations following iOS updates, causing us to have to validate manually. Its execution speed is also very slow.

For how long have I used the solution?

I've been using Appium for more than seven years.

What do I think about the scalability of the solution?

Appium is scalable.

How are customer service and support?

Appium's support forum is very helpful.

What's my experience with pricing, setup cost, and licensing?

Appium is free and open-source.

What other advice do I have?

I would give Appium a rating of seven out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
it_user717255 - PeerSpot reviewer
QA Lead at a tech vendor
Vendor
Saves A Large Amount Of QA Resources Needed For Doing Smoke Tests And Sanity Checks

What is most valuable?

Support for both Android and IOS. It simplifies the testing setup.

How has it helped my organization?

It saves a large amount of QA resources needed for doing smoke tests and sanity checks on new versions of the app on several phones and OS versions.

What needs improvement?

Usability. The documentation is not always easy to follow, especially the advanced setup part, where the IOS predicates usage. Also, the Appium inspector, a tool which allows you to inspect screen elements, is rather tricky to setup.

For how long have I used the solution?

Three years.

What do I think about the stability of the solution?

Yes. Sometimes the mobile environment reset and application installation are slow. Sometimes you need to kill and restart the Appium app. I have seen constant improvements though.

What do I think about the scalability of the solution?

Appium is not that scalable, if you're using real devices locally. It can get scalable by using cloud services and emulators.

How are customer service and technical support?

I am not aware of any paid support option. There is a decent sized community where you can get answers. Also, Appium and all language extension clients are open-source, so anybody can raise issues on Github.

Which solution did I use previously and why did I switch?

Yes, Silk Mobile. Its features are very far from Appium's capabilities. Also, it is expensive.

How was the initial setup?

Straightforward. Straightforward on Windows, relatively straightforward on MAC (the best option is testing on both Android and IOS devices), slightly tricky on Linux (I am using Arch Linux).

What's my experience with pricing, setup cost, and licensing?

It's open source. There is nothing wrong with that.

Which other solutions did I evaluate?

I was using Silk Mobile, and it was not the right tool for our needs. Also, I tested the native automation on both Android and Mac. These are good options, but you need to switch context radically from Android to IOS and back.

What other advice do I have?

Good luck, not sure how you can do it better. It has flaws, but is still much better than any other cross-platform mobile automation tool.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Quality and Testing Services Leader at a tech services company with 11-50 employees
Real User
Value found in the configuration and interface
Pros and Cons
  • "Appium has easy interaction with mobile."
  • "If it had more facility for configuration it would be a spectacular solution."

What is our primary use case?

We are a consulting company. Appium is an open-source library. We use Appium in our platform for optimizing mobile testing. For our company, Appium's similarity with Selenium is important as we use Selenium.

We have three users using this solution.

What is most valuable?

I find the configuration and interface of Appium valuable. Appium has easy interaction with mobile.

What needs improvement?

When doing mobile testing Appium is difficult as you can't use it for mobile testing in virtual machines. You need to have a physical machine. If Appium could manage this problem, and if it had more facility for configuration it would be a spectacular solution.

For how long have I used the solution?

We have been using Appium for two years.

How are customer service and support?

Technical support has been fine.

How was the initial setup?

Appium is not easy to setup, it has a degree of complexity. 

What's my experience with pricing, setup cost, and licensing?

The pricing of Appium is fine.

Which other solutions did I evaluate?

We evaluated Micro Focus.

What other advice do I have?

I would rate this solution an 8 out of 10.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user