automation tester at a computer software company with 10,001+ employees
Real User
Top 20
Makes it easier to test without needing physical devices, and enables us to do offshore testing
Pros and Cons
  • "Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every new release would be a difficult task. But with Perfecto, it is easy."
  • "It is slow compared to physical device testing. The interactive speed could be improved."

What is our primary use case?

We use it for manual mobile testing and a little bit of web testing.

How has it helped my organization?

Perfecto makes it easier for us to do mobile testing, rather than shipping mobile devices. They always have the newest versions.

Although I can't comment on cost savings, it is useful for us because of our offshore-onshore model. We are able to utilize the devices even if we don't have a physical device available to us.

What is most valuable?

Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every new release would be a difficult task. But with Perfecto, it is easy.

Perfecto’s cloud-based lab to test across devices is very important because as a banking and financial project, we need to ensure that our app is working on all devices, irrespective of version.

What needs improvement?

It is slow compared to physical device testing. The interactive speed could be improved. 

And sometimes we have issues with our app not working properly with Perfecto. Even though it is working perfectly on the physical device, in Perfecto we find issues. That is another thing we'd like to see improved. Perfecto support said not to use the instrument option so that you do not face that issue. But unless we use the instrument option we cannot do the inspection. We haven't had this issue with all versions of our apps, only with a few.

Buyer's Guide
Perfecto
March 2024
Learn what your peers think about Perfecto. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,234 professionals have used our research since 2012.

For how long have I used the solution?

I have been using Perfecto for almost five years.

What do I think about the stability of the solution?

The stability of the solution is good, around eight out of 10. And the new features they're bringing out are also good. They are useful for us. 

What do I think about the scalability of the solution?

The scalability is a seven out of 10.

How are customer service and support?

Whenever we have an issue we raise a ticket and it is resolved pretty fast. The technical support is great and it's quicker now than when I first used it. The follow-up is also great.

How would you rate customer service and support?

Positive

How was the initial setup?

The initial deployment is not that complex, and the solution doesn't require any maintenance.

What was our ROI?

We don't have to carry physical devices from one place to another. They are virtual, so we can always use them without any issues. It has been very helpful from that perspective for us.

What other advice do I have?

Overall, it's a great solution. They just need to improve on the slowness. I would definitely recommend it.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
Automation Consultant at a consultancy with 10,001+ employees
Real User
We can execute tests in multiple browsers through Quantum framework, but test history should be extended
Pros and Cons
  • "The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream."
  • "We feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required."

What is our primary use case?

We use it to automate regression test cases for the mobile app of our application. We use Android and iOS for execution, in both English and French. We also use the solution to execute tests in different browsers.

How has it helped my organization?

It has really helped us speed up our testing process. We are able to execute tests overnight and see the results quickly.

Our devices are in the Perfecto cloud and that's extremely important because we have monthly releases and a lot of OS upgrades in our mobile application. We always have to validate our app for both forward and backward compatibility, as well as in the browser, to make sure that all the features of the application are working. Perfecto facilitates delivering the product on time, through the cloud devices, so that there is no impact to our end-users. That's extremely important for us.

The Perfecto lab also provides same-day access to new devices, which is another very important aspect. If we want to do some tests to make sure the features work in the latest Android 11 version, we don't have to contact the Perfecto team and ask them to provide us with access to that particular device. We can get that access and execute tests against the devices.

What is most valuable?

The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream. 

It's also very user-friendly. I can see and locate any issues that come in and it's easy to see which test case has failed. Under the Perfecto job name, if you click on it, it will show how many passed, how many failed and due to what issues, such as "element not found" or "object not found" or a Java error.

It also has video recording with the screenshots which is really good.

Another very good feature is the cross-platform testing. We are able to execute in multiple browsers and multiple Chrome, Safari, and Microsoft Edge versions. We have the capability in Perfecto to develop scripts. We just need to capture the capabilities of the different browsers and update them in our Quantum framework and we are able to execute. It's very easy. 

There is an option in Perfecto to capture the capabilities using the tool itself. If we want to run it in, let's say, a particular Android device, we can capture it from there and put it into the code and we can update the information and execute.

The range of open-source technologies that Perfecto supports is really good. I don't see any issue in using Perfecto for that.

In terms of its reporting and analytics, whenever I'm doing any execution for a new release, I just put in my release number and it's easy for me to look for what happened in the test case execution I ran for the previous month's release. I can easily locate it and I can get the information.

In addition, I can schedule the devices I need in Perfecto and I can block those devices so that other users on the team do not try accessing them.

What needs improvement?

The reporting can be improved due to the scrolling you need to do. We have an option for filtering and generating reports, but we are limited to three months of history. After that, we are no longer able to see the information. If they would maintain the history for a minimum of two years, that would be helpful.

Another issue is that sometimes, when we have to locate a button through physically accessing a mobile app, versus through Perfecto, we feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required.

For how long have I used the solution?

I have been using Perfecto since 2019.

What do I think about the scalability of the solution?

I would rate the scalability as an eight out of 10.

How are customer service and support?

I work closely with my Perfecto vendor and he is very supportive. Every time there is a new update he will share it with us and get our feedback to help enhance the tool.  They help update the core into the Quantum framework. We have had some key, latest, knowledge-sharing sessions with their team regarding these new updates.

We also have the Perfecto support portal, where we'll raise incident tickets. If, for example, a device is not working, it's not connecting, or a tool is not supporting what we're doing, we will raise a defect ticket. We can indicate the severity and wait for updates from the Perfecto customer solution team.

In terms of objects, we had some challenges initially and we told our point of contact about them. They updated the solution as a result. Also, sometimes we were not able to access iOS devices. Every time we wanted to go to iOS devices, we had to trust the app, otherwise the lab would not be launched. And we had some challenges accessing the iOS app from the Quantum framework. We worked with the Perfecto team and we got solutions to those issues.

That process is ongoing. We ask them about whatever ideas we have for them to improve. One of the ideas I asked about is because there are a lot of things we need to export into ALM Test Lab. It would be great if Perforce could create a plugin that could be added to the Perfecto portal so that we could just provide the ALM URL domain name and password to connect it to Perfecto. Right now, we need to write code to integrate it with ALM and export the results once the execution is done. An integration with Jira would also help.

How would you rate customer service and support?

Positive

Which solution did I use previously and why did I switch?

I have not used any other tool for a long time.

How was the initial setup?

I wasn't involved in the initial setup but there is some ongoing script maintenance involved.

What other advice do I have?

It's user-friendly, adaptable, extendable, and scalable. We are able to understand everything through the UI. They just need to enhance it further to adopt the kinds of changes we would like to see.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
Buyer's Guide
Perfecto
March 2024
Learn what your peers think about Perfecto. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
765,234 professionals have used our research since 2012.
Regional Head Customer Experience at a financial services firm with 10,001+ employees
Real User
Good automated testing, but the price and performance could be better
Pros and Cons
  • "The most valuable feature is automated testing."
  • "We have had some issues with performance, which is something that should be improved."

What is our primary use case?

We write applications for mobile devices and we use Perfecto Mobile to test them. We set up automated tests, although we perform manual tests in some cases.

What is most valuable?

The most valuable feature is automated testing.

What needs improvement?

We have had challenges while using this product.

The main problem has to do with OTP. OTP comes on the SIM but there is no SIM card in the cloud, so it makes it a big challenge for us. It is available in development but because we don't have the OTP API exposed, we don't have it in production.

We have had some issues with performance, which is something that should be improved.

The price of Perfecto Mobile should be lowered.

For how long have I used the solution?

I have been using Perfecto Mobile for more than a year.

What do I think about the stability of the solution?

We experience some device hangs, as well as other performance-related issues.

What do I think about the scalability of the solution?

It is not auto-scalable. We have dedicated devices that we use for testing our applications. There is an option for scalability but we aren't using it.

How are customer service and technical support?

We have had contact with technical support and they are good. We have no issues with them.

How was the initial setup?

The initial setup is not easy because the networking team is in the bank and the network is secure. It took a lot of time to get approval, receive access, and then set it up properly. 

What about the implementation team?

We had to engage the Perfecto team to assist with deployment.

What's my experience with pricing, setup cost, and licensing?

This is an expensive solution compared to others, by 30% to 40%.

What other advice do I have?

This is a product that I would recommend. However, we have complaints about both cost and performance.

I would rate this solution a six out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Prin IT Bus Systems Analyst at a healthcare company with 10,001+ employees
Real User
Scales quickly and easily for multiple devices, but web application testing needs improvement
Pros and Cons
  • "One of the good things about Perfecto is the scalability that it provides."
  • "It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution."

What is our primary use case?

We are application developers and we use Perfecto to ensure that our applications are working on a variety of devices. We have a need to support a broad range of mobile devices, which Perfecto is able to assist with.

What is most valuable?

One of the good things about Perfecto is the scalability that it provides. We are able to quickly scale up the devices. We can choose Android devices, web-based applications, or whatever we need, and we can scale up quickly and easily.

What needs improvement?

We bought this solution because it is supposed to be proficient at both web and mobile testing. It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution. Specifically, if it is a native app then it does really well. But, with a hybrid, or it is a native mobile web app, it seems to be lagging.

For how long have I used the solution?

We have been working with Perfecto for approximately two years.

What do I think about the stability of the solution?

I have not experienced any stability-related issues.

What do I think about the scalability of the solution?

The scalability is very good. We have four to five people using it at the moment, and we have five or six concurrent licenses. At peak, we have five people using it.

There are three or four teams of approximately eight people each who use it, and the time is shared based on their needs. We may expand this in the future but for now, we art set.

How are customer service and technical support?

I have not interacted directly with their technical support. We have a team that deals with them.

Which solution did I use previously and why did I switch?

We also use UFT Mobile.

How was the initial setup?

The initial setup seemed to be straightforward.

What about the implementation team?

We used a vendor partner and they completed most of the setup.

The team looked like they have been doing it as part of their service and they were able to complete it pretty quickly.

What other advice do I have?

I would rate this solution a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Responsible for Test Management at a tech services company with 10,001+ employees
Real User
Stable, easy initial setup, and offers coverage of various mobile devices and operating systems
Pros and Cons
  • "The most valuable aspect of the solution is that it covers all types of devices on the market allowing you to test different versions of an operating system."
  • "It would be ideal if there was a complete integration with other test management tools and other applications like HPLM, Micro Focus, or Microsoft Azure."

What is our primary use case?

We primarily use the solution as a mobile testing tool.

What is most valuable?

The most valuable aspect of the solution is that it covers all types of devices on the market allowing you to test different versions of an operating system.

What needs improvement?

I looked at the solution a year ago. I'm not sure what functionalities were lacking or need improvement, but I do find it to be a good tool.

It would be ideal if there was a complete integration with other test management tools and other applications like HPLM, Micro Focus, or Microsoft Azure.

For how long have I used the solution?

I worked with the solution for one year.

What do I think about the stability of the solution?

Once we had an open session and during the next entry, we had difficulties re-entering the tool. This only happened once or twice, but no more than that.

What do I think about the scalability of the solution?

The scalability is very easy to handle.

How are customer service and technical support?

The current version of the solution is very stable, so we've never had to contact technical support.

Which solution did I use previously and why did I switch?

We use both Perfecto Mobile and Mobile Center. Our customers dictate which tools we use. 

How was the initial setup?

The initial setup is easy, especially with the cloud version, which is what we use.

What about the implementation team?

My colleagues handled the setup phase and we had a center dedicated to mobile, but I am unsure if we solicited any outside help.

What other advice do I have?

We use the cloud deployment model.

The solution itself is fairly broad in scope meaning you don't need to implement other solutions.

While Mobile Center is a little difficult to install, Perfecto Mobile is simpler for both setup and training.

I would rate the solution eight out of ten. It's the best tool, but it can still be updated to be even better.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Associate - Projects at a tech services company with 10,001+ employees
Real User
It offers cloud-based architecture for manual testing, along with integration with Appium and Selenium.

What is most valuable?

  • Cloud-based architecture for manual testing
  • Performance testing & automation of browsers, mobile devices and gadgets
  • Enhanced reporting with video recording and proper steps
  • Wind tunnel
  • Appium + Selenium integration
  • Best-ever tool for RWD apps
  • Parallel execution of almost any browsers, mobile devices and gadgets

How has it helped my organization?

It has saved hours of manual testing time, costs and efforts. It's pretty much the best tool that has a repository of all the execution status, apps and information, which can be available in any part of the world.

What needs improvement?

Ability to use/automate Windows/iOS/Linux environment would be a great feature to add in cloud.

Increasing local deployment of cloud devices/resources worldwide would be even better.

For how long have I used the solution?

I have used it for two years.

What was my experience with deployment of the solution?

No issues.

What do I think about the stability of the solution?

No issues.

What do I think about the scalability of the solution?

No issues.

How are customer service and technical support?

Customer Service:

Customer service is 100%.

Technical Support:

Technical support is 100%.

Which solution did I use previously and why did I switch?

We used Perfecto + UFT and then switched to Appium + Perfecto as it gives more flexibility and better control.

How was the initial setup?

Initial setup was simple. Perfecto took care of all the setup.

What about the implementation team?

Perfecto made it look easy.

What's my experience with pricing, setup cost, and licensing?

Go for private cloud as it has unlimited hours of testing and the most availability of devices.

Which other solutions did I evaluate?

We evaluated multiple open-source and commercial tools, but Perfecto helped our needs by providing secured connection over cloud, as we use VPN.

What other advice do I have?

Perfecto has a highly active community so just blend with it. Completing their certifications would give a bright overview about their products and it helps to get better at the tool.

Disclosure: My company has a business relationship with this vendor other than being a customer:
PeerSpot user
it_user173214 - PeerSpot reviewer
Test Lead at a tech services company with 10,001+ employees
Consultant
Due to the cloud-based model, devices available in any geographical area can be accessed and used. In iOS, it needs improvements with some limitations.

What is most valuable?

The cloud features are the most valuable.

How has it helped my organization?

Due to the cloud-based model, devices available in any geographical area can be accessed and used.

What needs improvement?

In iOS, it needs improvements with some limitations.

For how long have I used the solution?

I've been using it over a year.

What was my experience with deployment of the solution?

There have been no issues with the deployment.

What do I think about the stability of the solution?

There have been no issues with the stability.

What do I think about the scalability of the solution?

There have been no issues with the scalability.

How are customer service and technical support?

Customer Service:

It's been 100%.

Technical Support:

It's been 100%.

Which solution did I use previously and why did I switch?

No previous solution has been used.

How was the initial setup?

It was straightforward to implement.

What about the implementation team?

We used an in-house team with help from the vendor.

Which other solutions did I evaluate?

No other solutions were used.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Perfecto Report and get advice and tips from experienced pros sharing their opinions.
Updated: March 2024
Buyer's Guide
Download our free Perfecto Report and get advice and tips from experienced pros sharing their opinions.