We performed a comparison between Perfecto and Sauce Labs based on real PeerSpot user reviews.
Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools."We're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us."
"The reporting feature is really tough to find in some of the other products that are competitors. Having your CITB type dashboard, where we can see the test results and see recordings of each test that passed or failed, is probably one of the distinguishing aspects of Perfecto."
"We are continuously doing testing on different environments, devices, and platforms. It executes seamlessly on multiple devices without having any connectivity issues. It has been really helpful for us to test on cloud devices."
"The automated test reporting functionality is the most valuable feature. We use the CI Dashboard. It's very important as it is the main reporting tool for our automated tests."
"Their team is really great to work with. They're very flexible, and they always show care. They prioritize our work, our company, and our working relationship. I appreciate the ad hoc sessions that they schedule to provide help with troubleshooting, provide the information that we're looking for, or do a demo of a new feature that they have. They're always willing and very quick to get that scheduled for us. I appreciate that a lot."
"The quality of our software has improved since we implemented this solution."
"It creates a faster production cycle and is quick to market. Things get deployed earlier because the testing happens on time. We can do a lot of panelization, so a lot of test phases can happen in a panel. People don't have to wait for a device to come to them. They can access multiple devices at the same time and do testing at the same time."
"The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"The custom capabilities that can be provided to Sauce Labs VMs during automated testing sessions are a valuable option for experimental or niche testing."
"The most valuable feature is the cross-browser feature, it has many android and iOS devices both simulators and real devices. It's easy to integrate. I also like video recording too."
"Testing subscription videos for on-demand software, making them better quality and bug free for our customers."
"Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market."
"Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs."
"It has a wide assortment of platforms."
"So far, the stability has proven to be quite good."
"If we could run an accessibility test in Perfecto against builds, it would help us a lot. Currently, that's a very manual process for us. We haven't found a tool that can do accessibility scans for iOS and doesn't depend on engineering effort. Having a feature related to that would be really awesome for us."
"There was a discussion about having the capability to export the test results to a certain tool that we use in our project. If that were added it would be great not having to manually take screenshots, put them in a document, and share them on the different test management tools."
"It would be ideal if there was a complete integration with other test management tools and other applications like HPLM, Micro Focus, or Microsoft Azure."
"We've had a couple of issues lately with videos not loading or browsers dying after some execution, although that happens very rarely."
"Going by the dashboard or analytics capabilities that Perfecto or Perforce is looking to offer in its roadmap, it will certainly help if they also cater to executing and enabling decision-making, rather than just focusing on standard testing metrics such as execution, efficiency, and defect rate. These are good metrics, but they don't necessarily enable decision-making for SLTs. Any improvements in the dashboards and reporting tools should focus on metrics or SLAs that can help with decision-making."
"When using devices on the cloud, it lags quite a bit at times. I know that these are real devices that are being projected on our laptop screens and monitors, but if the speed could be improved, that would be good."
"We feel that Perfecto is a little slow. If they could improve on that slowness in accessing the app, when we want to click a button, that would be great because we feel the difference. An improvement in the connectivity speed is required."
"It would be nice if there were some kind of AI to compile a list of available devices. Currently, we have to look at the web interface to see the available devices, but the pipelines can't do it on their own there. We always need to do this manually, so it would be better if this feature were automated."
"The one issue I have is the 14-day trial that a new user gets for free. I understand the concept of the trial period; however, I think this could be revamped to a free 30-minute run time every few months or after a significant update once the trial period has ended."
"Integration with Github, as well as several other similar tools, could be improved."
"There have been various times throughout the last month or so where the service has gone down during business hours."
"The ability to configure the memory and CPU for the test machines should be included."
"User account management needs an overhauls, allowing for user groups rather than just a hierarchy structure."
"As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again."
"We have faced challenges with the availability of mobile devices. There was once or twice where there were no mobile devices available."
"Another aspect that could be improved is having the virtual devices boot up a little quicker. Sometimes we wait up to a minute before a device is available. It would be nice if that was 30 seconds or so."
Perfecto is ranked 4th in Test Automation Tools with 23 reviews while Sauce Labs is ranked 13th in Test Automation Tools with 112 reviews. Perfecto is rated 8.4, while Sauce Labs is rated 8.8. The top reviewer of Perfecto writes "Its reporting allows us to have a clear view regarding what tests have been executed". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". Perfecto is most compared with BrowserStack, Appium, AWS Device Farm, Katalon Studio and HeadSpin, whereas Sauce Labs is most compared with BrowserStack, LambdaTest, OpenText UFT One, Katalon Studio and Bitbar.
See our list of best Test Automation Tools vendors and best Functional Testing Tools vendors.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
