"They have good support documentation and when we have contacted them, they helped to guide us."
"BlazeMeter can be used for both API and performance testing, it is a multi-facility tool."
"The stability is good."
"It supports any number of features and has a lot of tutorials."
"The solution offers flexibility with its configurations."
"The feature that stands out the most is their action groups. They act like functions or methods and code, allowing us to reuse portions of our tests. That also means we have a single point for maintenance when updates are required. Instead of updating a hundred different test cases, we update one action group, and the test cases using that action group will update."
"The most valuable feature is the ability to run concurrent automated tests up to a specified value, depending on what we are currently paying for."
"As stated earlier we use Sauce Labs for a combination of automated testing and manual testing. Therefore the most useful features are the ability to run the functional automated tests via a Sauce Labs tunnels which allows access to applications in our internal network. The second most useful feature is the manual side."
"The error logging is also very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."
"The most valuable feature is cross-browser, cross-OS, cross-mobile device testing."
"From an infrastructure support perspective, the number of VMs, browsers installations and versions that we would be maintaining without Sauce Labs would be a lot. This includes not only the infrastructure costs, but also the maintenance costs and people's time. The labor cost associated with maintaining all of that would be considerably high. In terms of efficiency, having concurrent VMs with various browser combinations available has allowed us to run multiple executions by all our teams."
"Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs."
"Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."
"Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements."
"The performance could be better. When reviewing finished cases, it sometimes takes a while for BlazeMeter to load. That has improved recently, but it's still a problem with unusually large test cases. The same goes for editing test cases. When editing test cases, it starts to take a long time to open those action groups and stuff."
"The reporting capabilities could be improved."
"Having more options for customization would be helpful."
"The should be some visibility into load testing. I'd like to capture items via snapshots."
"If the solution had better support and the documentation was efficient it would do better in the market."
"Lacks an option to include additional users during a test run."
"The testing process is difficult. I need to prove the complete competency of the tool, and I am finding that challenging."
"Every time that we run scenarios where we need to discover the geolocation of our customers, by default it shows as Palo Alto, California. That's a problem for us and we need a workaround for those cases... It would be helpful if we could enter a latitude and longitude into Sauce Labs configuration and say, "When you run a virtual Chrome device or an iPhone, make this your default location. Then, provide me that device so I can run my scenarios," because we have stores in different regions across the United States."
"When we were in development, it was a bit of a pain because we have onshore and offshore development. One of our development shops is in India, and we were running tests over there. When some of the users tried to log in, it was slow for them or we didn't have enough licenses. That was during the core development before we even launched."
"They should provide a JIRA integration plugin so that we can easily log issues."
"As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again."
"Sauce Labs has room for improvement with its price point. Using a real mobile device, and having that dedicated to your team, costs more than actually purchasing a mobile device. We haven't tried the real devices yet. This is because of their price point."
"On a rare occasion, I will come into a ticket where a customer will have reached out to me after reaching out to Sauce Labs, saying, "Sauce Labs doesn't understand what I am going through. They are not being very helpful." So, I try to do clean up there. Outside of those extremely rare occasions, I have only had one or two of those support issues."
"I can't remove team members that have left the organization. I can only set them as inactive. It would be really nice to clean up my data and delete them from the team management."
BlazeMeter is ranked 11th in Test Automation Tools with 6 reviews while Sauce Labs is ranked 3rd in Test Automation Tools with 28 reviews. BlazeMeter is rated 7.4, while Sauce Labs is rated 8.6. The top reviewer of BlazeMeter writes "The action groups allow us to reuse portions of our test and update multiple tests at once". On the other hand, the top reviewer of Sauce Labs writes "Metrics about testing across the company are easily accessible, and it's easy to get teams up and running". BlazeMeter is most compared with Apache JMeter, Tricentis NeoLoad, Micro Focus LoadRunner Professional, Micro Focus LoadRunner Cloud and Selenium HQ, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, Tricentis Tosca and HeadSpin. See our BlazeMeter vs. Sauce Labs report.
See our list of best Test Automation Tools vendors and best Functional Testing Tools vendors.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
