BlazeMeter vs Sauce Labs comparison

Cancel
You must select at least 2 products to compare!
Perforce Logo
587 views|338 comparisons
93% willing to recommend
Sauce Labs Logo
4,030 views|2,976 comparisons
96% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between BlazeMeter and Sauce Labs based on real PeerSpot user reviews.

Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools.
To learn more, read our detailed Test Automation Tools Report (Updated: April 2024).
768,740 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"BlazeMeter has allowed us to simplify and speed up our load testing process.""It's a great platform because it's a SaaS solution, but it also builds the on-premises hosting solutions, so we have implemented a hybrid approach. BlazeMeter sets us up for our traditional hosting platforms and application stack as well as the modern cloud-based or SaaS-based application technologies.""The most valuable feature of the solution is its ability to run high loads and generate reports.""The product's initial setup phase was straightforward.""The product's initial setup phase was simple.""The on-the-fly test data improved our testing productivity a lot. The new test data features changed how we test the applications because there are different things we can do. We can use mock data or real data. We can also build data based on different formats.""The baseline comparison in BlazeMeter is very easy, especially considering the different tests that users can easily compare.""It is a stable solution. When we compare BlazeMeter with other tools in the market, I can say that the solution's overall performance has also been very good in our company."

More BlazeMeter Pros →

"One of the most valuable features is that we do not have to have the cross-platform testing vehicles in-house. Sauce Labs gives us the ability to test across platforms and that really helps give us confidence in our products.""It provides a comprehensive selection of browsers and platform versions for our test automations and CI/CD pipeline process. It also provides a comprehensive set of virtual mobile devices, which we can configure for our automation and availability. These features are valuable for us when it comes to testing our applications. We have a website and mobile applications that we want to test and diversify to various browsers and mobile devices as well as restore various versions. This helps us to find bugs that users might be facing and correct them.""Sauce Connect gave us ability to test an application that was hosted locally.""Live device testing. As we all know, It's really hard and challenging to find/purchase many real devices to test because it will be costly and not all the team can be able to purchase all of the devices out there. We used to have a lot of real devices under our labs. However, it is really time-consuming to maintain those devices and make sure they are up to date with the testing requirements.""The most valuable feature is the cross-browser feature, it has many android and iOS devices both simulators and real devices. It's easy to integrate. I also like video recording too.""APPIUM for mobile testing has improved our organization by allowing us to test our website on more devices and browsers than we currently possess.""Sauce Lab analytics helped us to get detailed knowledge on test cases execution and logs.""With Sauce Labs, we have a whole universe of devices: Galaxy, all the iPhones, and all the operating system versions. All our software developers are able to test on a multitude of different devices."

More Sauce Labs Pros →

Cons
"Potential areas for improvement could include pricing, configuration, setup, and addressing certain limitations.""BlazeMeter has room for improvement in terms of its integration with GitLab, particularly in the context of CI/CD processes. While it has multiple integrations available, the level of integration with GitLab may need further enhancements. It is known to work well with Git and Jenkins, although the extent of compatibility with GitLab is uncertain.""The product currently doesn't allow users to run parallel thread groups, making it an area that should be considered for improvement.""In terms of improvement, I would like to have the ability to customize reports.""The scanning capability needs improvement.""I believe that data management and test server virtualization are things that Perforce is working on, or should be working on.""The only downside of BlazeMeter is that it is a bit expensive.""The tool fails to offer better parameterization to allow it to run the same script across different environments, making it a feature that needs a little improvement."

More BlazeMeter Cons →

"If I had to speak of an area that could be improved it would probably have to be the speed of interaction with the devices. There is at times a considerable amount of lag while using some of the virtual and at times even physical device farm""Sauce Labs has room for improvement with its price point. Using a real mobile device, and having that dedicated to your team, costs more than actually purchasing a mobile device. We haven't tried the real devices yet. This is because of their price point.""Progress towards reducing application testing time can be made.""Better and programmatic controls on request/response recordings and sharing with developers.""The only drawback is the speed, it will be good if we have a server in Asia too. It will be great if we can improve speed while initialization and execution.""We have found that during automated testing this can be very slow. This causes inconsistencies with the tests. It's very difficult to rely on a service when you can't be sure if a test will pass or fail the next time it runs. This means building in a lot of sync time into the tests which in turn slows them down. If this speed could be improved then the service would be much better.""As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again.""Sauce Labs needs to be improved in the different platforms for farm testing, like iOS and Android farm testing and farm testing web browsers.​"

More Sauce Labs Cons →

Pricing and Cost Advice
  • "The licensing fees are billed on a monthly basis and they cost approximately $100 for the basic plan."
  • "The solution is free and open source."
  • "The product isn't cheap, but it isn't the most expensive on the market. During our proof of concept, we discovered that you get what you pay for; we found a cheaper solution we tested to be full of bugs. Therefore, we are willing to pay the higher price tag for the quality BlazeMeter offers."
  • "The overall product is less costly than our past solutions, so we've absolutely saved money."
  • "It's consumption-based pricing but with a ceiling. They're called CVUs, or consumption variable units. We can use API testing, GUI testing, and test data, but everything gets converted into CVUs, so we are free to use the platform in its entirety without getting bogged down by a license for certain testing areas. We know for sure how much we are going to spend."
  • "My company has opted for a pay-as-you-go model, so we don't make use of the free version of the product."
  • "I rate the product's price two on a scale of one to ten, where one is very cheap, and ten is very expensive. The solution is not expensive."
  • "When compared with the cost of the licenses of other tools, BlazeMeter's license price is good."
  • More BlazeMeter Pricing and Cost Advice →

  • "We have an enterprise account; it has worked great for our needs."
  • "Try the free trial and work with a Sauce Labs representative to see what package works best for your application(s)."
  • "It could be less like pay-per-use with a lower rate."
  • "Go ahead please. Try it at a smaller scale."
  • "Trial the product and see if it suits your needs."
  • "When you reach the Enterprise licensing tier, base level being with 10 concurrent test sessions, pricing is essentially per-unit-of-concurrency thereafter with a relatively linear increase and not much benefit for "bulk"."
  • "Compared with other services, Sauce Labs is a bit expensive."
  • "​Now that we have an enterprise license, we no longer have to worry about minutes each month!​"
  • More Sauce Labs Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
    768,740 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs We… more »
    Top Answer:In our company, various teams use BlazeMeter, particularly appreciating its cloud license software, which supports up to 5,000 users BlazeMeter's cloud capabilities allow us to load test or… more »
    Top Answer:The pricing is manageable. It is not that big. Big companies won't mind the licensing costs. However, Neustar has more reasonable pricing. Most people don't prefer Neustar, but it is a good solution.
    Top Answer:The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL that has the entire grid of desktops, web browsers, and mobile devices. They… more »
    Top Answer:With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the… more »
    Top Answer:We use it for automated testing. For our company, we do web testing automation. We run our test suites containing Java-based scripts and automate the entire mobile or web application. We've 500 to 600… more »
    Ranking
    6th
    Views
    587
    Comparisons
    338
    Reviews
    19
    Average Words per Review
    1,051
    Rating
    8.3
    13th
    Views
    4,030
    Comparisons
    2,976
    Reviews
    1
    Average Words per Review
    2,324
    Rating
    6.0
    Comparisons
    BrowserStack logo
    Compared 37% of the time.
    Perfecto logo
    Compared 26% of the time.
    LambdaTest logo
    Compared 13% of the time.
    OpenText UFT One logo
    Compared 2% of the time.
    Appium logo
    Compared 1% of the time.
    Also Known As
    JMeter Cloud
    Learn More
    Overview

    BlazeMeter ensures delivery of high-performance software by enabling DevOps teams to quickly and easily run open-source-based performance tests against any mobile app, website or API at massive scale to validate performance at every stage of software delivery.

    The rapidly growing BlazeMeter community has more than 100,000 developers and includes prominent global brands such as Adobe, Atlassian, Gap, NBC Universal, Pfizer and Walmart as customers. Founded in 2011, the company is headquartered in Palo Alto, Calif., with its research and development in Tel Aviv.

    Sauce Labs is a functional testing tool that ensures your apps and websites work flawlessly on every browser, OS, and device. The solution allows you to automate functional testing on multiple operating systems and browsers, emulating the way that a user would use the website. With Sauce Labs, you can also run tests on various operating system and browser combinations in parallel, reducing the amount of time to get results. The Sauce Labs solution provides enterprise-grade security, scalability, and reliability.

    Sauce Labs Features

    Sauce Labs has many valuable key features. Some of the most useful ones include:

    • Automated cross-browser testing
    • Mobile testing
    • Secure tunneling protocol
    • Usage reporting
    • Enterprise security
    • Provisioning
    • Centralized user account management
    • Access controls
    • Support for Selenium, Appium, and JUnit Testing

    Sauce Labs Benefits

    There are many benefits to implementing Sauce Labs. Some of the biggest advantages the solution offers include:

    • Speed up development time: The solution makes it possible for you to test web and mobile apps in parallel and accelerate your testing time by up to 10x or more. Using Sauce Labs, you can increase developer productivity because your teams will be able to spend less time with test maintenance and debug faster.
    • No worrying about infrastructure: With Sauce Labs, you don’t have to buy or maintain more servers or mobile devices. You also don’t need to worry about updating browsers or VM licenses. Sauce Labs allows you to easily scale your tests with parallelization to speed up test cycles and boost capacity on their reliable cloud.
    • Run tests securely: The solution enables you to securely run your scripts and access your data and files from behind your firewall. Sauce Labs generates single-use VMs for every test and destroys them immediately afterwards so your data always remains secure.
    • Easy integration for your CI systems: Sauce Labs automated testing platform integrates with Jenkins, Bamboo, Microsoft VSTS, and others so you can test as fast as you develop. In addition, you can share results instantly by using the solution’s simple plugins.

    Reviews from Real Users

    Sauce Labs is a solution that stands out when compared to many of its competitors. It has valuable features that include error logging, helpful dashboards, and its browser.

    Joel A., Product Manager - Data & APIs at a marketing services firm, says, "The error logging is very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."

    Savio D., Sr. IT Architect at a healthcare company, mentions, "Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."

    PeerSpot reviewer, Rob L., Director of Quality Assurance - Shared Service at a financial services firm, writes, “The most valuable feature for us is the browser. The most critical thing is that this software aligns with our Agile and DevOps way of doing things. It integrates with kickoff scripts through DevOps.”

    Sample Customers
    DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub
    Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
    Top Industries
    REVIEWERS
    Financial Services Firm30%
    Computer Software Company22%
    Non Profit13%
    Comms Service Provider9%
    VISITORS READING REVIEWS
    Financial Services Firm20%
    Computer Software Company18%
    Retailer7%
    Manufacturing Company6%
    REVIEWERS
    Healthcare Company14%
    Computer Software Company11%
    Media Company9%
    Marketing Services Firm8%
    VISITORS READING REVIEWS
    Financial Services Firm17%
    Computer Software Company17%
    Healthcare Company6%
    Retailer6%
    Company Size
    REVIEWERS
    Small Business37%
    Midsize Enterprise20%
    Large Enterprise44%
    VISITORS READING REVIEWS
    Small Business17%
    Midsize Enterprise15%
    Large Enterprise67%
    REVIEWERS
    Small Business25%
    Midsize Enterprise20%
    Large Enterprise55%
    VISITORS READING REVIEWS
    Small Business18%
    Midsize Enterprise11%
    Large Enterprise71%
    Buyer's Guide
    Test Automation Tools
    April 2024
    Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools. Updated: April 2024.
    768,740 professionals have used our research since 2012.

    BlazeMeter is ranked 6th in Test Automation Tools with 41 reviews while Sauce Labs is ranked 13th in Test Automation Tools with 112 reviews. BlazeMeter is rated 8.2, while Sauce Labs is rated 8.8. The top reviewer of BlazeMeter writes "Reduced our test operating costs, provides quick feedback, and helps us understand how to build better test cases". On the other hand, the top reviewer of Sauce Labs writes "Robust documentation, helpful support representative, good licensing model". BlazeMeter is most compared with Apache JMeter, Tricentis NeoLoad, OpenText LoadRunner Cloud, OpenText LoadRunner Professional and ReadyAPI, whereas Sauce Labs is most compared with BrowserStack, Perfecto, LambdaTest, OpenText UFT One and Appium.

    See our list of best Test Automation Tools vendors and best Functional Testing Tools vendors.

    We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.