BlazeMeter vs Perfecto comparison

 

Comparison Buyer's Guide

Executive Summary
 

Categories and Ranking

BlazeMeter
Ranking in Performance Testing Tools
4th
Ranking in Functional Testing Tools
8th
Ranking in Test Automation Tools
5th
Average Rating
8.2
Number of Reviews
42
Ranking in other categories
Load Testing Tools (4th)
Perfecto
Ranking in Performance Testing Tools
8th
Ranking in Functional Testing Tools
3rd
Ranking in Test Automation Tools
4th
Average Rating
8.4
Number of Reviews
23
Ranking in other categories
Mobile App Testing Tools (3rd)
 

Mindshare comparison

As of June 2024, in the Performance Testing Tools category, the mindshare of BlazeMeter is 17.7%, up from 11.6% compared to the previous year. The mindshare of Perfecto is 0.3%, down from 0.7% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Performance Testing Tools
Unique Categories:
Functional Testing Tools
0.6%
Load Testing Tools
17.0%
Mobile App Testing Tools
10.5%
 

Featured Reviews

Robinson Caiado Guimarães - PeerSpot reviewer
Jul 28, 2022
Helps us implement shift-left testing, and ability to build test data on-the-fly helps us increase test coverage
One thing that we are doing a lot with the solution, and it's very good, is orchestrating a lot of JMeter agents. This feature has helped us a lot because we can reuse other vendors' performance scripts that they have used with JMeter before. It can also be used for both performance and functional testing of any application and we can manage different kinds of data to better cover the performance and functional testing of the applications. For example, if we need different kinds of data to test the different uses of an application, we can use this platform to help us with that. Another thing we like is that while it's difficult sometimes to connect this kind of performance test solution with application performance monitoring solutions, BlazeMeter has been great. Our experience with that has been great. BlazeMeter is the perfect tool for us because it works with cloud and open source and other vendors' solutions. It's very good with other testing solutions in both our and our customers' ecosystems. For example, it's very good for perfecting mobile solutions and with other test data management solutions. It's very easy to integrate it into the software testing processes and tools that our customers are using. It's also very good at bridging Agile and CoE teams. One thing that we are exploring right now, to make sure it works correctly, is the integration of BlazeMeter in the continuous integration and continuous delivery journey.
VR
Aug 13, 2022
Reasonable price, reduces infrastructure cost, and provides access to all browser versions we need
We have been using a competing product. We encountered some challenges in that competing solution in the cross-browser area. Perfecto has certainly brought positive change. We no longer have the defects or issues we were encountering earlier. It has been great from that aspect. We use Perfecto’s cloud-based lab to test across devices, browsers, and OSs. It is very important for us. It saves the effort and the cost of investing in all different devices, which can become obsolete very soon. Continuous maintenance is not needed, and there is a single platform to access everything. All these benefits don't just make it cost-effective but also make things administratively light. It is very useful for us. They provide same-day access to new devices, but we didn't require that. The majority of our tests focus on the in-market version. So, we haven't used it, but that's a good capability to have. Perfecto’s device lab has helped us to scale our testing operations. One good thing is that you just need an email address, and you can share it with anyone. It is very prompt. We are able to offer a quality product that has been tested fully, which improves our customer satisfaction. That is a good thing. It has also reduced our IT infrastructure cost. We don't have to spend a lot on setting up infrastructure, which becomes redundant or obsolete very soon. It helps in offsetting that cost. It certainly has brought more capabilities to our coordinating teams. We are able to cater to different testing asks from the business and IT teams, and we are able to meet some of the key areas that our enterprise testing strategies are requiring us to do. It is very important for scaling our testing. Investing in all different devices and then managing them, when it is not your primary job as a company, is not easy. Using virtual devices is certainly something that we can easily do at an enterprise level. It affects our software quality. Our solutions are now tested for compatibility and accessibility. In the Ontario region where we are operating, accessibility is mandated by the government. It has also made us compliant with the accessibility requirements.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"It is a stable solution. When we compare BlazeMeter with other tools in the market, I can say that the solution's overall performance has also been very good in our company."
"The most valuable aspect of BlazeMeter is its user-friendly nature, ability to conduct distributed load testing and comprehensive analysis and reporting features. It particularly excels in providing a clear and organized view of load test results."
"It has a unique programming dashboard that is very user-friendly."
"BlazeMeter can be used for both API and performance testing, it is a multi-facility tool."
"BlazeMeter has allowed us to simplify and speed up our load testing process."
"The most valuable features of the solution stem from the fact that BlazeMeter provides easy access to its users while also ensuring that its reporting functionalities are good."
"It has helped us simulate heavy load situations so we can fix performance issues ahead of time."
"The orchestration feature is the most valuable. It's like the tourist backend component of BlazeMeter. It allows me to essentially give BlazeMeter multiple JMeter scripts and a YAML file, and it will orchestrate and execute that load test and all those scripts as I define them."
"The CI dashboard tool is very good, as is the Live Stream monitoring. Whenever I want to monitor execution, I can open multiple tabs in Perfecto and it is easy for me to refer to the CI dashboard and the Live Stream."
"I also like the reporting functions. We are constantly downloading these reports and sharing them with our final customers. They help us understand what kind of bugs are happening through the applications. The recording feature is handy because it lets us see a video of the process we run through the pipeline and discover the point at which the automation is breaking."
"In terms of cross-platform testing, they offer all of it, every device available in the market. It covers real scenarios that mimic production so that we don't miss out on any devices that our clients might be using to run the applications we develop. It's been great and very helpful."
"It saves on the cost and effort of having to maintain our own virtual testing environment. Even our onshore team is not in the city that we work in, so that helps a lot. Even if we didn't invest a lot in getting multiple devices, having to share those devices would become a hassle."
"The most valuable feature is automated testing."
"Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after every new release would be a difficult task. But with Perfecto, it is easy."
"The number one feature, which if we didn't have out-of-the-box would be missed, is the fact that we have video execution. That gives us the ability to view errors or defects in the progression, from beginning to the end of the video."
"We're working in Agile and we need results ASAP. The fact that the lab provides same-day access to new devices is extremely important to us."
 

Cons

"Sometimes, when we execute tests, the results calculated by BlazeMeter, specifically the response times for failed transactions, are incorrect."
"Integration with APM tools like Dynatrace or AppDynamics needs to be improved."
"The performance could be better. When reviewing finished cases, it sometimes takes a while for BlazeMeter to load. That has improved recently, but it's still a problem with unusually large test cases. The same goes for editing test cases. When editing test cases, it starts to take a long time to open those action groups and stuff."
"The scanning capability needs improvement."
"For a new user of BlazeMeter, it might be difficult to understand it from a programming perspective."
"The should be some visibility into load testing. I'd like to capture items via snapshots."
"A possible improvement could be the integration with APM tools."
"I don't think I can generate a JMX file unless I run JMeter, which is one of my concerns when it comes to BlazeMeter."
"It is slow compared to physical device testing. The interactive speed could be improved."
"I'm hoping that Perfecto will come up with browser testing as well because it would be easier to access it."
"It would be ideal if there was a complete integration with other test management tools and other applications like HPLM, Micro Focus, or Microsoft Azure."
"If we could run an accessibility test in Perfecto against builds, it would help us a lot. Currently, that's a very manual process for us. We haven't found a tool that can do accessibility scans for iOS and doesn't depend on engineering effort. Having a feature related to that would be really awesome for us."
"It does well for mobile testing, but when it comes to the web aspect, it is lagging a little bit in terms of execution."
"Previously, we used the cradle. Every time the mobile was blocking it, we would have to ask Perfecto to provide another one. That took a lot of time away from us."
"The flakiness, or the accuracy, of the test execution can be improved. Also, the responsiveness of their cloud lab could be improved as well."
"The monitoring features, in particular network traffic monitoring, could be improved."
 

Pricing and Cost Advice

"The licensing fees are billed on a monthly basis and they cost approximately $100 for the basic plan."
"I rate the product's price two on a scale of one to ten, where one is very cheap, and ten is very expensive. The solution is not expensive."
"The overall product is less costly than our past solutions, so we've absolutely saved money."
"My company has opted for a pay-as-you-go model, so we don't make use of the free version of the product."
"It is an averagely priced product."
"The pricing is manageable. It is not that big. Big companies won't mind the licensing costs."
"It's consumption-based pricing but with a ceiling. They're called CVUs, or consumption variable units. We can use API testing, GUI testing, and test data, but everything gets converted into CVUs, so we are free to use the platform in its entirety without getting bogged down by a license for certain testing areas. We know for sure how much we are going to spend."
"When compared with the cost of the licenses of other tools, BlazeMeter's license price is good."
"Pricing-wise, it is fine. It is not as expensive as what we used to have in the past from HP, IBM, and others. It is decently priced."
"It's definitely on the higher end of prices for this type of service."
"I am not sure about its pricing, but from our perspective, licensing has been easy. Anytime I have new users or requests for users that want to get added, it's a very simple process. I just give the architectural owner of the product the name and email address, and they're able to easily add a new user. We don't have any issues in regards to getting licenses, but I don't have any insights into pricing."
"Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discounts when we sell Perfecto projects and licenses to our customers."
"This is an expensive solution compared to others, by 30% to 40%."
"Perfecto is about 30-40% cheaper than Device Anywhere. That was a big reason why we switched. Perfecto also solves some of the issues that we had with Device Anywhere. We have grown by 100% since we started to use Perfecto, and now we have devices roaming. When we look at the competition, we would still stick with Perfecto."
"Perfecto has definitely saved us on the costs and efforts of having to maintain our own virtual test environment. We lost about 20 devices in the past to maintenance and audit. That was a massive loss for us, as a company, because we were giving devices to someone, but don't know whether we would get it back or not. Having those virtual labs, we don't need to worry about these kinds of things. We are easily saving $5,000 to $10,000 a month on device costing."
"Pricing is an area where Perfecto can do a little better. When we obtain additional licenses, we enter into negotiations with them."
report
Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
787,817 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Financial Services Firm
21%
Computer Software Company
18%
Retailer
7%
Manufacturing Company
7%
Financial Services Firm
19%
Computer Software Company
17%
Manufacturing Company
8%
Recreational Facilities/Services Company
7%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

How does BlazeMeter compare with Apache JMeter?
Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs. We ...
What do you like most about BlazeMeter?
It has a unique programming dashboard that is very user-friendly.
What is your experience regarding pricing and costs for BlazeMeter?
The pricing is manageable. It is not that big. Big companies won't mind the licensing costs. However, Neustar has more reasonable pricing. Most people don't prefer Neustar, but it is a good solution.
What do you like most about Perfecto?
Mobile testing is the most valuable feature as it has reduced dependency on physical devices. We are located offshore and we don't have the physical devices, and shipping physical devices after eve...
What is your experience regarding pricing and costs for Perfecto?
Perfecto's price is excellent compared to other products with similar features. It was the lowest of the three we evaluated. We also established a partnership with Perfecto, so they provide discoun...
What needs improvement with Perfecto?
It is slow compared to physical device testing. The interactive speed could be improved. And sometimes we have issues with our app not working properly with Perfecto. Even though it is working perf...
 

Comparisons

 

Also Known As

JMeter Cloud
Perfecto Mobile, Perfecto Web
 

Learn More

 

Overview

 

Sample Customers

DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub
Virgin Media, Paychex, Rabobank, R+V, Discover
Find out what your peers are saying about BlazeMeter vs. Perfecto and other solutions. Updated: June 2024.
787,817 professionals have used our research since 2012.