BlazeMeter vs OpenText LoadRunner Professional vs Tricentis NeoLoad comparison

Cancel
You must select at least 2 products to compare!
Perforce Logo
6,402 views|3,731 comparisons
93% willing to recommend
OpenText Logo
6,887 views|4,431 comparisons
95% willing to recommend
Tricentis Logo
8,345 views|4,202 comparisons
94% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between BlazeMeter, OpenText LoadRunner Professional, and Tricentis NeoLoad based on real PeerSpot user reviews.

Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools.
To learn more, read our detailed Performance Testing Tools Report (Updated: April 2024).
769,662 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"The most valuable aspect of BlazeMeter is its user-friendly nature, ability to conduct distributed load testing and comprehensive analysis and reporting features. It particularly excels in providing a clear and organized view of load test results.""BlazeMeter's most valuable feature is its cloud-based platform for performance testing.""The most valuable feature of the solution is its ability to run high loads and generate reports.""It's a great platform because it's a SaaS solution, but it also builds the on-premises hosting solutions, so we have implemented a hybrid approach. BlazeMeter sets us up for our traditional hosting platforms and application stack as well as the modern cloud-based or SaaS-based application technologies.""The product's initial setup phase was simple.""BlazeMeter can be used for both API and performance testing, it is a multi-facility tool.""The product's initial setup phase was straightforward.""Using cloud-based load generators is highly valuable to us, as we can test from outside our network and increase load generation without having to upscale our hardware as much. The cloud load generator is there when we need it and is the feature we leverage the most."

More BlazeMeter Pros →

"The most valuable feature is the ability to create performance test cases quickly and then execute them. It provides a lot of powerful features to do that very efficiently and effectively.""It is a good and stable tool.""LoadRunner is a very systematic tool for anyone to use. Even someone who is actually a first time user of LoadRunner can actually get a lot of benefit out of the tool.""LoadRunner is a very sophisticated tool, and I can use many languages. For example, I can use Java. I can use C++. I can test the Internet of Things, FTP, mail, and Active Directory. It is very useful.""I recommend LoadRunner Professional as it supports many protocols and applications and is very easy to set up and use.""The reporting mechanism is a valuable feature that generates good reports.""A very comprehensive tool that is good for performance testing.""Very useful for finding out how the system responds to load, stress, and normal situations, as well as benchmarking with other industry competitors. It also improved our response time, memory delegation, and CPU delegation. In addition, we used LoadRunner to optimize our database and website."

More OpenText LoadRunner Professional Pros →

"What I found best in Tricentis NeoLoad is that it's better with scripting and load test execution in the load testing environment compared to its competitors. The tool has a better design, scenarios, and model, which I find helpful. I also found the Result Manager a fascinating part of Tricentis NeoLoad because of the way it collates results and presents reports. The straightforward implementation of Tricentis NeoLoad, including ease of use, is also valuable to my team.""The most valuable feature is flexibility, as it connects to all of the endpoints that we need it to.""Learning-wise, it's pretty straightforward and flexible because if the person has little knowledge of performance testing and the process, they can definitely easily grab the knowledge from NeoLoad.""The scripting is really user-friendly and the reporting is very good.""It offered us an easy to use, limited code option for end-to-end performance testing.""It is a good source for load, stress and performance testing.""The test cases are quite easy to build and to maintain. This is the most valuable aspect of the solution for us. It's the reason why they changed from JMeter to NeoLoad.""The solution's setup was straightforward."

More Tricentis NeoLoad Pros →

Cons
"Scalability is an area of concern in BlazeMeter, where improvements are required.""A possible improvement could be the integration with APM tools.""I don't think I can generate a JMX file unless I run JMeter, which is one of my concerns when it comes to BlazeMeter.""Potential areas for improvement could include pricing, configuration, setup, and addressing certain limitations.""One problem, while we are executing a test, is that it will take some time to download data. Let's say I'm performance testing with a high-end load configuration. It takes a minimum of three minutes or so to start the test itself. That's the bad part of the performance testing... every time I rerun the same test, it is downloaded again... That means I have to wait for three to four minutes again.""Having more options for customization would be helpful.""In terms of improvement, I would like to have the ability to customize reports.""The performance could be better. When reviewing finished cases, it sometimes takes a while for BlazeMeter to load. That has improved recently, but it's still a problem with unusually large test cases. The same goes for editing test cases. When editing test cases, it starts to take a long time to open those action groups and stuff."

More BlazeMeter Cons →

"In terms of resource management, you need a lot of high capacity boxes if you need to generate a load of 1,000 or 2,000 users.""The monitoring technology in LoadRunner could be improved. It depends on another tool called SiteScope, but they only took a part of the features of SiteScope. They need to improve on that.""Support for Microsoft Dynamics needs improvement.""Sometimes, we aren't able to see an accurate page view while replying and executing the script. When you are navigating the application side by side, it needs to be displayed on a random viewer. Sometimes we will get a few applications, and we won't get others.""I recently just got to see LoadRunner Developer, but it is still not fully developed to use.""The initial start-up of Micro Focus LoadRunner could be improved. When we add 20 or 30 scripts, the refresh is completed one by one. I would like to be able to select all the script at one time, so it can be completed in a single click, reducing the time required.""More guidance on the use of the Tru Client protocol which is used for Web interfaces.""There should be more integration with more open-source platforms."

More OpenText LoadRunner Professional Cons →

"NeoLoad does not support Citrix-based applications.""I would like to see support for auto-correlations.""Regular and strong support has to be made available by Tricentis during the solution's implementation and initial setup.""I didn't like much of the support that you get from the Tricentis group unless it was after it integrated with Tricentis; the support is not that good.""An area for improvement in Tricentis NeoLoad is its integration with third-party tools because, at the moment, it's a bit complicated. Per Tricentis, you can integrate Tricentis NeoLoad with different monitoring tools such as Dynatrace and New Relic, but that requires installing an additional tool to make that integration happen, rather than being able to pull in Tricentis NeoLoad from the different tools and servers, and make integration simpler and easier.""There were some features that were lacking in Tricentis NeoLoad, e.g. those were more into Citrix and other complicated protocols, which were supported easily by a competitor: Micro Focus LoadRunner. We also need to look into how it integrates with other Tricentis products, because Tricentis did not have a good performance testing tool until now.""The SAP area could be improved.""We would like to see the addition of one-to-one integrations with the Tricentis Tosca suite to this product, which would then cover the end-to-end needs of our customers who are looking for a single vendor solution."

More Tricentis NeoLoad Cons →

Pricing and Cost Advice
  • "The licensing fees are billed on a monthly basis and they cost approximately $100 for the basic plan."
  • "The solution is free and open source."
  • "The product isn't cheap, but it isn't the most expensive on the market. During our proof of concept, we discovered that you get what you pay for; we found a cheaper solution we tested to be full of bugs. Therefore, we are willing to pay the higher price tag for the quality BlazeMeter offers."
  • "The overall product is less costly than our past solutions, so we've absolutely saved money."
  • "It's consumption-based pricing but with a ceiling. They're called CVUs, or consumption variable units. We can use API testing, GUI testing, and test data, but everything gets converted into CVUs, so we are free to use the platform in its entirety without getting bogged down by a license for certain testing areas. We know for sure how much we are going to spend."
  • "My company has opted for a pay-as-you-go model, so we don't make use of the free version of the product."
  • "I rate the product's price two on a scale of one to ten, where one is very cheap, and ten is very expensive. The solution is not expensive."
  • "When compared with the cost of the licenses of other tools, BlazeMeter's license price is good."
  • More BlazeMeter Pricing and Cost Advice →

  • "The cost depends greatly on the needs of the testing engagement."
  • "I would still consider LoadRunner as an expensive tool and you get a LoadRunner and the Performance Center."
  • "I don't know the licensing cost, but I think that you would get a discount for normal usage. I think there are different yearly options for different types of usage. It is not only how many users, but also whether it is shareable or not and other criteria involved in each feature. There are additional fees for the users and hardware linked to the processing."
  • "The licensing fees are based on the number of users."
  • "It is competing with other products that may cost significantly less or may be available as open-source. Because of that it is relatively expensive."
  • "LoadRunner Professional is an expensive product."
  • "This is not a cheap product."
  • "There is a licensing cost that is expensive."
  • More OpenText LoadRunner Professional Pricing and Cost Advice →

  • "Licence cost is very attractive compared to other vendor tools and also there are many license alternatives."
  • "The pricing is fair for high-volume licensing."
  • "It is cheaper than other solutions."
  • "The licensing cost is less compared to other licensing performance testing tools."
  • "Licensing for NeoLoad is subscription-based."
  • "Its licensing cost is very less."
  • "NeoLoad is cheaper compared to other solutions. There are no additional licensing fees."
  • "Pricing is always cheaper with Tricentis NeoLoad versus the very expensive Micro Focus LoadRunner."
  • More Tricentis NeoLoad Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Performance Testing Tools solutions are best for your needs.
    769,662 professionals have used our research since 2012.
    Comparison Review
    Anonymous User
    The six phases of an IT project Enthusiasm Disillusionment Panic Search for the guilty Punishment of the innocent (the performance tester) Praise and rewards for the incompetent non-participants This article has been put together as part of an evaluation of the performance test tools NeoLoad and LoadRunner. I consulted a variety of sources, including user groups, discussions with colleagues, telephone chats with HP (the vendors of LoadRunner) and Neotys (the vendors of NeoLoad), and of course the Oracle – Google. The opinions in this article are my own and do not represent the views of any particular company, the software vendors or any organisation (and I’ve assumed that readers have some knowledge of web application performance testing). The versions discussed in this article as of April 2014 are: LoadRunner 11.52 NeoLoad 4.2.2 I hope this evaluation and comparison will assist you with your own evaluation of LoadRunner and NeoLoad. Introduction LoadRunner and NeoLoad are considered the top two best performance testing tools on the market. Comparing the two tools is just like comparing a Mercedes Benz and a BMW: both are high performance, perfectly engineered machines that also have an associated prestige. Performance testing is a critical component of the software testing process. It determines the actual operational boundaries that will simulate the real world use of an application. Performance testing is load testing, stress testing and scalability testing. Why… Read more →
    Questions from the Community
    Top Answer:Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and… more »
    Top Answer:It has a unique programming dashboard that is very user-friendly.
    Top Answer:The pricing is manageable. It is not that big. Big companies won't mind the licensing costs. However, Neustar has more… more »
    Top Answer:My favorite feature in LoadRunner Professional is its ability to group scripts under separate IDs.
    Top Answer:The pricing model, especially when involving partners, could use some improvement.
    Top Answer:In terms of improvement, it lacks mobile testing features present in some competitors, like GitMatters, which I find… more »
    Top Answer:I highly recommend Tricentis NeoLoad for companies that are in need of a versatile load and performance testing tool… more »
    Top Answer:What I found best in Tricentis NeoLoad is that it's better with scripting and load test execution in the load testing… more »
    Top Answer:I don't have information on the licensing cost of Tricentis NeoLoad because my manager handles that. From a testing… more »
    Ranking
    Views
    6,402
    Comparisons
    3,731
    Reviews
    20
    Average Words per Review
    1,006
    Rating
    8.2
    Views
    6,887
    Comparisons
    4,431
    Reviews
    27
    Average Words per Review
    564
    Rating
    8.6
    Views
    8,345
    Comparisons
    4,202
    Reviews
    20
    Average Words per Review
    564
    Rating
    8.2
    Comparisons
    Also Known As
    JMeter Cloud
    Micro Focus LoadRunner Professional, Micro Focus LoadRunner, HPE LoadRunner, LoadRunner
    NeoLoad, Neotys NeoLoad
    Learn More
    Overview

    BlazeMeter ensures delivery of high-performance software by enabling DevOps teams to quickly and easily run open-source-based performance tests against any mobile app, website or API at massive scale to validate performance at every stage of software delivery.

    The rapidly growing BlazeMeter community has more than 100,000 developers and includes prominent global brands such as Adobe, Atlassian, Gap, NBC Universal, Pfizer and Walmart as customers. Founded in 2011, the company is headquartered in Palo Alto, Calif., with its research and development in Tel Aviv.

    OpenText LoadRunner Professional is a performance testing tool used for various software applications, including web-related use cases, API testing, and enterprise performance modeling. Its valuable features include quick test case creation and execution, graph monitoring, multiple protocols, scripting and executing tests, scalability, easy setup, auto-correlation, analysis and reporting capabilities, stability, reliability, and compatibility with various programming languages. 

    LoadRunner has helped organizations load test potential new payroll solutions and choose the best option, record network traffic of mobile applications, and handle different protocols. It is the ultimate tool for performance testing.

    OpenText LoadRunner Professional Will Enable You To:

    • Drive quality across your enterprise.
    • Alleviate the challenges of managing many application types, testing tools, licenses, repositories, and systems while working toward unified results.

    With OpenText LoadRunner Professional You Can:

    • Increase organizational efficiency through standardization of tools and resources.
    • Balance your priorities and improve the results delivered by your testing team.
    • Increase testing productivity.
    • Improve collaboration across application teams.
    • Gain the ability to outsource some or all the tactical work of load testing.

    OpenText LoadRunner Professional Features:

    • Intuitive and Easy to Use: OpenText LoadRunner Professional is intuitive, versatile, and easy to use, which makes it easy for testers to quickly learn the basics and apply them to their testing tasks, while engineers who are more experienced can utilize all the features for the most complex of scenarios.
    • Comprehensive Enterprise Coverage: OpenText LoadRunner Professional provides support for multiple protocols such as HTML, WebSocket, AJAX, RDP, Database, Remote Terminal Emulators, Citrix, Java, .NET, Oracle and SAP.
    • Scripting Technologies: Reduce scripting time by 50% or more via OpenText LoadRunner Professional’s TruClient protocol, and automatic correlation, and correlate both front end (user experience) and back end (load) issues.
    • Extensive and Flexible Test Scenarios: The LoadRunner solution provides several valuable features that let you validate, enhance, and modify your tests. It gives you the ability to integrate external measurements to assess the impact on every application component, extend tests with success-failure checks, and emulate peak loads. You can also apply load on the go and change parameters for better flexibility in order to yield the most representative testing possible.
    • Realistic Network Conditions: Network virtualization capabilities help accurately simulate realistic conditions for an accurate analysis of both throughput and user response time. Realistic network conditions are predicted using location-aware analytics, transaction analysis and optimization.
    • Accurate Workloads with Low Overhead: OpenText LoadRunner Professional allows you to run high-scale tests with minimal hardware so that you can apply accurate workloads to any application.
    • Ongoing Testing Support: The OpenText LoadRunner Professional solution provides continuous testing support via built-in integrations across IDE, CI/CD, open source test automation, monitoring, and source code management tools.

    OpenText LoadRunner Professional Benefits:

    • Quickly deliver enterprise engineering capabilities and facilitate sharing of assets and collaboration.
    • Reduce complexity and increase utilization of infrastructure and human resources.
    • Get the big picture with cross-project reporting and individual project drill downs.
    • Increase collaboration and consistency with unified storage and access to all relevant assets.
    • Reduce costs with centralized management and built-in support of cloud-based load generation.
    • Analyze end-to-end performance, including topology, infrastructure-level, and advanced insights.
    • Incorporate application monitoring and user sentiment data to take a centralized approach to data collection and connect the dots.
    • Using powerful analytics and insights, gain visibility into the test status across the entire enterprise and performance trending information across multiple tests.

    Reviews from Real Users:

    "The most useful aspect of the solution is that it provides agents in different geographic locations.” - Head, Testing Centre of Excellence at NIIT Technologies Limited

    "The most important feature for us is that it supports a lot of protocols because we support all of them, including HTTP, FTP, mainframe, and others.” - Test Automation, DevOps & Performance Engineering at a financial services firm

    "The solution can handle a huge amount of workloads, it's quite scalable.” - Regional Head Customer Experience at a financial services firm

    "The reporting mechanism is a valuable feature that generates good reports.” - Senior Architect at a computer software company

    Tricentis NeoLoad is a performance testing tool that provides developers and testers with automatic test design, test maintenance, realistic simulation of user behavior, fast root cause analysis, and built-in integrations with the entire SDLC toolchain. With NeoLoad’s plugins, teams can reuse and share test assets and results from functional testing tools, analytics, metrics, and APM tools in order to catch performance issues early. With NeoLoad’s full tech stack support, users can test the range of mobile, web, and desktop apps.

    Tricentis NeoLoad Features

    Tricentis NeoLoad has many valuable key features. Some of the most useful ones include:

    • Supports API technologies 

      • Support for SOAP/REST.
      • Assisted design with Swagger/Open API import and highly efficient extractors for quick test design and fewer errors in scripting.
      • Ability to test as code or GUI-based productivity.

    • Automated testing of API performance

      • CI/CD automated API testing, dynamic load generation infrastructure, and auto pass/fail based on SLAs.
      • Real-time test results for fast dev feedback loop if bottleneck is found.
      • Non-regression API performance trends.
    • API-based applications 

      • Ability to test stand-alone APIs or APIs within end-to-end tests. Same platform, same skills.
      • Dev, PO, QA, Ops share a common view of API performance.
      • Confidence in API and application speed and reliability.

    • Design tests faster and update automatically

      • Assisted design using wizards and automatic parameter handling.
      • Reuse functional scripts and/or convert LoadRunner scripts to NeoLoad performance tests.
      • Update system-level scripts quicker with automatic user path updates.
      • Easy to reuse and maintain.

    • Realistic user simulation

      • Simulate any business case.
      • Scale load tests with up to millions of virtual users.

    • Bottleneck identification

      • Real-time test analysis.
      • Pass/fail based on SLA.
      • Root cause analysis.

    Tricentis NeoLoad Benefits

    There are many benefits to implementing Tricentis NeoLoad. Some of the biggest advantages the solution offers include:

    • Automate API testing within CI pipelines: Design, maintain, and run performance tests. Analyze results within continuous integration pipelines.
    • Accelerate end-to-end app testing: Create test scripts fast for complex applications using a graphical user interface without the complexity of scripting new and updated tests.
    • Find performance bottlenecks fast: Compare SLAs to server-level statistics to measure how an application is performing. See overall analysis of behavior or an analysis of the data flow to a particular user path.
    • Manage across the enterprise: Collaborate across QA, operations, dev, and business teams to define SLAs and review results. Share test results and manage test infrastructure. Schedule and share resources across teams and apps.

    Reviews from Real Users

    Tricentis NeoLoad stands out among its competitors for a number of reasons. Some of these include its price, its user-friendly UX, its API support, and its scalability. PeerSpot users take note of the advantages of these features in their reviews:

    Patrik B., Technical Lead at a tech services company, writes, “The licensing cost is very less for NeoLoad. It is user-friendly and easy to understand because they have created so many useful functionalities. When I started working with this tool, we just had to do the initial assessment about whether this tool will be able to support our daily work or not. I could easily understand it.”

    A Global Delivery Head at a consultancy firm notes, “The API support is much better with this solution, compared with the competition. Pricing for it is also more affordable than its competitor. We have used Tricentis NeoLoad and we find it scalable.”

    Sample Customers
    DIRECTV, GAP, MIT, NBCUniversal, Pfizer, StubHub
    JetBlue, GOME, Australian Red Cross Blood Service, RMIT University, Virgin Media
    Dell, H&R Block, Best Buy, Orange, Verizon Wireless, ING, Mazda, Siemens, University of Oxford
    Top Industries
    REVIEWERS
    Financial Services Firm30%
    Computer Software Company22%
    Non Profit13%
    Comms Service Provider9%
    VISITORS READING REVIEWS
    Financial Services Firm20%
    Computer Software Company18%
    Retailer7%
    Manufacturing Company6%
    REVIEWERS
    Computer Software Company30%
    Financial Services Firm20%
    Comms Service Provider9%
    Government7%
    VISITORS READING REVIEWS
    Financial Services Firm16%
    Computer Software Company15%
    Manufacturing Company11%
    Government7%
    REVIEWERS
    Computer Software Company21%
    Retailer14%
    Government11%
    Financial Services Firm11%
    VISITORS READING REVIEWS
    Educational Organization44%
    Financial Services Firm10%
    Computer Software Company9%
    Manufacturing Company5%
    Company Size
    REVIEWERS
    Small Business37%
    Midsize Enterprise20%
    Large Enterprise44%
    VISITORS READING REVIEWS
    Small Business18%
    Midsize Enterprise16%
    Large Enterprise67%
    REVIEWERS
    Small Business18%
    Midsize Enterprise13%
    Large Enterprise68%
    VISITORS READING REVIEWS
    Small Business16%
    Midsize Enterprise11%
    Large Enterprise73%
    REVIEWERS
    Small Business7%
    Midsize Enterprise18%
    Large Enterprise75%
    VISITORS READING REVIEWS
    Small Business10%
    Midsize Enterprise49%
    Large Enterprise41%
    Buyer's Guide
    Performance Testing Tools
    April 2024
    Find out what your peers are saying about Apache, OpenText, Tricentis and others in Performance Testing Tools. Updated: April 2024.
    769,662 professionals have used our research since 2012.