Apache JMeter vs Worksoft Certify comparison

Cancel
You must select at least 2 products to compare!
Apache Logo
8,414 views|6,767 comparisons
87% willing to recommend
Worksoft Logo
4,859 views|2,371 comparisons
95% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Apache JMeter and Worksoft Certify based on real PeerSpot user reviews.

Find out in this report how the two API Testing Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI.
To learn more, read our detailed Apache JMeter vs. Worksoft Certify Report (Updated: March 2024).
767,667 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"I appreciate JMeter's simplicity and power for performance testing.""Very user-friendly and easy to use.""The solution helps by detecting bottlenecks.""The most valuable feature of this solution is that it is free.""Due to process automation, I don't have to prepare reports, making it the perfect solution.""JMeter lets us generate virtual users and T-load, per our requirements. It's easy to configure and adjusting the virtual users according to the DPS we want to achieve.""When someone in our organization wants to test web applications, they use Apache JMeter since they face no hurdles while using the solution.""The most valuable features are the integration with Jenkins and the reporting."

More Apache JMeter Pros →

"During our yearly upgrades, we have now gotten them down to ten days or less. We have Worksoft run all our integration tests, where it used to take probably six weeks to do that manually.""The turn around time for getting the automation tester familiarized with the tool is very quick, as it doesn't have any coding. It is fairly simple to understand.""The most valuable features of Worksoft Certify are the way we can maintain the processes and sub-processes inside. We can immediately identify and replicate multiple objects in the application without having a major issue with it. We are able to do a lot of operations even with the solution being completely scriptless. That is a large advantage compared with other automation tools.""It is highly scalable and reusable. It is easy for team members to maintain and use with confidence. There is great versatility.""It is a huge improvement, as it recognizes complex general applications, where most tools won't recognize the objects within them.""We are mainly using it for the SAP application, and for the SAP application, if you don't have any experience with automation tools, after a few training sessions, you can easily automate the scripts. That's because no specific programming language is used. All resources that I have are specifically SAP resources. They are not from the automation background, but after gaining the knowledge, they are able to develop a script, or when there is any issue while doing regression testing, they are at least able to understand the issue, such as whether the issue is in the code or data.""It's module based and it's giving functionality.""The Worksoft Capture feature is most valuable. For example, if you are creating a sales order in SAP, you do not need to go to each field and do everything. You do not need to write code for each and every line. You can just turn on the Worksoft Capture feature and manually perform your actions. It will capture all manual actions, and it will give you the steps. It will write the steps for you."

More Worksoft Certify Pros →

Cons
"Apache JMeter could be a more user-friendly product from the end user's perspective.""It's not easy to get the data from one place or to do customizations.""In Micro Focus LoadRunner we can go from the UI and we can configure it. There is no such feature in Apache JMeter. There should be UI-based recording history or logs.""The initial setup is complex and needs to be upgraded.""The solution is not user-friendly, there is no framework for autocorrelation or parameterization.""Automation is difficult in JMeter.""Apache should have a graphic interface.""Apache JMeter may have difficulty recognizing dynamic objects in some critical cases, which can lead to challenges in terms of object identification."

More Apache JMeter Cons →

"With the codeless process automation across packaged applications, once in a while, if we get a weird application that's not widely used, it gets a little stickier. First, the software has to learn the fields, so you have to identify all the fields. Once you do that, as long as there isn’t any non-standard code in the application, then it works fine. But there's that one step that you have to do, a step you don't have to do with SAP and Salesforce, for example.""The web application should be more robust.""I would like Worksoft Certify to do automation at any layer (the UI layer, API layer, or database layer) and challenge competitors in the RPA industry, like UiPath and Automation Anywhere.""The overall speed and performance of this solution could be improved. In a future release, it would be useful to be able to do API testing.""In the past, when we've tried to automate some of our web apps, it has not been as robust. If there were one thing that could be improved, it's interaction with web applications. The issue we were running into is that it was harder to identify the objects than it is with some of the other architectured applications.""When it comes to mobile testing, we have a small bottleneck there. You have to buy third-party separate licenses if you want to test on a mobile. Business wise we see room for improvement there, although it's that really critical for us.""I would like the GUI to be more user-friendly and intuitive. We want to be able to move assets from project to another project without having to be in the same project or the same folder structure.""The technical support comes on, and says, "Oh, so-and-so link is here, go through that link, and make the modifications." I'm not comfortable in making those changes. I want to schedule a call, share my screen, and have them fix it for me."

More Worksoft Certify Cons →

Pricing and Cost Advice
  • "Free"
  • "I switched to Apache because it is free. Other tools are much too expensive and can cost up to $50,000 a year if you are looking at commercial options."
  • "This is an open-source solution, and there are no fees."
  • "This is an open-source product."
  • "I was using the free version of the software."
  • "In terms of open-source adoption, it is completely free."
  • "We are using the free version, and if required, we can easily switch to the other version."
  • "When comparing the price with Load Runner, and if the cost is an issue then JMeter is a better choice"
  • More Apache JMeter Pricing and Cost Advice →

  • "The tool is not really good at all because you need to purchase some additional tools."
  • "We would purchase more licenses right now if they were cheaper. Pricing is a little bit of a hindrance."
  • "It is expensive compared to some of the other automation tools in the market. However, the benefits and ROI has proved that it has been a good investment."
  • "The initial upfront cost in terms of licenses, plus all the money that we spent developing tests, has proven it's worth. Now, we can do a regression test suite in ten days as opposed to sixteen weeks."
  • "Our ROI is primarily a reduction in testing time. The testing, when we were doing it manually, was 30 to 40 percent of the project's cost."
  • "We ended up buying too many licenses. They were very good at selling it to us, and probably oversold it a little. We bought 45 licenses and have never used more than twenty. However, they gave us a pretty significant discount on the bigger license, so it made sense for us to buy enough that we wouldn't have to go back and ask for more."
  • "We could use Certify to do robotic process automation, which is basically running a process on your correction system instead of your test system. Therefore, we may do that in the future."
  • "By using automation, it reduced about 75 percent of the time when compared to any other tool."
  • More Worksoft Certify Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which API Testing Tools solutions are best for your needs.
    767,667 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:Postman lets you easily define variables, which then get updated automatically. This is a huge time-saver and makes processes very efficient. We can also export the test cases we create and share them… more »
    Top Answer:Blazemeter is a continuous testing platform that provides scriptless test automation. It unifies functional and performance testing, enabling users to monitor and test public and private APIs We… more »
    Top Answer:JMeter is basically the art of the entire performance testing process.
    Top Answer:Tosca fulfills our business needs better because it is an end-to-end solution across technologies. We like that it is scriptless, so even non-experienced staff can use it. To put it simply, with… more »
    Top Answer:A specific feature that I found to be the most valuable in the solution for our company's work processes stems from the fact that it is useful as a low-code automation tool.
    Top Answer:Worksoft Certify is priced higher than most tools. I rate Worksoft Certify an eight out of ten for pricing.
    Ranking
    3rd
    out of 13 in API Testing Tools
    Views
    8,414
    Comparisons
    6,767
    Reviews
    45
    Average Words per Review
    487
    Rating
    7.6
    6th
    out of 13 in API Testing Tools
    Views
    4,859
    Comparisons
    2,371
    Reviews
    12
    Average Words per Review
    552
    Rating
    8.1
    Comparisons
    Also Known As
    JMeter
    Learn More
    Overview

    Apache JMeter is an open-source Java application that tests load and functional behavior and performance in applications. Created initially to test web applications, it has expanded its functionality to test other functions. For instance, you can test a server to see how efficiently it works and how many user requests can be handled simultaneously.

    You can use JMeter to test functional performance and regression tests on different technologies. This Java desktop application has an easy-to-use graphical interface which uses the Swing graphical API. You can run JMeter on any environment that accepts a Java virtual machine, such as Windows, Linux, and Mac.

    What protocols does JMeter support?

    • Web - HTTP, HTTPS
    • Web services - SOAP/XML-RPC
    • Email service - POP3, IMAP, SMTP
    • FTP service
    • Database via JDBC drivers
    • LDAP
    • Native commands or shell scripts
    • TCP
    • Java objects

    How does JMeter work?

    JMeter sends requests to a target server by simulating a group of user requests. Then it collects and calculates statistics on the performance of the target. This target can be a server or an application.

    You can test the performance of static resources, such as JavaScript or HTML, and dynamic resources, such as JSP, Servlets, and AJAX. It is also helpful to determine how many concurrent users your website can handle.

    There are two main tests you can carry out with JMeter: load test and stress test. The load test models expected usage of a server by simulating multiple users accessing the web server simultaneously. The stress testing aims to find the maximum load capacity of the server or application.

    Apache JMeter Key Features

    • JMeter enables fast test plan recording, building, and debugging via a featured test IDE (integrated development environment).
    • Command-line mode allows carrying out load tests from any OS compatible with Java.
    • JMeter can extract data from most popular response formats, such as HTML, JSON, XML.
    • JMeter is entirely portable.
    • A multithreading framework allows you to simultaneously test multiple samplings and separate thread groups.
    • Thanks to the caching feature, you can conduct offline analysis or replay test results.

    Apache JMeter Benefits

    • As open-source software, it is freely available and continuously improved.
    • The setup is user-friendly, and no installation is needed.
    • The GUI (graphic user interface) is intuitive and easy to use.
    • You can write your own tests and use the visualization plugins to extend the testing.
    • It is a platform-agnostic tool. For example, JMeter can work with Linux by clicking on the JMeter shell script. On Windows, you can call up JMeter by starting the jmeter.bat file.
    • Since the test plans are stored in XML format, you can generate a test plan using any text editor.
    • You can simulate a heavy load on a server, a group of servers, a network, or an object. Use JMeter to test an application or server's strength and performance under different load types.

    The JMeter extensible core has numerous benefits:

    • Unlimited testing capabilities via pluggable samplers.
    • You can choose multiple load statistics with pluggable timers.
    • Visualization plugins and data analysis enable customization.
    • Continuous integration via third-party open-source libraries (Maven, Gradle, and Jenkins).

    Reviews from Real Users

    Stephen B., I.T. Architect, Analyst, and Developer at an educational organization, says, "The scripting ability is most valuable. It is easy to use. There is a UI, and you can go in there and figure those things out. After you've got a good set of tests, you basically have a scripted document that you can grab and execute in a pipeline. It is pretty quick to set up, and you can scale it and version control it."

    "I like the fact that JMeter integrates well with other tools," adds the Founder and Principal Consultant at a tech services company.

    A Quality Engineering Delivery Leader at a financial services firm says, “The performance of the solution is excellent. They have designed the product so that it is very easy to configure. You can basically do anything you like with the product. It's not very restrictive. We like the fact that the technology is open-source.”

    Worksoft Certify is the industry's first codeless automated testing system, created for non-technical people to test end-to-end business processes at an enterprise scale.

    It was designed to test complicated processes spanning numerous apps and integrating into contemporary DevOps tool chains. Worksoft Certify manages dynamic input, process flows, and frequent variances in business processes with ease.

    Worksoft Certify automates the testing of your exact business processes across all of your enterprise applications. This solution makes it simple for customers and suppliers to package a process with all of its related dependencies, sub-processes, record sets, record filters, layouts, and variables.

    Worksoft Certify automates tests as effortlessly and quickly as the underlying applications permit, allowing you to evaluate business processes in record time with flawless dependability and consistency. Worksoft Certify speeds up test automation by utilizing a patented Object Action Framework, which effectively models the application under test as a set of pages containing GUI objects and test steps that perform actions on those objects.

    Worksoft Certify Features

    Worksoft Certify has many valuable key features. Some of the most useful ones include:

    • LiveTouch: Without coding, graphically edit and update tests.
    • No "fail" tests: See fail validations flagged when the end-to-end test continues.
    • Process comparison: Visually compare tests side by side and eliminate unnecessary tests to reduce maintenance
    • Magic search: AI-driven process search can find duplicate processes and keep automation libraries clean.
    • Exploratory testing: Real-time automated exploratory tests.
    • API testing: Utilize the virtual services and current SoapUI tests.
    • Test data generator: Obtain data from SAP for testing.
    • Create content: Make use of the more than 300 prebuilt SAP end-to-end testing scenarios.
    • Visual capture: Support agile testing by using automation artifacts from process discovery.
    • Full compatibility: Web, Java, .Net, client/server applications, SAP GUI, FIORI, web portal Workday, Salesforce, ServiceNow, Ariba, SuccessFactors, Hybris, AJAX, and more.

    Worksoft Certify Benefits

    There are many benefits to implementing Worksoft Certify. Some of the biggest advantages the solution offers include:

    • Speed: Automate at least 80% of testing to accelerate innovation.
    • Savings: Reduce overall testing and maintenance expenditures by 60% to 80%.
    • Confidence: Identify defects faster and reduce production defects by 60%.
    • DevOps-ready: Run tests as part of continuous integration, testing, or delivery cycle.
    • Support for RPA: Convert test scripts into robotic process automation.

    Reviews from Real Users

    Jens N., Enterprise Architect SAP Solutions at a computer software company, writes, “As compared to other tools for test automation, what is very good in this tool is the ability to implement logic into the scripts without coding and learning a complex script language. It is comparable to defining formulas in Excel. It is pretty easy to learn how to make your scripts more intelligent and more flexible as per the situation.”

    Aditya C., Sr Test Automation Architect at a tech services company, notes, “The most valuable features of Worksoft Certify are the way we can maintain the processes and sub-processes inside. We can immediately identify and replicate multiple objects in the application without having a major issue with it.”

    Sample Customers
    AOL, Orbitz, Innopath Software, PrepMe, Sapient, Corporate Express Australia, CSIRO, Ephibian, Talis, DATACOM, ALALOOP, eFusion, Panter, Sourcepole, University of Western Cape
    Kraft, Reliant Energy, Richemont, Applied Materials, Siemens PLM, Mosaic, Dow Corning, ebay, IBM, Accenture, Fortis BC, US Government, Southwest Airlines
    Top Industries
    REVIEWERS
    Computer Software Company38%
    Financial Services Firm30%
    Energy/Utilities Company4%
    Renewables & Environment Company4%
    VISITORS READING REVIEWS
    Financial Services Firm18%
    Computer Software Company17%
    Manufacturing Company8%
    Government6%
    REVIEWERS
    Manufacturing Company36%
    Energy/Utilities Company11%
    Computer Software Company9%
    Pharma/Biotech Company7%
    VISITORS READING REVIEWS
    Manufacturing Company17%
    Computer Software Company12%
    Retailer8%
    Financial Services Firm7%
    Company Size
    REVIEWERS
    Small Business25%
    Midsize Enterprise24%
    Large Enterprise52%
    VISITORS READING REVIEWS
    Small Business16%
    Midsize Enterprise13%
    Large Enterprise70%
    REVIEWERS
    Small Business7%
    Midsize Enterprise9%
    Large Enterprise84%
    VISITORS READING REVIEWS
    Small Business14%
    Midsize Enterprise13%
    Large Enterprise73%
    Buyer's Guide
    Apache JMeter vs. Worksoft Certify
    March 2024
    Find out what your peers are saying about Apache JMeter vs. Worksoft Certify and other solutions. Updated: March 2024.
    767,667 professionals have used our research since 2012.

    Apache JMeter is ranked 3rd in API Testing Tools with 82 reviews while Worksoft Certify is ranked 6th in API Testing Tools with 64 reviews. Apache JMeter is rated 7.8, while Worksoft Certify is rated 8.4. The top reviewer of Apache JMeter writes "It's a free tool with a vast knowledge base, but the reporting is lackluster, and it has a steep learning curve". On the other hand, the top reviewer of Worksoft Certify writes "Enables us to automate end-to-end testing of our integration between S/4HANA and Salesforce.com". Apache JMeter is most compared with BlazeMeter, Postman, Tricentis NeoLoad, OpenText LoadRunner Professional and Katalon Studio, whereas Worksoft Certify is most compared with Tricentis Tosca, Selenium HQ, OpenText UFT One, Katalon Studio and LEAPWORK. See our Apache JMeter vs. Worksoft Certify report.

    See our list of best API Testing Tools vendors.

    We monitor all API Testing Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.