SmartBear TestComplete vs SpecFlow comparison

Cancel
You must select at least 2 products to compare!
SmartBear Logo
6,927 views|4,860 comparisons
86% willing to recommend
Tricentis Logo
464 views|196 comparisons
75% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between SmartBear TestComplete and SpecFlow based on real PeerSpot user reviews.

Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools.
To learn more, read our detailed Test Automation Tools Report (Updated: April 2024).
769,789 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"It is a strong automation tool for desktop, browser, and API testing.""The most valuable features are the desktop and mobile modules.""The product has many features.""The most valuable feature of this solution is regression testing tools.""Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution.""Test items, project variables helps in managing automation suite and scheduling execution.""Complete works perfectly with CUTE. That includes all dialogues, right-click menus, or system dialogues, etc., which are handled well.""The most valuable feature is the integration with Azure DevOps."

More SmartBear TestComplete Pros →

"The most valuable feature of the solution is unit testing...It is also an easy-to-use and user-friendly product that can easily adapt to any framework.""The initial setup is easy.""SpecFlow's best feature is the ability to add additional layers to the programming.""One of the most valuable features of SpecFlow for us is its risk identification capabilities."

More SpecFlow Pros →

Cons
"There could be API interfaces with this tool.""Headless testing would be a big improvement.""In the cross-browser domain, it has a few snags with Microsoft Edge and Chrome; although, these problems are not critical.""The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS.""What is currently missing from this solution is better support for mobile testing.""The pricing is the constraint.""The integration tools could be better.""If that engine could better identify more XPaths automatically and make the process more flexible, that would be better."

More SmartBear TestComplete Cons →

"Regarding improvement, it would be good if SpecFlow could provide chain testing, which it currently doesn't allow.""SpecFlow's installation and configuration can be a bit challenging due to its flexibility as an open-source tool.""I'd prefer in TFS if we could be writing test cases, not in the old classical version. We should be writing in Gherkin and then automatically have it convert that Gherkin test case into SpecFlow feature files.""SpecFlow would be improved with the addition of functionality reporting, which would be really helpful for automation testing."

More SpecFlow Cons →

Pricing and Cost Advice
  • "The product is becoming more and more expensive."
  • "My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
  • "The price is less, compared to other products, such as QTP."
  • "Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
  • "TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
  • "This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
  • "The option we chose was around $2,000 USD."
  • "The licensing costs are in the range of $1,000 to $3,000."
  • More SmartBear TestComplete Pricing and Cost Advice →

  • "SpecFlow is open-source and free of charge."
  • "SpecFlow is an open-source product."
  • More SpecFlow Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
    769,789 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly appreciate is the tagging system. Tags are highly valuable, as they allow you to… more »
    Top Answer:There are certain challenges related to the license management system in place. It comes with a high cost. An annual price is around four thousand five hundred plus per user, whereas UiPath is only… more »
    Top Answer:At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they introduced the Optical Character Recognition (OCR) capability. This introduction has… more »
    Top Answer:One of the most valuable features of SpecFlow for us is its risk identification capabilities.
    Top Answer:SpecFlow is an open-source product. You just use SpecFlow's plugin capabilities or add it to your existing framework.
    Top Answer:In terms of improvement, SpecFlow's installation and configuration can be a bit challenging due to its flexibility as an open-source tool. While it offers a balanced flexibility, setting it up might… more »
    Ranking
    7th
    Views
    6,927
    Comparisons
    4,860
    Reviews
    7
    Average Words per Review
    503
    Rating
    7.1
    9th
    Views
    464
    Comparisons
    196
    Reviews
    4
    Average Words per Review
    609
    Rating
    7.3
    Comparisons
    Also Known As
    SpecFlow+
    Learn More
    Overview

    What is SmartBear TestComplete?

    TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

    TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

    TestComplete offers three different testing scenarios:

    • Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.

    • Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.

    • Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

    Key Features

    • Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.

    • Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.

    • Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.

    • Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

    Reviews from Real Users

    Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

    Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

    SpecFlow is a testing framework that supports Behaviour Driven Development (BDD). It lets us define application behavior in plain meaningful English text using a simple grammar defined by a language called Gherkin.

    Sample Customers
    Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
    Microsoft, Caterpillar, Siemens, Charles Schwab, IBM, Deloitte, Accenture, Philips, Dell, Deutsche Bank
    Top Industries
    REVIEWERS
    Computer Software Company31%
    Manufacturing Company13%
    Financial Services Firm9%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Computer Software Company19%
    Manufacturing Company11%
    Financial Services Firm11%
    Government7%
    VISITORS READING REVIEWS
    Computer Software Company16%
    Financial Services Firm13%
    Healthcare Company12%
    Manufacturing Company9%
    Company Size
    REVIEWERS
    Small Business28%
    Midsize Enterprise28%
    Large Enterprise45%
    VISITORS READING REVIEWS
    Small Business24%
    Midsize Enterprise15%
    Large Enterprise62%
    VISITORS READING REVIEWS
    Small Business22%
    Midsize Enterprise14%
    Large Enterprise65%
    Buyer's Guide
    Test Automation Tools
    April 2024
    Find out what your peers are saying about Tricentis, OpenText, Katalon Studio and others in Test Automation Tools. Updated: April 2024.
    769,789 professionals have used our research since 2012.

    SmartBear TestComplete is ranked 7th in Test Automation Tools with 71 reviews while SpecFlow is ranked 9th in Test Management Tools with 4 reviews. SmartBear TestComplete is rated 7.6, while SpecFlow is rated 7.2. The top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". On the other hand, the top reviewer of SpecFlow writes "Ensures efficient testing and validation of both business and technical requirements". SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish, whereas SpecFlow is most compared with Tricentis Tosca, Tricentis qTest and TestRail.

    We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.