Galen Framework vs Sauce Labs vs SmartBear TestComplete comparison

Cancel
You must select at least 2 products to compare!
Galen Framework Logo
249 views|102 comparisons
100% willing to recommend
Sauce Labs Logo
6,616 views|4,907 comparisons
96% willing to recommend
SmartBear Logo
5,893 views|4,121 comparisons
85% willing to recommend
Comparison Buyer's Guide
Executive Summary

We performed a comparison between Galen Framework, Sauce Labs, and SmartBear TestComplete based on real PeerSpot user reviews.

Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools.
To learn more, read our detailed Functional Testing Tools Report (Updated: April 2024).
769,479 professionals have used our research since 2012.
Featured Review
Quotes From Members
We asked business professionals to review the solutions they use.
Here are some excerpts of what they said:
Pros
"What I like most about Galen Framework are its advantages, particularly its spec language and the spec file feature."

More Galen Framework Pros →

"Allows us to do JIRA Cloud and BambooHR Integration.""Sauce Labs helps us identify the root causes of bugs. The solution offers a lot of flexibility by providing the latest iOS and Android emulator versions, and even the Appium updates when it comes out in the market.""Running tests in parallel.""As stated earlier we use Sauce Labs for a combination of automated testing and manual testing. Therefore the most useful features are the ability to run the functional automated tests via a Sauce Labs tunnels which allows access to applications in our internal network. The second most useful feature is the manual side.""The most valuable feature is the cross-browser feature, it has many android and iOS devices both simulators and real devices. It's easy to integrate. I also like video recording too.""With only a few clicks, it gives us the availability to use any browser and OS combination whenever we want.""Before implementing Sauce Labs, we tested physical devices that team members had to share. It was more feasible when we were all located in one office, but we couldn't leverage our offshore capacity. With this solution, we can do everything remotely, which is essential now that most of us work from home.""Sauce Connect gave us ability to test an application that was hosted locally."

More Sauce Labs Pros →

"The most valuable feature of this solution is its ability to integrate with Azure DevOps for continuous integration and deployment.""The ability to run a whole suite of tests automatically (which we did overnight).""TestComplete is simple, it's a very easy-to-use tool.""It is a strong automation tool for desktop, browser, and API testing.""It works very fine. It is fast on almost any machine, and it is also very well organized. I like its object mapping and its capability to find and interact with almost everything that exists on Windows.""When compared to other tools, it is very simple.""The initial setup is pretty easy and it's quick to deploy.""The solution has a very nice interface."

More SmartBear TestComplete Pros →

Cons
"There don't seem to be functions available for automatically generating Galen values based on the specifications in the spec file, and this could be a potential improvement for Galen Framework."

More Galen Framework Cons →

"The only drawback is the speed, it will be good if we have a server in Asia too. It will be great if we can improve speed while initialization and execution.""With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for mobiles so that we can quickly inspect elements on the device. To write the Selenium scripts, we require web locators. We have to capture them from the local and execute the script on Sauce Labs. If Sauce Labs can provide a solution where we can inspect any of the mobile devices online, it will be very helpful for us.""We encountered minor issues with stability from time to time but Sauce Labs continues to make improvements.""They could improve the platform's customer support services.""Sauce Labs' dashboard could be improved by adding more filters and allowing more customization options. There was one instance where the dashboard on the Sauce Labs UI didn't meet our requirements, so we had to use the Sauce Labs API to create some apps and dashboards on our own. The API endpoints could be a little more robust and customizable.""The ability to install profiles on iOS real mobile devices should be included.""On a rare occasion, I will come into a ticket where a customer will have reached out to me after reaching out to Sauce Labs, saying, "Sauce Labs doesn't understand what I am going through. They are not being very helpful." So, I try to do clean up there. Outside of those extremely rare occasions, I have only had one or two of those support issues.""As a web product QA team, we sometimes need to spot check some new child site on multiple browsers and OS(es). It was a little time consuming for us since we need to click on each of the browser/OS combinations and start a new session to test. Every sprint, with new features and child pages being added, we mostly need to do the same steps over and over again."

More Sauce Labs Cons →

"Right now, when you buy the solution, you need to pay for one solution. You receive one set up and you install it and it's just in that one machine. It would be ideal if they could offer one subscription where you can connect to different machines with a group subscription.""SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra.""The artificial intelligence needs to be improved.""Stability issues occurred only when connecting to the SourceSafe. Sometimes, after getting the latest version, the tool hangs and it should be reopened in order to recover.""What is currently missing from this solution is better support for mobile testing.""We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses.""It is very hard to read the test log generated by TestComplete Executor if the log file is very big. TestComplete Executor is a small tool for just running the TestComplete test framework (not for developing).""If that engine could better identify more XPaths automatically and make the process more flexible, that would be better."

More SmartBear TestComplete Cons →

Pricing and Cost Advice
Information Not Available
  • "We have an enterprise account; it has worked great for our needs."
  • "Try the free trial and work with a Sauce Labs representative to see what package works best for your application(s)."
  • "It could be less like pay-per-use with a lower rate."
  • "Go ahead please. Try it at a smaller scale."
  • "Trial the product and see if it suits your needs."
  • "When you reach the Enterprise licensing tier, base level being with 10 concurrent test sessions, pricing is essentially per-unit-of-concurrency thereafter with a relatively linear increase and not much benefit for "bulk"."
  • "Compared with other services, Sauce Labs is a bit expensive."
  • "​Now that we have an enterprise license, we no longer have to worry about minutes each month!​"
  • More Sauce Labs Pricing and Cost Advice →

  • "The product is becoming more and more expensive."
  • "My advice so far, is that while it’s not quite as powerful and easy to use as UFT, its price tag more than makes up for it."
  • "The price is less, compared to other products, such as QTP."
  • "Buy modules on demand. If you have a four-person team and they will each automate tests only 25% of the time, it's better to buy a floating licence and share the tool during the work day."
  • "TestComplete now have come up with three modules (Web, Desktop & Mobile), so based on the type of product for automation, it is adequate to purchase the required module."
  • "This is a pay-per-use service that is not expensive, and cost-efficient if you have a small team."
  • "The option we chose was around $2,000 USD."
  • "The licensing costs are in the range of $1,000 to $3,000."
  • More SmartBear TestComplete Pricing and Cost Advice →

    report
    Use our free recommendation engine to learn which Functional Testing Tools solutions are best for your needs.
    769,479 professionals have used our research since 2012.
    Questions from the Community
    Top Answer:What I like most about Galen Framework are its advantages, particularly its spec language and the spec file feature.
    Top Answer:Galen Framework does not have any additional costs after the product is purchased.
    Top Answer:I haven't found any specific areas for modernization or improvement in Galen Framework yet. However, one observation I… more »
    Top Answer:The solution they provide is very robust. We can quickly connect to their environment with the hub URL. They have a URL… more »
    Top Answer:With the desktop browser, we can inspect any screen with the web developer option, but they should provide something for… more »
    Top Answer:We use it for automated testing. For our company, we do web testing automation. We run our test suites containing… more »
    Top Answer:This company offers end-to-end capabilities for test suite creation and execution. One feature that I particularly… more »
    Top Answer:There are certain challenges related to the license management system in place. It comes with a high cost. An annual… more »
    Top Answer:At times, identifying or locating an element can be somewhat challenging. However, in a recent test update, they… more »
    Ranking
    25th
    Views
    249
    Comparisons
    102
    Reviews
    1
    Average Words per Review
    376
    Rating
    8.0
    11th
    Views
    6,616
    Comparisons
    4,907
    Reviews
    2
    Average Words per Review
    1,551
    Rating
    5.5
    10th
    Views
    5,893
    Comparisons
    4,121
    Reviews
    7
    Average Words per Review
    503
    Rating
    7.1
    Comparisons
    Learn More
    Overview

    Layout testing seemed always a complex task. Galen Framework offers a simple solution: test location of objects relatively to each other on page. Using a special syntax and comprehensive rules you can describe any layout you can imagine.

    Galen Framework runs well in Selenium Grid. You can set up your tests to run in a cloud like Sauce Labs or BrowserStack so that you can even test your responsive websites on different mobile devices. Galen can run multiple tests in parallel which is also a nice time saver.

    Galen Framework is designed with responsivness in mind. It is easy to set up a test for different browser sizes. Galen just opens a browser, resizes it to a defined size and then tests the page according to specifications.

    Sauce Labs is a functional testing tool that ensures your apps and websites work flawlessly on every browser, OS, and device. The solution allows you to automate functional testing on multiple operating systems and browsers, emulating the way that a user would use the website. With Sauce Labs, you can also run tests on various operating system and browser combinations in parallel, reducing the amount of time to get results. The Sauce Labs solution provides enterprise-grade security, scalability, and reliability.

    Sauce Labs Features

    Sauce Labs has many valuable key features. Some of the most useful ones include:

    • Automated cross-browser testing
    • Mobile testing
    • Secure tunneling protocol
    • Usage reporting
    • Enterprise security
    • Provisioning
    • Centralized user account management
    • Access controls
    • Support for Selenium, Appium, and JUnit Testing

    Sauce Labs Benefits

    There are many benefits to implementing Sauce Labs. Some of the biggest advantages the solution offers include:

    • Speed up development time: The solution makes it possible for you to test web and mobile apps in parallel and accelerate your testing time by up to 10x or more. Using Sauce Labs, you can increase developer productivity because your teams will be able to spend less time with test maintenance and debug faster.
    • No worrying about infrastructure: With Sauce Labs, you don’t have to buy or maintain more servers or mobile devices. You also don’t need to worry about updating browsers or VM licenses. Sauce Labs allows you to easily scale your tests with parallelization to speed up test cycles and boost capacity on their reliable cloud.
    • Run tests securely: The solution enables you to securely run your scripts and access your data and files from behind your firewall. Sauce Labs generates single-use VMs for every test and destroys them immediately afterwards so your data always remains secure.
    • Easy integration for your CI systems: Sauce Labs automated testing platform integrates with Jenkins, Bamboo, Microsoft VSTS, and others so you can test as fast as you develop. In addition, you can share results instantly by using the solution’s simple plugins.

    Reviews from Real Users

    Sauce Labs is a solution that stands out when compared to many of its competitors. It has valuable features that include error logging, helpful dashboards, and its browser.

    Joel A., Product Manager - Data & APIs at a marketing services firm, says, "The error logging is very robust. If we run a test through Sauce Labs and there's some sort of issue, a log will appear on the screen. Log messages are usually heinous and horrible... Sauce Labs is incredibly good at saying things like, 'Hey, here is the exact issue. Fix this and you can run the test.' That helps in getting things up and running and executing the way they should."

    Savio D., Sr. IT Architect at a healthcare company, mentions, "Sauce Labs' dashboards contain multiple useful metrics in one place. Everything is represented to us visually on the dashboard, which helps us understand where to focus our attention, what the issues are, and what we need to resolve."

    PeerSpot reviewer, Rob L., Director of Quality Assurance - Shared Service at a financial services firm, writes, “The most valuable feature for us is the browser. The most critical thing is that this software aligns with our Agile and DevOps way of doing things. It integrates with kickoff scripts through DevOps.”

    What is SmartBear TestComplete?

    TestComplete is a reliable, sturdy automated testing platform created by SmartBear Software. SmartBear Software is a worldwide technological leader known for developing quality enterprise-class development and testing solutions.

    TestComplete simplifies the process of creating tests for numerous applications, including, but not limited to; Desktop, Android, IOS, Web browsers, and Windows. Application tests can be manual, scripted, and even recorded by using keyword-driven or data-driven functionality. There are even additional options for error reporting and automated playback. The object repository is extremely accurate and is fully customizable. TestComplete can easily be used by experienced developers and even by manual novice testers to develop quality automated UI tests quickly.

    TestComplete offers three different testing scenarios:

    • Desktop: Users can easily and quickly automate UI tests using today’s most popular desktop applications, such as; Windows, Java, Python,.Net, VBScript, and more.

    • Web: Users can effortlessly create renewable tests for all of today’s popular web applications, including JavaScript frameworks on 2000+ trusted browser and platform integrations.

    • Mobile: Users can safely build and automate serviceable UI tests on actual or virtual android or IOS devices, locally or in the cloud. Users can create code or codeless tests. TestComplete seamlessly integrates with many of today’s popular frameworks.

    Key Features

    • Easily create automated UI tests: TestComplete offers scriptless Record and Replay or simple keyword-driven tests to quickly develop any type of UI test users may require. Tests can be recorded once, then replayed when needed across various applications on mobile, web, or desktop environments. TestComplete integrates with many different languages, such as Java, Python, C+, and more.

    • Keyword driven tests: Users can easily divide testing steps, actions, objects, and data with an integrated keyword-driven test structure. This makes it easy for every user to participate in the test automation process; there is no programming experience needed. Everything is made simple with easy-to-use point-and-click options.

    • Data driven tests: Easily distinguish data from test commands to keep administrative efforts simple. Users can improve overall coverage by running various automated mobile, desktop, or web UI tests.

    • Record and Replay: Users can reuse created automated tests across every environment as often as desired. This helps to expand overall test coverage and represents a huge cost and time savings.

    Reviews from Real Users

    Sandhiya T S., Sr Solutions Engineer at Lexington Soft, relates, “The record and replay aspects of the solution are quite useful for people. With them, you don't have to write any scripts. Basically, you can record your actions and play them back later. The initial setup is also very easy.”

    Sai S R., Staff Test Architect at a tech services company, says, "The most valuable features of the SmartBear TestComplete are self-healing, they reduce the maintenance required. The different languages SmartBear TestComplete supports are good because some of our libraries are written in Python, JavaScript, and C#. It's very easy to put them all under one project and use them."

    Sample Customers
    Information Not Available
    Salesforce.com, Mozilla, Zendesk, Puppet Labs, Twitter, Bank of America, Eventbrite, Bleacher Report, Okta, Intuit, Travelocity, Sharecare, CapitalOne.
    Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
    Top Industries
    VISITORS READING REVIEWS
    Financial Services Firm15%
    Energy/Utilities Company12%
    Computer Software Company12%
    Healthcare Company10%
    REVIEWERS
    Healthcare Company14%
    Computer Software Company11%
    Media Company9%
    Financial Services Firm8%
    VISITORS READING REVIEWS
    Financial Services Firm17%
    Computer Software Company17%
    Healthcare Company6%
    Retailer6%
    REVIEWERS
    Computer Software Company31%
    Manufacturing Company13%
    Financial Services Firm9%
    Comms Service Provider6%
    VISITORS READING REVIEWS
    Computer Software Company19%
    Manufacturing Company11%
    Financial Services Firm11%
    Government7%
    Company Size
    VISITORS READING REVIEWS
    Small Business14%
    Midsize Enterprise8%
    Large Enterprise78%
    REVIEWERS
    Small Business25%
    Midsize Enterprise20%
    Large Enterprise55%
    VISITORS READING REVIEWS
    Small Business18%
    Midsize Enterprise10%
    Large Enterprise71%
    REVIEWERS
    Small Business28%
    Midsize Enterprise28%
    Large Enterprise45%
    VISITORS READING REVIEWS
    Small Business24%
    Midsize Enterprise15%
    Large Enterprise62%
    Buyer's Guide
    Functional Testing Tools
    April 2024
    Find out what your peers are saying about Tricentis, OpenText, Perforce and others in Functional Testing Tools. Updated: April 2024.
    769,479 professionals have used our research since 2012.