Try our new research platform with insights from 80,000+ expert users

SmartBear TestComplete vs TestRail vs Tricentis Tosca comparison

 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

ROI

Sentiment score
6.7
SmartBear TestComplete automation saves time, enhances client satisfaction, and boosts efficiency, with annual savings of approximately $10,000.
Sentiment score
8.0
TestRail improved productivity, collaboration, and accuracy in test management, providing valuable reporting, integrations, and an intuitive interface for users.
Sentiment score
7.2
Tricentis Tosca enhances ROI with efficient automated testing, reducing costs and time, though costly for smaller firms.
Once set up, only one person is needed to handle all tasks, reducing the requirement for multiple personnel.
Time-wise, it saves about fifteen to twenty percent compared to Excel, and money-wise, it's around ten percent.
Tasks that typically take ten hours are reduced to two to three hours, representing a threefold productivity gain.
 

Customer Service

Sentiment score
6.9
SmartBear TestComplete's customer support is knowledgeable but inconsistent, with delays and unresolved issues needing faster escalation and responses.
Sentiment score
4.0
TestRail's self-sufficient support has mixed reviews on communication and responsiveness; some seek improvements for complex issues.
Sentiment score
6.8
Tricentis Tosca customer service is praised for responsiveness and expertise, despite some delays and lack of online community.
Sometimes, you really need to speak to a person, and arranging such calls is not easy.
My experience has been positive; their response to emails or phone calls in tech support is fast, usually between eight to ten hours.
There is no way to mark the importance or criticality of incidents when creating them.
Response through chat has been replaced by chatbots, which has impacted the experience.
 

Scalability Issues

Sentiment score
7.3
SmartBear TestComplete is scalable and adaptable, with flexible scripting, but may require licensing for wider deployment.
Sentiment score
9.5
TestRail remains stable and scalable with minimal maintenance, effectively managing increasing users and data loads for organizations of all sizes.
Sentiment score
7.4
Tricentis Tosca is scalable for large enterprises, supporting automation across technologies, despite potential customization and cost challenges.
I have never experienced any issues with its scalability.
It covers a breadth of applications and products, demonstrating excellent scalability that I have seen in reality.
 

Stability Issues

Sentiment score
6.9
SmartBear TestComplete generally stable, but users report crashes, memory leaks, and HTML5 testing delays in certain scenarios.
Sentiment score
9.7
TestRail is praised for its strong stability and reliability, with users consistently rating it highly for performance.
Sentiment score
7.4
Tricentis Tosca is stable, with minor license issues and occasional slowdowns, but vendor support effectively resolves challenges.
It has never had any issues.
The stability of Tricentis Tosca is rated ten out of ten. It is very stable.
I find stability issues when using the Vision AI feature; Tricentis Tosca is not very stable.
 

Room For Improvement

SmartBear TestComplete faces challenges in object recognition, integrations, licensing, performance, and support across browsers and mobile devices.
TestRail users seek enhanced reporting, better integrations, built-in defect management, and improved usability, performance, and automation features.
Tricentis Tosca needs better integration, object recognition, documentation, mobile testing, UI, cost-effective licensing, support, reporting, and AI features.
While using SmartBear TestComplete, we are fine with the current capabilities, however, it would be beneficial to improve some performance aspects, especially the image comparison feature.
TestRail lacks the functionality to map test cases to requirements and risks.
Moving to a cloud-based application rather than a desktop one could improve Tosca.
The Vision AI implementation works very slowly, affecting the speed of our work.
If a button in an application changes, Tricentis Tosca should be smart enough to detect the change and still execute the script seamlessly.
 

Setup Cost

SmartBear TestComplete's pricing and licensing receive mixed reviews, seen as both reasonable and costly depending on usage and modules.
Enterprise users have mixed opinions on TestRail pricing, recommending shopping around and negotiating for the best deals.
Tricentis Tosca's high costs suit large enterprises, while smaller companies may prefer open-source alternatives for automation.
It offers good value for money.
The pricing for Tricentis Tosca is extremely high, and I rate it as ten in terms of expense.
A yearly license costs around 20,000 euros.
For enterprise customers, the cost is manageable because it provides solutions for multiple applications they want to automate.
 

Valuable Features

SmartBear TestComplete excels in cross-platform automation, integration, and support for multiple languages, enhancing automated testing efficiency and maintenance.
TestRail excels in test management with intuitive organization, JIRA integration, user-friendly interface, real-time dashboards, and global accessibility.
Tricentis Tosca simplifies testing with scriptless automation, model-based testing, broad technology support, and seamless integration with other tools.
The most valuable feature of SmartBear TestComplete for me is the image comparison functionality.
It significantly saves effort in managing test execution and managing all test cases.
The modular approach reduces scripting effort by at least fifty percent, which significantly cuts down on the script development time.
It allows for drag-and-drop functionality and demo automation in SAP-based applications, which can be challenging with other automation tools.
The most useful features of Tricentis Tosca include API scanning, basic web application automation, and data validation capabilities.
 

Mindshare comparison

Test Automation Tools
Test Management Tools
Functional Testing Tools
 

Featured Reviews

Prakhar Goel - PeerSpot reviewer
Used for integration automation, user-based automation, and web automation
The solution's most valuable features are the drag-and-drop feature, keyword-driven approach, and reusability of the scripts. The solution has introduced a new feature that helps us identify objects we cannot normally identify. It gives you a fair idea of objects, resolving the object recognition issue. The solution can be used to perform different tests on different machines.
StuartBarker - PeerSpot reviewer
A tool that provides effective test management and real-time reporting capabilities
I have faced some issues with the integration between TestRail and Jira where the status of tests is not displayed (in Jira) due to I suspect security settings on the browser. In a large corporate environment, it is not easily changed. The support wasn't particularly helpful. It would be great if I could create custom reports, ideally with a tool designed specifically for that.
PrabhuKrishnamoorthy - PeerSpot reviewer
Has transformed testing by reducing scripting effort and enhancing productivity with advanced features
The self-healing feature of Tricentis Tosca needs significant improvement. Currently, it is static and not dynamic. For example, if a button in an application changes, Tricentis Tosca should be smart enough to detect the change and still execute the script seamlessly. Improvements are needed to ensure it responds dynamically to changes in the application.
report
Use our free recommendation engine to learn which Test Automation Tools solutions are best for your needs.
851,174 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
20%
Manufacturing Company
14%
Financial Services Firm
13%
Government
7%
Computer Software Company
20%
Manufacturing Company
10%
Financial Services Firm
9%
Insurance Company
6%
Computer Software Company
14%
Financial Services Firm
13%
Manufacturing Company
13%
Retailer
6%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

What do you like most about SmartBear TestComplete?
TestComplete has strong reporting capabilities. The reports they generate are really good.
What is your experience regarding pricing and costs for SmartBear TestComplete?
I am not involved in pricing or licensing; our management team handles these aspects.
What needs improvement with SmartBear TestComplete?
While using SmartBear TestComplete, we are fine with the current capabilities, however, it would be beneficial to imp...
What is your experience regarding pricing and costs for TestRail by Gurock?
Pricing is reasonable for TestRail. It offers good value for money.
What needs improvement with TestRail by Gurock?
TestRail lacks the functionality to map test cases to requirements and risks. While integration with another tool is ...
How does Micro Focus UFT One compare to Tricentis Tosca?
We reviewed MicroFocus UFT One but ultimately chose to use Tricentis Tosca because we needed API testing. MicroFocus...
How does Tricentis Tosca compare with Worksoft Certify?
Tosca fulfills our business needs better because it is an end-to-end solution across technologies. We like that it is...
What do you like most about Tricentis Tosca?
For beginners, the product is good, especially for those who are interested in the quality side of software testing.
 

Also Known As

No data available
TestRail by Gurock
No data available
 

Overview

 

Sample Customers

Cisco, J.P. Morgan, Boeing, McAfee, EMC, Intuit, and Thomson Reuters.
Apple, Microsoft, Boeing, Intel, NASA, Amazon, HP, Samsung
HBO, AMEX, BMW Group, ING, Bosch, Austrian Airlines, Deutsche Bank, Henkel, Allianz, Bank of America, UBS, Orange, Siemens, Swiss Re, Vodafone
Find out what your peers are saying about Tricentis, Katalon Studio, OpenText and others in Test Automation Tools. Updated: April 2025.
851,174 professionals have used our research since 2012.