We performed a comparison between SmartBear TestComplete and TestRail based on real PeerSpot user reviews.
Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."TestComplete is simple, it's a very easy-to-use tool."
"Test items, project variables helps in managing automation suite and scheduling execution."
"TestComplete fits almost perfectly with a large amount of stacks, such as Delphi, C#, Java and web applications."
"The initial setup is pretty easy and it's quick to deploy."
"Recording and playback of tests were easier with SmartBear TestComplete...It is a scalable solution."
"In TestComplete, I saw a conformed package of a tool that kept everybody in consistency. The team was able to regenerate further tests without having to manipulate more code because the record feature is great."
"The reporting is ready to use and doesn't require any setup."
"It is very easy to maintain tests with this tool. It covers all necessary items in the test plan. The most painful item in testing is maintenance. When changes occur, the tests should be maintained."
"The integration with Jira and the ability for extra configurations are the most valuable features."
"The features that I have found most valuable are that there are various test case templates and test artifact maintenance."
"Integration with Confluence and JIRA."
"The solution is very stable. We've never had any issues with it."
"From a testing perspective, the management is awesome. I am able to do testing and then add the reporting and the evidence. It is fair in terms of the price that you're paying. You get what you're paying for."
"The API to support integration of the homemade automated testing tool."
"The product helps us create test cases and reports."
"You don't need to follow complex procedures to create a test run, test case, etc."
"The pricing is the constraint."
"We were testing handheld barcode scanners running WindowsCE with many menus of warehouse functions, and our biggest problem was the timing between input and responses."
"I didn't use it very heavily. One issue that I found was that there wasn't a quick way or a button to move Visual Basic scripts to TestComplete. We have a lot of such scripts in our organization, and it would be very useful to have some option to easily move these scripts. It is currently possible to convert these scripts to TestComplete, but it is not easy. I have to write some code, but everything is not available immediately."
"Product is not stable enough and it crashes often."
"TestComplete gives support to do requests to a SOAP web service but has no support to do HTTP requests on Restful services."
"In SmartBear TestComplete the integration with Jenkins could be easier. Additionally, some of the controls could have better customization options. For example, if a grid is used and it contains multiple controls within it, it can be a checkbox, radio button, or any kind of control, the way the Object Spy is operating currently there is a lot of room for improvement."
"What is currently missing from this solution is better support for mobile testing."
"The solution needs to extend the possibilities so that we can test on other operating systems, platforms and publications for Android as well as iOS."
"The product is not focused on synthetic data creation. I would also like to see more integrations with other platforms."
"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."
"I've encountered at some point, some difficulties on the administration side, but I don't remember exactly what they were."
"The platform needs improvement regarding performance and creating links."
"There are a number of improvements that have been requested. While I don't have a list of these requests available, many can be found on Gurock's forum."
"The TestRail API to integrate reporting of automated tests is complete, but requires many requests to identify the appropriate entry."
"TestRail's user interface is not great. When you use it for the first time, you will be very uncomfortable and not know how to create test cases. It doesn't have a field for preconditions and post-conditions."
"I have faced some issues with the integration between TestRail and Jira, which haven't been permanently resolved yet."
SmartBear TestComplete is ranked 8th in Test Automation Tools with 70 reviews while TestRail is ranked 3rd in Test Management Tools with 21 reviews. SmartBear TestComplete is rated 7.6, while TestRail is rated 8.0. The top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". On the other hand, the top reviewer of TestRail writes "A tool that provides effective test management and real-time reporting capabilities". SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish, whereas TestRail is most compared with Zephyr Enterprise, Tricentis qTest, TFS, Tricentis Tosca and Visual Studio Test Professional. See our SmartBear TestComplete vs. TestRail report.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.