We performed a comparison between SmartBear TestComplete and TestRail based on real PeerSpot user reviews.
Find out in this report how the two Test Automation Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."Complete works perfectly with CUTE. That includes all dialogues, right-click menus, or system dialogues, etc., which are handled well."
"When compared to other tools, it is very simple."
"The most valuable features are the desktop and mobile modules."
"You can record your actions and play them back later."
"The product is stable for what we are currently using it for, and it is sufficient for us."
"The reporting is ready to use and doesn't require any setup."
"The solution is great as a record and playback tool. It also has valuable regression testing."
"It is a strong automation tool for desktop, browser, and API testing."
"The most valuable features are the flexibility, ease of use for writing new test cases, the test plans, and the composition."
"Integration with Confluence and JIRA."
"The features that I have found most valuable are that there are various test case templates and test artifact maintenance."
"I use the product to create test cases and share them with my team and manager."
"I haven't faced any stability issues using the solution. Stability-wise, I rate the solution a ten out of ten."
"The most valuable features are the reporting in the dashboard and the general way in which we can create test runs is helpful."
"Most valuable features are the ease of organizing test cases and a great API for sending results from automated test run results into the database."
"From a testing perspective, the management is awesome. I am able to do testing and then add the reporting and the evidence. It is fair in terms of the price that you're paying. You get what you're paying for."
"During the distribution of our regression test cases, the control IDs are not always recognized correctly."
"What is currently missing from this solution is better support for mobile testing."
"There could be API interfaces with this tool."
"SmartBear products generally have a weak link when it comes to integration with other test management tools like Inflectra."
"Right now, when you buy the solution, you need to pay for one solution. You receive one set up and you install it and it's just in that one machine. It would be ideal if they could offer one subscription where you can connect to different machines with a group subscription."
"The code editor, though following eclipse-style, is still a work in progress and gives a very poorly formatted code once viewed via other editing tools."
"One notable drawback is the absence of native integration with Git."
"It is very hard to read the test log generated by TestComplete Executor if the log file is very big. TestComplete Executor is a small tool for just running the TestComplete test framework (not for developing)."
"It's not easy to create a custom report. It's not straightforward. A good improvement would be if there was a way to report and create a custom report without using a plugin or scripting language."
"Better prediction of text."
"The product is not focused on synthetic data creation. I would also like to see more integrations with other platforms."
"TestRail should improve its pricing."
"With TestRail, the APIs are there, but they may not be able to easily integrate with the Jenkins."
"Their customer support could be improved. Sometimes we struggle with that. It could be faster. Whenever we raise any query, they get back to you but the turnaround time is very slow."
"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."
"TestRail by Gurock could improve by adding a defect management module tool. It would add a lot of value if I want to install it and I don't have Jira or an isolating team. For example, if I am providing a service it's separated from the development team, it then would be better to have defect management included with the test management. However, as it is now I need to be integrated with Jira or another defect management tool to complete the testing process."
SmartBear TestComplete is ranked 8th in Test Automation Tools with 70 reviews while TestRail is ranked 3rd in Test Management Tools with 21 reviews. SmartBear TestComplete is rated 7.6, while TestRail is rated 8.0. The top reviewer of SmartBear TestComplete writes "A stable product that needs to improve its integration capabilities with other test management tools". On the other hand, the top reviewer of TestRail writes "A tool that provides effective test management and real-time reporting capabilities". SmartBear TestComplete is most compared with Tricentis Tosca, Katalon Studio, Ranorex Studio, OpenText UFT One and froglogic Squish, whereas TestRail is most compared with Zephyr Enterprise, Tricentis qTest, TFS, Tricentis Tosca and Visual Studio Test Professional. See our SmartBear TestComplete vs. TestRail report.
We monitor all Test Automation Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
