We performed a comparison between TestRail and TFS based on real PeerSpot user reviews.
Find out in this report how the two Test Management Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The API to support integration of the homemade automated testing tool."
"Integration with Confluence and JIRA."
"The most valuable features are the reporting in the dashboard and the general way in which we can create test runs is helpful."
"The most valuable features of TestRail by Gurock are the user experience, it's very easy to learn. There is no learning curve needed to work on projects and manage the test cases, it is easy. Exporting and importing are simple."
"I haven't faced any stability issues using the solution. Stability-wise, I rate the solution a ten out of ten."
"I use the product to create test cases and share them with my team and manager."
"I use the solution for test management."
"You don't need to follow complex procedures to create a test run, test case, etc."
"The most valuable features of TFS are the test plans. We can reproduce reusable test plans in test automation. We have a lot of queries and this feature is very useful."
"It's an integrated system that includes all the information that we need to deliver our products smoothly and to track the progress of each piece of code."
"This solution enables us to link all items usefully, in the way we use Agile."
"The most valuable feature from my point of view is project management, which includes user stories as well as task management."
"Some of the valuable features are version control and the ability to create different collections in terms of segregating the authorization for teams who connect to small projects."
"The API for managing TFS programmatically is very powerful, you can listen on work items changes by TFS events."
"I like the build management features and the integration with Jenkins and many other tools."
"We use TFS for forecast management."
"This solution has room for improvement. For example, some particular projects need to adjust access or add additional members and this isn't always possible. Role-based access would improve this."
"TestRail's user interface is not great. When you use it for the first time, you will be very uncomfortable and not know how to create test cases. It doesn't have a field for preconditions and post-conditions."
"The platform needs improvement regarding performance and creating links."
"There are a number of improvements that have been requested. While I don't have a list of these requests available, many can be found on Gurock's forum."
"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."
"It would be useful if it had its own issue management system. At the moment, it's purely a test management tool and you have to link to a defect management tool, like JIRA. It would be useful if there was an option to use its own defect management tool so that it's integrated and not two separate tools."
"The product is not focused on synthetic data creation. I would also like to see more integrations with other platforms."
"I have faced some issues with the integration between TestRail and Jira, which haven't been permanently resolved yet."
"I would also like a true command prompt like Git."
"The usability of TFS is not that great."
"TFS and MTM have their own style of working and they are different from other tools like Jira or TestRail, which are simpler and easy to use."
"The manageability and performance of the product are areas of concern where improvements are required."
"Currently, we are looking for a solution with which we can incorporate third-party development sites or third-party project teams into the system. Because it is on-premise, it is a bit problematic because we need to have a VPN or something else in the system. A cloud-based solution would be better for us, and that's what we are looking for. Our biggest problem is the external connection, which, of course, is limited by our own IT. It would be good to have some kind of publishing service for this external connection. It might be there, and it might be that our IT is making it impossible for us. Its template editor could be easier to use. Currently, customizing the project templates according to your needs requires some work."
"The solution's server for deployment needs to be improved."
"Overall, I think it would be useful to have something similar where Microsoft comes up with supporting concepts of scaling Agile in TFS so that clients don't have to look for a separate tool."
"The project management side should be addressed and the project and release planning should be somewhat extended."
TestRail is ranked 3rd in Test Management Tools with 21 reviews while TFS is ranked 2nd in Test Management Tools with 93 reviews. TestRail is rated 8.0, while TFS is rated 8.0. The top reviewer of TestRail writes "A tool that provides effective test management and real-time reporting capabilities". On the other hand, the top reviewer of TFS writes "It is helpful for scheduled releases and enforcing rules, but it should be better at merging changes for multiple developers and retaining the historical information". TestRail is most compared with Zephyr Enterprise, Tricentis qTest, Tricentis Tosca, Sealights and PractiTest, whereas TFS is most compared with Microsoft Azure DevOps, Jira, Rally Software, Visual Studio Test Professional and Zephyr Enterprise. See our TFS vs. TestRail report.
See our list of best Test Management Tools vendors.
We monitor all Test Management Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
