We performed a comparison between TestRail and Visual Studio Test Professional based on real PeerSpot user reviews.
Find out in this report how the two Test Management Tools solutions compare in terms of features, pricing, service and support, easy of deployment, and ROI."The features that I have found most valuable are that there are various test case templates and test artifact maintenance."
"Integration with Confluence and JIRA."
"You don't need to follow complex procedures to create a test run, test case, etc."
"The solution is very stable. We've never had any issues with it."
"I was on the lookout for automation testing on the browser and I believe this tool is very interesting in that matter. The solution is useful for UI testing. You just need to add the URL that is to be checked."
"This is a user friendly solution."
"The integration with Jira and the ability for extra configurations are the most valuable features."
"Reliable and stable. It is important that TestRail be up and running 24/7 as we have users around the world using it."
"The solution is very stable; there's nothing in relation to stability to complain about."
"The setup is easy and straightforward."
"Visual Studio Test Pro is super helpful for my Microsoft app work."
"I was satisfied with the support given by customer service."
"The most valuable features of the solution are its ease of use and availability."
"The user interface is very friendly."
"One of the best documentation in the world."
"The product is good to create big or small projects fastly. It is one of the leaders in the area."
"TestRail should improve its pricing."
"It's not easy to create a custom report. It's not straightforward. A good improvement would be if there was a way to report and create a custom report without using a plugin or scripting language."
"TestRail's user interface is not great. When you use it for the first time, you will be very uncomfortable and not know how to create test cases. It doesn't have a field for preconditions and post-conditions."
"The product is not focused on synthetic data creation. I would also like to see more integrations with other platforms."
"Their customer support could be improved. Sometimes we struggle with that. It could be faster. Whenever we raise any query, they get back to you but the turnaround time is very slow."
"I have faced some issues with the integration between TestRail and Jira, which haven't been permanently resolved yet."
"It would be useful if it had its own issue management system. At the moment, it's purely a test management tool and you have to link to a defect management tool, like JIRA. It would be useful if there was an option to use its own defect management tool so that it's integrated and not two separate tools."
"With TestRail, the APIs are there, but they may not be able to easily integrate with the Jenkins."
"The product must provide more automation."
"Sometimes Visual Studio is slow. It uses a lot of resources like memory and processing power. You should optimize the performance by only installing what you need on your machine. Don't install unnecessary things that will slow your machine."
"The data flow can be improved."
"I would like to see more integration in the solution."
"It is not good in terms of performance. When you open Visual Studio, you have to wait for a while to process your code. It uses a lot of resources and has a lot of features. If we could disable some of the features, it would be lighter and faster to use. Nowadays, for some of the projects, we use VS Code for JavaScript or Python. VS Code is very light and easy to use, whereas, in Visual Studio, we have to wait because it takes time to compile or run a project. It has a lot of competitors in terms of performance, such as Intelligent ID. Intelligent ID is very easy to use. It has many features, and it is lighter to use than Visual Studio. In terms of error handling, sometimes, it shows an error before you finish your code, which can be improved. It would be good if it has a version for Linux. I use VS Code on Linux, but I am not sure if Visual Studio has a version for Linux."
"The vendor must release a lightweight version of the solution."
"The product must provide more integration."
"The database administration could be better; you should be able to choose new tools with the development environment in Visual Studio. It could be easier to use."
More Visual Studio Test Professional Pricing and Cost Advice →
TestRail is ranked 3rd in Test Management Tools with 21 reviews while Visual Studio Test Professional is ranked 5th in Test Management Tools with 46 reviews. TestRail is rated 8.0, while Visual Studio Test Professional is rated 8.6. The top reviewer of TestRail writes "A tool that provides effective test management and real-time reporting capabilities". On the other hand, the top reviewer of Visual Studio Test Professional writes "Customization is a key feature as is the ability to integrate with third-party services ". TestRail is most compared with Zephyr Enterprise, Tricentis qTest, TFS, Tricentis Tosca and IBM Rational Quality Manager, whereas Visual Studio Test Professional is most compared with TFS, Apache JMeter, Tricentis NeoLoad, SmartBear TestComplete and Tricentis Tosca. See our TestRail vs. Visual Studio Test Professional report.
See our list of best Test Management Tools vendors.
We monitor all Test Management Tools reviews to prevent fraudulent reviews and keep review quality high. We do not post reviews by company employees or direct competitors. We validate each review for authenticity via cross-reference with LinkedIn, and personal follow-up with the reviewer when necessary.
