Katalon Test Ops vs TestRail comparison

"Katalon Test Ops has AI features that speed up the process by automating tasks that would otherwise be done manually."

"It's more user-friendly as a solution."

"I noticed that only the enterprise version has integration with GitHub."

"The product’s most valuable feature is the UI. The structure of test cases is easy to understand."

"You don't need to follow complex procedures to create a test run, test case, etc."

"The most valuable features are the reporting in the dashboard and the general way in which we can create test runs is helpful."

"Most valuable features are the ease of organizing test cases and a great API for sending results from automated test run results into the database."

"From a testing perspective, the management is awesome. I am able to do testing and then add the reporting and the evidence. It is fair in terms of the price that you're paying. You get what you're paying for."

"I have integrated TestRail, Leapwork, and Jira together using PowerShell scripting, so when we have 100 test cases and before every release goes out to our customers, we kick off the regression run in Leapwork, and at runtime, when the test case passes, it reflects the results on TestRail, and if it fails, it automatically creates a Jira story and sends that story to our backlog for further investigation."

"I use the solution for test management."

"The most valuable features of TestRail by Gurock are the user experience, it's very easy to learn. There is no learning curve needed to work on projects and manage the test cases, it is easy. Exporting and importing are simple."

"The free version is limited."

"There are stability troubles. My area does not have a good connection. That's why sometimes I face issues."

"The execution module of Katalon Test Ops may need some improvement, especially when running a high volume of test scripts."

"TestRail should improve its pricing."

"There are a number of improvements that have been requested. While I don't have a list of these requests available, many can be found on Gurock's forum."

"The test suite management has room for improvement as well as better reporting."

"It's not easy to create a custom report. It's not straightforward. A good improvement would be if there was a way to report and create a custom report without using a plugin or scripting language."

"I do see room for lots of improvement in it. In terms of usability, duplication with test cases and constant creation of projects isn't easy. There is also too much API integration into automation tools, which is not there in ALM with UFT. Instead of setting it up as a project and using it, we set it up as a system for usability. It also lacks in the traceability aspect. For traceability, you need to use the JIRA plugin and drag traceability on JIRA, but the functionality is still quite limited. The biggest gap is mainframe testing. It would be good if I could start with mainframe testing. Manual granting of access is another issue. There is no API that I could use with another system where it is automated. There is an API for loading somebody to a project but not for adding to the application."

"It would be useful if it had its own issue management system. At the moment, it's purely a test management tool and you have to link to a defect management tool, like JIRA. It would be useful if there was an option to use its own defect management tool so that it's integrated and not two separate tools."

"Reporting could be more flexible regarding repeating reports."

"It would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be."

"The solution is quite reasonably priced for what it offers and offers a monthly subscription model."

"Pricing for small teams seems correct with respect to competitors."

"Use TestRail Cloud (online TR hosted server) and don't worry about maintenance or scalability. It saves a lot of cash and time."

"The product has a reasonable price in terms of the features."

"Its price is definitely not more. If they introduce automation, they can charge more."

"The price of the solution is based on how many users you have per year. When you grow, it is segmented, For example, 10 to 25, you have a price, and more than 50, or 100, you need to take the enterprise license. I don't think we will reach this point."

"My advice to others is to shop around for the best deal. Some options out there are free in cyberspace."

"The product is not much expensive."