TestRail Reviews

The database structure and exploration tool. The API to support integration of the homemade automated testing tool.

This product completes our production line based on continuous integration (using Jenkins) by acquiring all tests results, manual and fully automated into a single platform, which is connected with our bug reporting system (Trac). It offers a full view of test campaigns for each product/version we develop.

The TestRail API to integrate reporting of automated tests is complete, but requires many requests to identify the appropriate entry.

The main room for improvement is in the reporting: It provides templates which are not well adapted and introduces new ones that are rather complex.

Four months.

No issues so far.

With a few users only, but already thousands of items in the DB, we have no issues so far.

Quite good and fast for my interactions with them.

No.

I did not manage it myself, but it seemed straightforward (using the officially supported Linux version).

Pricing for small teams seems correct with respect to competitors.

JIRA/Enterprise Tester: Felt less user-friendly and more complex to start with. Also, it was less adapted for coupling with a homemade automation testing tool.

TestRail is a very user-friendly product to manage test cases. It integrates easily to automation systems and most common bug tracking systems.

It is not the Holy Grail, but has many interesting, useful features.

1. Ability to import test scenarios (CSV).
2. Redmine integration and ability to link Redmine issues to test cases.
3. Network deployment. Need accessibility world wide.
4. Report generation capability.
5. LDAP authentication.
6. Ability to control and restrict user IDs.
7. File attached upload capability.
8. Ability to note when the Blocking issue has been placed in Verify state (or Closed) and flag the Execution records for re-test.
9. Ability to note when the failing issue has been closed and move the execution record to some re-test phase.
10. Reliable and stable. It is important that TestRail be up and running 24/7 as we have users around the world using it.
11. Easy to upgrade and maintain.
12. Customer support.

TestRail has made it possible for our large team around the globe to more easily create, manage, and monitor test execution. It has also provided valuable report information used for project management.

There are a number of improvements that have been requested. While I don't have a list of these requests available, many can be found on Gurock's forum.

Four years.

No.

No.

Very good.

Previously we used a customized spreadsheet tool.

Setup was pretty straightforward. Creating our own customized reports was more complex. It required writing PHP code and they are time consuming to maintain.

Negotiate the best deal you can.

TestLodge, Klaros-TestManagement, PractiTest, Test Collab.

I would recommend researching all available products and evaluate the top three that meet your needs. There may be better products out there today. Carefully choose the tool that best meets your requirements. It is a huge investment in time and effort and very difficult to change tools once a decision has been made.

The feature that is of most value is the ease of use. You don't need to follow complex procedures to create a test run, test case, etc.

Before we used TestRail there were no, or only a very small number of, test cases written. Now, because it is easy to use, there are many more test cases written.

It would be nice if they would add an export to Word.

We have been using this product for about one year.

We never had any issues with stability.

We never had any issues with scalability.

I’m rating technical support a nine out of 10.

We used TestLink. The reason we changed was that it was rather complex to use and there was no way to indicate at what step the case failed.

The initial setup was straightforward.

I can’t answer this question because I’m not the one handling the financials.

I can’t answer this question because the choice was made before I came to this firm.

The advice I would give is just do it.

The ability to time test runs gives the tester the ability to compare calculated times to actual times it takes for a test case to run. This is the advantage over the other test management tool that we have used. Also, I liked the fact that TestRail's test cases could be linked to JIRA tickets.

Most significantly, I found it was easy to organize test cases, and that the application did not time out while I was in the middle of writing a test case.

I found it difficult to link requirements to test cases, if I remember correctly. Also, it would be nice to have a description section when creating the test scenario itself so I can indicate what the configuration should be. I was able to do this with the old tool, and I also could link requirements to test scenarios and test cases in the old tool.

I have probably used it for three months.

No.

No.

I was not the point person.

Well, I really didn't want to switch, but the rest of the team did not want to go through the exercise of learning how to configure the application for our needs.

Also, the old application was unreliable. For example, I would be in the middle of writing a test case, and before I had a chance to save the test case, I would find myself back on the previous page where test scenarios are stored. When I went back into the test scenario to continue working on the test case, all the information that I had previously entered would be lost. Thus, I would have to start all over again.

I wasn't involved in the setup. I QA'd the app, and indicated to the administrator what I desired.

I hear that the cost is a bit pricey. My advice to others is to shop around for the best deal. Some options out there are free in cyberspace.

No.

Use the product to its fullest during the trial period, and if you need an extension on your trial time, most honest companies will oblige you with an extension.

Most valuable features are the ease of organizing test cases and a great API for sending results from automated test run results into the database.

We don't have to take care of test case results in time. They are automatically added into TestRail (TR) on a per case basis, so you have the test results history.

Only a few small ones. Reporting could be more flexible regarding repeating reports. You have to basically repeat the same report run, but then you have two reports. An old one and a new one. A 'refresh' option for reports would be very useful. This way you would have a report but just need to refresh its data when needed. Also, more flexibility in adding custom fields and their placing around the test case form would be beneficial. For example, sometimes I can't place a custom text (paragraph) field in the exact spot that I was planning. Again, nothing critical, just a few small improvements.

For about nine months now.

No issues with stability in the last nine months that I've been working with TR.

No issues with scalability so far.

I haven't used their tech support directly because all I needed was info that I was able to find in their knowledge database.

I used Zephyr, but didn't make the switch. My new company was already using TR when I joined it.

Not applicable. It was already set up when I joined.

Use TestRail Cloud (online TR hosted server) and don't worry about maintenance or scalability. It saves a lot of cash and time.

Yeah, Zephyr, Redmine, etc.

It is great for manual testing. However, it is awesome for automated testing and integrations with most used testing frameworks.

I use TestRail for creating test plans, test cases, and generating reports.

The product’s most valuable feature is the UI. The structure of test cases is easy to understand.

The platform needs improvement regarding performance and creating links.

I have been using TestRail for three years.

I rate the product’s stability a seven out of ten.

We have 30 TestRail users in our organization. I rate its scalability a seven out of ten.

I rate the initial setup process a nine out of ten. It takes 20 minutes to complete.

The product has a reasonable price in terms of the features.

I recommend TestRail as it is the top test management tool. I rate it a nine out of ten.