CucumberStudio Reviews

Scenarios, since is a really easy way to create and control your test cases.

Test runs, since it lets you execute the test cases in a faster way. You can included screenshots or notes, or to mark it as passed, failed, retest, and some others.

Cloning Scenarios, which save you a lot of time when you have to create test cases for a regression or for similar tasks.

I was not part of the company before they started using Hiptest, but they told me they created their test cases in Excel. Now they can create test cases faster, even cloning their own information.

It has some issues that they can fix. If you start creating a data table, and you insert values really fast, then it doesn't save some of them.

I think they should improve the way the memory is handled in areas where the app is really heavy because of JavaScript.

Since January.

Yes, it is not stable when you create a data table that includes more than 30 elements, so it can lose your data.

As mentioned before, it has issues depending on the input size of the data.

The support is fast.

I don’t know it the company used to have a previous solution.

It took a while to understand most of the things. Not too complex, but also not too straightforward. Hiptest has a lot of functionalities to understand.

Not applicable.

Not applicable.

It’s a really good product. It has some flaws, but it is going to make your life easier.

The ability to manage and refactor test scripts using action words, and the ability to create skeleton codes for test automation.

It has allowed us to efficiently manage our test cases, tracking all our test campaigns both manual and automated.

The reporting and metrics can be improved. E.g.: If we wanted to have metrics across all projects.

Test run for an automated test could have historical data to better track our progress and effectiveness.

18 months.

No.

No.

An eight out of 10. They respond quite fast (in few hours) and are very open-minded.

I use manual test case management using a spreadsheet and have reviewed several test case managements.

Most of them are very cumbersome to manage and track, especially on the test script refactoring and test campaign.

It's easy. It's on the cloud. We could import our test scripts and start right away.

First three users are free. It should be enough to get the feel of it before committing to it. Plus per user price is USD$ 8-11 and you can have volume discounts.

TestLink, TestLodge, and few others that i have forgotten the name.

The power of Hiptest is its test cases and campaign management. If you're into test automation, they can help you boot. But to really get a sense of how it is integrated with test automation, you really need to try it with your case.

• The auto-completion while writing test steps. It is very useful to avoid test step duplication.
• The test steps refactoring. This is useful to reduce test maintenance.
• The strong automation abilities.
• the Atlassian JIRA plugin is very efficient to link development tasks to test scenarios and follow your test coverage and results.

Hiptest allowed us to clean up our test campaigns and standardize the way we write test cases and structure our BDD approach.

The reporting aspect can be improved.

I have used it for eight months.

I have not encountered any deployment issues. It is a cloud-based solution and teams have not curbed their use of it.

I have not encountered any stability issues.

I have not encountered any scalability issues.

Customer service is 9/10. The support team is very responsive, with concrete responses.

Technical support is 8/10. Some automation integration topics are tricky, but it is correctly documented and the support team is helpful.

Before choosing this product, we used TestLink. We switched because TestLink maintenance is too expensive, TestLink has no automation abilities and it has a very old-school approach to testing.

The initial setup is straightforward: It is a cloud-based tool and ready to use in one minute.

An in-house team implemented it.

3 months max ROI; we have not computed it because it is really cheap (around $2000 per year). But automation abilities and test maintenance are priceless.

We spent some 10 FTE on integrating Hiptest in our CI and it's $8 per month per user (x25). Let's say it is nothing compared to some other licenses.

Before choosing this product, we evaluated Zephyr, XQual, and TestRail.

I have been working in the testing domain for more than 10 years. It is amazing to be able to be surprised by a such tool.

Hiptest is a great test management tool for agile teams. Very easy to adopt. Integration with JIRA is awesome. We use the Gherkin feature to write BDD scenarios. It is also the only tool we have evaluated that is able to integrate with all the test automation frameworks (Cucumber, Robot Framework, Selenium ...)

We have boosted the team collaboration (developers, product owners and QA) with this real-time platform and Behavior Driven Development process.

Support with In-App chat is great. However, it would be awesome to have real time support also for PT timezone. Integration with LDAP would be also great for future releases.