PeerSpot user
Continuous Delivery Lead at SAI Global
Real User
TOSCA Testsuite Review

What is our primary use case?

Mixed environment having web and desktop applications, integrating with each other and over an API Gateway. API based and Financial Services portal testing created using modern technology using C# and ReactJS.

How has it helped my organization?

- Brought a good environment of test automation

- Allowed a significant increase in Continuous Integration

What is most valuable?

- Great User Interface and ease of checking all your artifacts of Testing.

- Makes optimal use of Model-based Test practice in getting Object-references from the application.

- Script-less, so less maintenance headache for non-technical users also.

- Drag and drop functionality to create and re-use your Test Cases

- Excellent re-use of Excel functionality for formulas and functions.

- Conditions which let the test case branch off from the Template. Helps work out different scenarios for data.

- Has been tried out on SAP, Oracle Apps, and IBM COGNOS BI applications. With a few tweaks works well with these applications.

- IF and LOOP statements introduced with the latest version.

- Improved performance of Web-Based Tests. WHILE LOOP and IF made better and more responsive with added error recovery options.

- Intuitive based options available, along with a rudimentary record and play functionality.

- Next version will even have the visualization tools required to see the interconnections between the TCD and the Test Cases, along with the workflow in the TCD and Tests.

- New and improved visualization for multiple browsers and a totally new Wizard with TBox out of Box support has been added to the (v9.2) of TOSCA Commander.

- Access to Business Intelligence (BI) features of comparing a DB to another one, also have been added as plugins.

- Access to an Analytical Engine to view and get reports from the Test Runs.

- Version 13 has also brought in BI testing and improvements on SAP Test scenarios

What needs improvement?

- Upgrades to the newer version if extra Add-ins are installed sometimes causes weird issues.

- Needs a UI to be open and present when running the tests. Cannot visit the DOM like in Selenium.

- Needs a UI to visualize the test case development.

Buyer's Guide
Tricentis Tosca
March 2024
Learn what your peers think about Tricentis Tosca. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
768,886 professionals have used our research since 2012.

For how long have I used the solution?

I have used it for the past 9 years

What do I think about the stability of the solution?

None seen as such, except it has a reliance on the Network for Licenses. If the network is lost, then the license will expire and crash/close the application.

What do I think about the scalability of the solution?

Depends on the Licensing model you take up.

How are customer service and support?

Customer Service:

Excellent almost 16x5 service with issue resolution within a given 24-hour time frame.

Technical Support:

- Great Customer Support, technical from the first step.

Which solution did I use previously and why did I switch?

Yes, have been using HP QTP and Selenium for Test Automation. Switch was mainly due to Team constraints and management wanting to try a new tool which is easier for the Business Analysts also to collaborate with.

How was the initial setup?

Setup is simple but requires learning of the tool and how it does things before you can optimally use it.

What about the implementation team?

In-house implementation.

What was our ROI?

An exceptionally good ROI, as we reduced the number of Tests from 4000 to around 89 scenario's which can be run in an automated manner with additional data (so in actuality we have around 1.4M tests, which can theoretically be run without human intervention). We have a full-stack CI pipeline for running these along with JIRA (requirement gathering and test results per Story), to the final TeamCity run for each check-in to the Dev branch.

What's my experience with pricing, setup cost, and licensing?

Pricing is steep if you go for the premium model. Advice would be to buy a mix of licenses, depending on the need. The Tricentis Sales are rather good at helping you with this, once you give the intent to buy. They are not just shoving you the highest premium toy/license.

Which other solutions did I evaluate?

Yes, evaluated TestComplete, HP UFT ALM, Selenium / SpecFlow / Cucumber.

What other advice do I have?

Take the online training on Udemy before you confirm the intent to buy it.

Which deployment model are you using for this solution?

Hybrid Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Amazon Web Services (AWS)
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Ann Marie Corker - PeerSpot reviewer
Ann Marie CorkerBusiness Systems Analyst Specialist at a financial services firm with 10,001+ employees
Real User

Hi Gagneet Thanks for sharing your story. Have you implemented any Non Functional Testing test cases?

Tax Fee QA Director at a financial services firm with 51-200 employees
Real User
Leaderboard
Stable and scalable with a very fast setup
Pros and Cons
  • "We like the fact that it works across mobile, desktop, web, and APIs. Due to this, the solution has a broad range of applications."
  • "The solution needs to improve its simulation of mobile environments. Right now, that aspect is really lacking."

What is our primary use case?

We primarily use the solution for testing. The company's businesses are tax-free payments. We're testing the company applications around the aspects of its tax-free payment systems.

What is most valuable?

The most valuable aspect of the solution is the extremely fast setup. You can really get up and running within a very small window of time. It's great.

We like the fact that it works across mobile, desktop, web, and APIs. Due to this, the solution has a broad range of applications.

What needs improvement?

The solution needs to improve its simulation of mobile environments. Right now, that aspect is really lacking.

The solution should work to try to lessen the cost of the solution. Right now, using it is costly for companies such as ours.

We'd like to see improvement in shared repositories. The problem with the shared repository is this: as it gets bigger, as we create more test cases, and due to this, we are experiencing issues.

For how long have I used the solution?

I've been dealing with the solution for just over a year.

What do I think about the stability of the solution?

The stability of the solution is excellent. It's very reliable. We don't seem to have issues with bugs and glitches. It doesn't crash or freeze. It's quite good.

What do I think about the scalability of the solution?

The scalability of the solution is very good. We can expand it if we need to The solution doesn't give us any problems in that sense.

How are customer service and technical support?

The technical support of the solution is very good. We've very satisfied with the level of service provided to us.

How was the initial setup?

The initial setup was straightforward. It was not complex at all. It took us less than a month to have something up and running. It was very easy, and one of the solution's big selling points for our organization.

What's my experience with pricing, setup cost, and licensing?

We're simply customers of Tosca. We don't have any professional relationship with the company.

The pricing of the solution is quite expensive. It's definitely not one of the cheapest options. It's very pricey.

On top of the already expensive pricing, there are add-ons that help with the basic test suite, and you have to pay more for those.

What other advice do I have?

I'd rate the solution eight out of ten.

I'd recommend people do a proof of concept (POC) around Tosca and compare it to other available tools. That way, an organization will know if the solution is right for them without investing too much time into everything.

Which deployment model are you using for this solution?

Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Tricentis Tosca
March 2024
Learn what your peers think about Tricentis Tosca. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
768,886 professionals have used our research since 2012.
it_user704700 - PeerSpot reviewer
Test Manager with 10,001+ employees
Real User
Have more time to increase the regression portfolio, decrease long delays with documentation
Pros and Cons
  • "Image recognition: It has allowed us to automate a GUI section of our product which involves drawing different topologies."
  • "Running the regression – if multiple lists are executed at once or if a list contains 200+ tests, it’s a pain to stop the execution."

What is most valuable?

Image recognition: It has allowed us to automate a GUI section of our product which involves drawing different topologies.

I’m aware that other tools have this feature, but the whole test suite, it makes it good enough for us not to look for something else.

How has it helped my organization?

No, not in global organization; we are the only ones who are using it in our location (Austria), but in our team, it changed the testing workflow:

Every second week we release a candidate, and from two weeks of hard manual testing, we are testing now only a few days (four to five), the new fixed tickets and running in parallel - the regression. We have more time to increase the regression portfolio and also decrease long delays with documentation.

What needs improvement?

Running the regression – if multiple lists are executed at once or if a list contains 200+ tests, it’s a pain to stop the execution.

For how long have I used the solution?

I have been using it for almost four years.

What do I think about the stability of the solution?

A few times, it just crashed. I didn’t encounter this issue with Tosca 8 and Tosca 9, but the PC was running for days so I cannot blame only Tosca. I assume Windows played its role, too.

What do I think about the scalability of the solution?

No, not so far. We have around 3500+ TCS.

How are customer service and technical support?

Nice and friendly, however not always coming up with the solution we were expecting. For example, after changing from Tosca 9 to Tosca 10, we were not able to run some test cases for an older tool (it was developed with Java 1.5). The solution from their side was to request a change request even if it worked in the past. In the end, we just downgraded and we are running those test cases with Tosca 9.

Which solution did I use previously and why did I switch?

No.

How was the initial setup?

Of the tool, yes. Managing to trigger our application was not so straightforward (because of our company access policy). We had to write some batch scripts for it, then it worked fine.

What's my experience with pricing, setup cost, and licensing?

Expensive, but for long-term projects, it is paying back.

Which other solutions did I evaluate?

Yes, there was an analysis, but I was not part of the company at that time.

What other advice do I have?

It is a good tool, but could be better in some aspects.

It’s relatively easy to set it up and intuitive to create test cases for non-developers. If you come from the development side you will feel some limitations, but I was always able to find a workaround.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Quality Manager at a tech consulting company
Consultant
It can be handled without any knowledge in parameterisation, especially the TestCaseDesign functionality.
Pros and Cons
  • "The tool can be handled without any knowledge in parameterisation, especially the TestCaseDesign which makes the tool mighty and stable."
  • "The Test Management options are still weak - improvement is outlined, but not yet visible. I"

What is most valuable?

The tool can be handled without any knowledge in parameterisation, especially the TestCaseDesign which makes the tool mighty and stable - even when releases in the tested software are subjected to deep code changes. The maintenance of the test tool is manageble.

How has it helped my organization?

I managed a test set over all areas for a retail bank alone for about three years with almost 1,000 test cases. I automated the starts overnight, and paralleled them on virtual clients. Then, I needed 24 hours for generating synthetic test data, regression test runs, and analyses. The runs were stable, and I could report many defects before the start of the manual tests.

What needs improvement?

The Testmanagement option are still weak - improvement is outlined, but not yet visible. I expect first impressions of this solution at accelerate in Vienna, october 2017.

For how long have I used the solution?

Actually I upgrade the testsuite as often as possible - in my function as consultant I want to feel and test the improvements as soon as they are released. 10.3 was not stable enough for my expectations.

What was my experience with deployment of the solution?

Not yet.

What do I think about the stability of the solution?

With testuite 10.3 - so I derelease back to 10.2.

What do I think about the scalability of the solution?

Not yet - as the environments were always well set up.

How is customer service and technical support?

Customer Service:

This is a point were Tricentis has to improve - customer support seems to be overflood in the last few months.

Technical Support:

Basically it's very high, the support is fast, friendly and qualified - if reachable. Which was not always the case in the last three months.

How was the initial setup?

The initial setup should be done highly structured, and by qualified specialists. This is the only efficient way of a stable test set.

What about the implementation team?

I would definitely recommend a vendor team for the implementation!

What was our ROI?

We felt the benefits within the first year. I would recommend in-house management.

Which other solutions did I evaluate?

There was no need for us to do so.

What other advice do I have?

It is a mighty and stable tool, but it needs qualified and motivated staff to work with and manage it.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
gagneet - PeerSpot reviewer
gagneetContinuous Delivery Lead at SAI Global
Real User

The defect management not being in the tool is by choice. You can attach and link it to JIRA cards, which are related to "Test Cases" in TOSCA. This I believe is a better way to do it than to impose a different workflow and DTS on users.

PeerSpot user
IT Business Consultant at a retailer with 1,001-5,000 employees
Vendor
It's nice that it uses a risk-based approached via a weighted requirement set, although the context menu in the newer versions is not ideal.

What is most valuable?

The features we've found most valuable are--

  • It’s a modular structure, so changes in a module are automatically updated in all relevant test cases.
  • It uses a risk-based approached via a weighted requirement set.

What needs improvement?

  • Not all functions are logical without certain know-how.
  • Context menu in the newer versions is not ideal.

For how long have I used the solution?

I've used it for about one year.

What do I think about the stability of the solution?

During an upgrade there were issues, but this was due to certain security settings on our end, and the Tosca support team was very useful in helping us with those setting and resolving the issues.

What do I think about the scalability of the solution?

We're discussing internally with fully integrate this tool within our business.

How are customer service and technical support?

Customer Service:

10/10. The customer service is top-notch.

Technical Support:

10/10. The technical support is top-notch.

Which solution did I use previously and why did I switch?

In our department there was not a different solution in place.

How was the initial setup?

The initial setup was relatively straightforward with support from our network department for the setting up of a common repository.

What about the implementation team?

We implemented it via our in-house team in combination with Tricentis consultants.

Which other solutions did I evaluate?

We also looked at Worksoft.

What other advice do I have?

Try it out and do a Proof of Concept.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
gagneet - PeerSpot reviewer
gagneetContinuous Delivery Lead at SAI Global
Real User

I think the main think that needs to be understood with these model based tools, is that during the initial setup period the Business involvement is a must to ensure that all the paths are explored and a proper workflow of tests is setup for use. Without that involvement, it makes the job for the users and maintainers of the tests a cumbersome one.

PeerSpot user
Test Manager with 501-1,000 employees
Vendor
We're able to create reusable data classes when using our test cases, and non-technical testers can automate tests with access to information.

What is most valuable?

We like the idea of reusable data classes when we are using our test cases. We work with a lot of data, and so being able to create reusable data classes is very helpful to us.

How has it helped my organization?

The primary driver for us is that it puts automation into the hands of non-technical testers. Previous programs, if you’re not a programmer, you can forget about it, but with TOSCA it’s easier to get information and start automating your own tests.

What needs improvement?

So far, all our issues have had to do with our unfamiliarity with the product.

For how long have I used the solution?

We are in a preparation phase – we haven’t seen everything yet. We purchased it about six or seven months ago, and started actively creating tests in the last six weeks.

What was my experience with deployment of the solution?

No issues encountered.

What do I think about the stability of the solution?

No issues encountered.

What do I think about the scalability of the solution?

No issues encountered.

How are customer service and technical support?

Customer Service:

It's excellent, 9/10.

Technical Support:

It’s excellent, 9/10, as the response times have been quick and there haven’t been any problems.

Which solution did I use previously and why did I switch?

Initial setup was straightforward. It took a little bit of juggling to get a central database set up as defaults to working in isolation, but other than that it was OK.

How was the initial setup?

We did it in-house.

Which other solutions did I evaluate?

TOSCA was recommended, so we didn’t look into anything else. Our software provider said it could support their solution so we went for it. We had looked into HP UFT and Smartbear. We had used HP UFT but are fading away from them.

What other advice do I have?

Be prepared to change how you approach test automation – definitely a mindset shift. It's highly configurable so you want to make good use of that. Don’t be afraid to ask for help from Tricentis, they will get back to you. Have a good bank balance because it’s not cheap.

Disclosure: PeerSpot contacted the reviewer to collect the review and to validate authenticity. The reviewer was referred by the vendor, but the review is not subject to editing or approval by the vendor.
PeerSpot user
it_user3396 - PeerSpot reviewer
it_user3396Team Lead at Tata Consultancy Services
Top 5Real User

Cool review

Consultant im Testingbereich at qcentris
Consultant
Handy way to automate on a surface but modules should be made more dynamic

What is our primary use case?

Primarily test automation for webshops based on PHP code. It was satisfying as long as the GUI did not change permanently.

How has it helped my organization?

It did not improve because the GUI was not static, so it was not possible to write tests for a GUI that was in progress.

What is most valuable?

The XScan was great because it was a handy way to automate on a surface which made it very easy and simple.

What needs improvement?

It should be more flexible when using the modules; it is kind of frozen there. They should be made more dynamic.

For how long have I used the solution?

One to three years.
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
PeerSpot user
Associate Project Manager at a tech services company with 10,001+ employees
Consultant
It uses model-based automation and does not require scripting knowledge.

What is most valuable?

There are a lot of features that I love within Tosca. To name a few:

  • Model-based automation
  • Scripting knowledge is not required
  • Requirement traceability
  • Usage of built-in aid packs

How has it helped my organization?

Before implementing Tosca, the average time that we took for completing regression was about four days. After we started using Tosca, it has been reduced to six hours.

What needs improvement?

I personally feel like the pricing is a little bit on the high end.

For how long have I used the solution?

I have been using Tosca for almost four years.

What was my experience with deployment of the solution?

As of now, I have not encountered any deployment issues.

What do I think about the stability of the solution?

I have not encountered any stability issues.

What do I think about the scalability of the solution?

I have not encountered any scalability issues.

How are customer service and technical support?

Customer Service:

Tosca customer service is one of the best in its class.

Technical Support:

The people involved in technical support really know what they are doing. This significantly reduces the amount of time it takes the end user to find solutions.

Which solution did I use previously and why did I switch?

I was using a different solution, but it required scripting knowledge, which most of my team members did not have.

What about the implementation team?

An in-house team implemented it.

What's my experience with pricing, setup cost, and licensing?

Pricing is a bit on the higher end.

Which other solutions did I evaluate?

Before choosing, we evaluated QTP, Selenium, and so on.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Download our free Tricentis Tosca Report and get advice and tips from experienced pros sharing their opinions.
Updated: March 2024
Buyer's Guide
Download our free Tricentis Tosca Report and get advice and tips from experienced pros sharing their opinions.