PeerSpot user
Senior Technical Automation Specialist at Sixsentix
Real User
Tosca CI: allows us to test when the code is deployed into the lower environment.

What is most valuable?

Tosca Continuous Integration (Tosca CI) - today's fast pace agile environment needs fast feedback. Working along with the development team and being able to test as soon as the code is available; gives the organisation an edge!

Tosca Continuous Integration allows you to exactly achieve that.

How has it helped my organization?

We have implemented Tosca CI, it allows us to test as soon as the code is deployed into the lower environment. Automated sanity, smoke tests have been configured to run every time there is a code deployment. The sanity/smoke tests are triggered automatically from a build server. After the test finishes, a Junit result file is generated and fed back to the build server.

This saves us significant amount of time by avoiding additional co-ordination/follow-ups required for sanity/smoke test. 

What needs improvement?

The Junit result file gets overwritten each time the build is triggered from Jenkins or Bamboo. It would be nice to have the result XML files stored.

What was my experience with deployment of the solution?

Only minor issues.

Buyer's Guide
Tricentis Tosca
March 2024
Learn what your peers think about Tricentis Tosca. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
768,857 professionals have used our research since 2012.

What do I think about the stability of the solution?

The connection between the CI client and remote machine dropped off when certain standard Tosca modules were used in the test cases.

Example: TC Send Key, TC Name To Buffer

What do I think about the scalability of the solution?

No issues so far.

How are customer service and support?

Customer service is reasonably good.

How was the initial setup?

There were a few hiccups on the way with the configuration files. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Manish Kum@r - PeerSpot reviewer
Manish Kum@rSenior Technical Automation Specialist at Sixsentix
Real User

Hi @reviewer789099 - how may I help you? Do let me know if you are faced with a challenge or just need the 'how to' about Tosca CI?

See all 9 comments
Nigel Powell - PeerSpot reviewer
QA Lead Engineer at Test Performance
Real User
Speeds up automation processes and allows us to automate test scripts much quicker
Pros and Cons
  • "The use of automation is most valuable."
  • "There should be ease of data manipulation within automation test cases."

What is our primary use case?

We use it to automate testing. In terms of the version, we're up to date. We're on the latest version. 

How has it helped my organization?

It speeds up automation processes within testing.

What is most valuable?

The use of automation is most valuable.

What needs improvement?

There should be ease of data manipulation within automation test cases.

There should be better testing in the ETL, warehouse, or big data environment. They need to look at the speed of that and how they do that type of testing.

There should be better support. We should be able to speak to somebody.

For how long have I used the solution?

I have been using this solution for six months.

What do I think about the stability of the solution?

The product is stable, but it can be a little slow, but that's a consequence of the fact that you're able to automate very quickly.

What do I think about the scalability of the solution?

If you buy more licenses, it's scalable. 

We just have a single instance, and we have multiple users with different projects.

How are customer service and support?

Their technical support is fairly good, but it's all done through email, which is a little difficult.

Which solution did I use previously and why did I switch?

I've used a lot of different automation tools. I'm a contractor. I go into different organizations. So, I didn't really switch. This company was using it.

How was the initial setup?

It is fairly easy. The worst thing about it is grabbing a license every time you log in. That takes a little bit of time.

The deployment duration depends on whether you use the on-premise version or cloud version. It takes a few hours for the on-premise version.

In terms of the implementation strategy, we just implemented the tool, did the training, and then started moving testing over to the tool.

What about the implementation team?

We did it ourselves. We had just one person for the deployment.

What was our ROI?

We have seen an ROI because we are able to automate test scripts much quicker.

What's my experience with pricing, setup cost, and licensing?

It is expensive. There is also the training cost, but it does speed up the process. So, you get a return on investment.

Which other solutions did I evaluate?

I evaluated the freeware tools.

What other advice do I have?

When reviewing the tool, you should make sure that any automation you've already got integrates fully with the Tosca tool. That's the biggest thing. Migration of any current automation is potentially a really difficult process.

I'd give it an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Tricentis Tosca
March 2024
Learn what your peers think about Tricentis Tosca. Get advice and tips from experienced pros sharing their opinions. Updated: March 2024.
768,857 professionals have used our research since 2012.
PeerSpot user
Quality Assurance Manager at a insurance company with 501-1,000 employees
Vendor
This solution allows you to create an automated framework where you can manage everything in one place.

What is most valuable?

This solution allows you to create an entire automated framework where it allows you to easily manage everything in one place.

How has it helped my organization?

It's given us the ability to do automated tests which has made some things a lot quicker.

A part of our problem is that we don’t necessarily have staff 100% dedicated to it, so that's a problem in our area. We should have had more done and taken on some huge projects, so it’s more that we haven’t had the time to use it to the greatest extent possible.

What needs improvement?

Our stability problems mentioned below notwithstanding, I am sure the new release will address everything that we need. We are going to convert to the new version and we have to address a problem with one of our apps first. We recently went through some training, our staff was excited about that and being able to see the new version was great.

The biggest roadblock for us in getting the newest version right now is accommodation of our application. The current version makes our lives easier, but we're still holding off on some testing until the accommodation issues has been resolved.

For how long have I used the solution?

I've used it for a year and a half.

What was my experience with deployment of the solution?

We've had no issues with deployment.

What do I think about the stability of the solution?

I think the version we're using is fairly stable, but I think the new version is not so stable, and that’s what's stopping us from moving over to it. We're having application problems, but once that's resolved, we'll move over to the new version.

What do I think about the scalability of the solution?

It's scaled for our needs so far.

How are customer service and technical support?

Overall, I'd say that technical support is good. When I have had interaction or problems, I let them know and they provide me with get instant feedback. I have been happy with that.

Which solution did I use previously and why did I switch?

We didn't use a previous solution, but I've personally worked with other tools. Testsuite is versatile, and that was the big thing about choosing it. We're using Power Builder, which Testsuite can support, along with other applications. So it's great having one tool instead of many.

What other advice do I have?

I think it’s important to get the training that is provided and really make sure you get hands-on time with the product. That’s our problem -- we haven’t been able to dedicate ourselves to it. If we had the time to stay with it and learn it then we could move forward.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Test Analyst at a financial services firm with 1,001-5,000 employees
Real User
Top 20
Complete solution, useful automation functionality, and reliable
Pros and Cons
  • "The most valuable features of Tricentis Tosca are all the test automation functionality. It is a full-scale automation tool."
  • "The support we received from Tricentis Tosca was good, but it can improve."

What is our primary use case?

We are using Tricentis Tosca for test automation.

How has it helped my organization?

Tricentis Tosca has completely met our requirements. It has benefitted our organization.

What is most valuable?

The most valuable features of Tricentis Tosca are all the test automation functionality. It is a full-scale automation tool.

For how long have I used the solution?

I have been using Tricentis Tosca for over five years.

What do I think about the stability of the solution?

The stability of Tricentis Tosca is excellent.

What do I think about the scalability of the solution?

We are using Tricentis Tosca at 100 percent capacity.

How are customer service and support?

The support we received from Tricentis Tosca was good, but it can improve.

I rate the support from Tricentis Tosca a three out of five.

What's my experience with pricing, setup cost, and licensing?

I rate the price of Tricentis Tosca a two out of five.

What other advice do I have?

I rate Tricentis Tosca a nine out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Release Test Manager at a tech company with 201-500 employees
Real User
They're always refining the test methodology
Pros and Cons
  • "What I find valuable is that Tricentis is always refining the test methodology. They listen to feedback from the analysts about what the testing tool should do, and then Tricentis always implements it. So all the necessary testing functions are already implemented in their tools."
  • "Tosca's reporting features could be better. Tricentis had a reporting tool called Analytics, but it didn't function properly after they reworked it. After that, they tried a new approach with key-tracing, and that didn't work."

What is our primary use case?

We use Tosca to automate progressive and regressive tests. About 60 people in my company are currently using it.

What is most valuable?

What I find valuable is that Tricentis is always refining the test methodology. They listen to feedback from the analysts about what the testing tool should do, and then Tricentis always implements it. So all the necessary testing functions are already implemented in their tools. So whenever there is some new need for a testing capability, I can be sure that Tricentis will implement it into the Tosca Test Suite quickly, and we can use it.

What needs improvement?

Tosca's reporting features could be better. Tricentis had a reporting tool called Analytics, but it didn't function properly after they reworked it. After that, they tried a new approach with key-tracing, and that didn't work. So they don't have a good reporting solution currently, and I hope they add one soon. 

For how long have I used the solution?

I've been using Tricentis Tosca for around 16 years.

What do I think about the stability of the solution?

Tosca's stability is good. However, when we upgrade, sometimes we find some defects or problems. These are usually fixed within days or two weeks if there are bigger issues. And this is once per year, usually without any bigger issues. The only other thing that sometimes causes problems is when the time path and some repositories are not on hand. Also, if the infrastructure or the network is not stable, you can have problems with the application. But, of course, that's not something the application can really prevent, like if the internet connection breaks or something like that. Especially now that almost all of us are working remotely. So you can have some defects on the network that causes some problems in the application as well.

What do I think about the scalability of the solution?

Before, we also used Tosca for manual testing. We had, I think, 400 to 800 main users — not at the same time — but we had a lot of users then. If you know the size of your repository, then it's easy to size the server accordingly. Also, when you know your requirements, you should make sure that the infrastructure meets the requirements, then it's easier. 

How are customer service and support?

The quality of Tricentis support really depends on the type of issue. When it's important, I go through the surveys, account manager quizzes, and so on. Tricentis handles the important issues quickly. And if we have smaller problems, it's usually routed to India, so we get a lot of basic questions back, and I don't like that process much. But, when it's important, we're immediately connected to the right people and get quick solutions.

How was the initial setup?

Setting up Tosca is quite straightforward. The main issue is setting up your infrastructure, the network port, and all those things upfront. But when this is fine, then the installation is uncomplicated. Then, we update once a year, and it takes a few hours.

What about the implementation team?

We have some integrators and consultants working for us, and we always have on-demand vendor support if something is not working. They resolve issues quickly. The vendor handles software maintenance. Our installation and maintenance can be partially done by a Tricentis consultant who works for our team. But before, it was an in-house guy. That guy left, so we hired an external consultant to do the same functions as the in-house staffer. So we have someone in the organization who is doing that. Before, it was internal and not external, but he is working basically like an internal for us.

What's my experience with pricing, setup cost, and licensing?

I'm not sure if I'm at liberty to talk about the pricing, but it has some significant costs. For example, you have to pay a license and maintenance fee. Then the rest of the terms are negotiable. We have to consider what we need and what benefit we get from it. You can then make a business case and see how the licensing fits best since they have different licensing models. You have to find the right model of licensing for you and then negotiate a reasonable price. So we always make a business case, and if the business case is okay, the licensing price is also okay. It provides value for the money. It's a stable product with a lot of functionality. And as I said before, it keeps pace with all the new trends that the analysts suggest, so it's worth the money

What other advice do I have?

I rate Tosca nine out of 10. So if you are considering this solution, I recommend that you make sure your team is good and stable in test definition. Also, you should build up your organization's competence in test automation. That way, you can get the most out of the tool and utilize its capabilities to benefit your organization. But there are challenges with a large organization internally. For example, we first had a central team for test automation. Then we moved to HL and de-centralized our test automation team. Unfortunately, that didn't work so well since it requires some specialized knowledge that you need to learn and to practice. So now we are trying to move again to centralized test automation and get more value for the business.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
DevOps lead at a computer software company with 51-200 employees
Real User
Stable, good technical support, but customization could improve
Pros and Cons
  • "The technical support is good, we were satisfied."
  • "The user management could improve in Tricentis Tosca because it is confusing. It would be better to have it in one place. Having to add it to the cloud and to a specific project can be a mess."

What is our primary use case?

We use Tricentis Tosca for testing.

What needs improvement?

The user management could improve in Tricentis Tosca because it is confusing. It would be better to have it in one place. Having to add it to the cloud and to a specific project can be a mess. 

In the future, they could improve overall mobile functionality.

For how long have I used the solution?

I have been using this solution within the past 12 months.

What do I think about the stability of the solution?

The solution is stable. However, we had a situation with an application we wanted to test some reset passwords. We have the two-factor authentication enabled on sending an SMS to a number and in this case, we did not find anything to solve it. There was not anything to automate me getting the number, and proceed with it automatically without going and testing it manually.

How are customer service and technical support?

The technical support is good, we were satisfied.

Which solution did I use previously and why did I switch?

I have previously used Selenium in the company I used to work for and it was perfect. The solution was very good at testing web applications, but not Windows, or desktop applications. Tricentis Tosca does not have customized reporting tools ready but Selenium you can build and customize whatever you want.

What's my experience with pricing, setup cost, and licensing?

Tricentis Tosca is an expensive solution and there is an annual license required. The whole licensing process is confusing and it could be made easier.

What other advice do I have?

My advice is if companies have developers, or the potential to teach developers, or QA teams, I would suggest they use Selenium because the price of Tricentis Tosca is expensive.

I rate Tricentis Tosca an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Conductor with 11-50 employees
Real User
Good online support, and has a reusable model
Pros and Cons
  • "The most valuable feature is being able to create a test case by recording some scenarios and then leasing that task case to other scenarios."
  • "The document object model or some aspects of it has a bit of a learning curve."

What is our primary use case?

Tricentis Tosca is used to test our in-house products. We have developers for Google and other web applications for our internal use, but that product is developed by outsourced developers, that needs to be tested.

What is most valuable?

The most valuable feature is being able to create a test case by recording some scenarios and then leasing that task case to other scenarios.

We only use the UI for testing purposes, so all other features are unusable to us.

What needs improvement?

The document object model or some aspects of it has a bit of a learning curve.

For how long have I used the solution?

I have been working with Tricentis Tosca for one year.

We use the latest version.

What do I think about the stability of the solution?

I don't have any issues with the stability of Tricentis Tosca.

What do I think about the scalability of the solution?

Because my organization or team only has one or two testers, we don't need to think about scalability. As a result, that product does not need to be scalable in my environment.

How are customer service and support?

My experience with the Tricentis website support was good.

Which solution did I use previously and why did I switch?

I have experience with Selenium HQ and Parasoft.

We conducted a SOAtest using Parasoft. Tricentis Tosca is different and better, because it has a reusable model, whereas the others do not.

How was the initial setup?

The initial setup requires some learning time. In my experience, we have testers who have no development experience, so we need to educate them on the development side. I'm referring to the ID in the document object model or some aspects of it. After that, we'll be able to use it. In my experience, the learning curve was the most difficult obstacle.

It took approximately three months to complete the deployment.

This solution is maintained by two people, the same two who use it.

What about the implementation team?

I was able to learn the installation process myself.

What's my experience with pricing, setup cost, and licensing?

Licensing fees are paid on a yearly basis.

What other advice do I have?

I would recommend this solution to others, but in our country, I believe the importance of testing is currently ignored or underestimated. It is not popular in our country at this moment but I will recommend this tool.

We are partners with Tricentis.

I would rate Tricentis Tosca an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Technical Lead at a tech services company with 1,001-5,000 employees
Real User
Good reporting, easy-to-use interface, and the APIs are useful
Pros and Cons
  • "The reporting is really nice."
  • "The UI does not have the option of automating the scroll bars."

What is our primary use case?

We have been using this solution in my organization. There are several clients who have come back to us asking for different automation tools and our views on which automation tools can be used in their respective projects.

We have been evaluating for these clients. The evaluations we were doing, was for our client but done within the organization only.

What is most valuable?

The most valuable feature is the UI.

We work primarily on evaluating the UI. We evaluated Tosca BI and a bit for Tosca APIs and think they are very useful.

The reporting is really nice. There are many clients who ask for a feature with any automation tool that can generate good reports for them. There is only one such tool that facilitates that option, which is Tosca.

What needs improvement?

The volume for the BI testing is limited. If they could provide a few options to use it, using Tosca only, that could be a great thing because there are a lot of clients who do not actually want to go for the BI, but then they do have the database testing.

I know that Tosca provides the feature but it's very minuscule.

The UI does not have the option of automating the scroll bars. There are workarounds for that but for example, if I open two tabs that have the same page then it will give me another difficulty in scanning those options. 

In the next release, including this in Tricentis would be great.

For how long have I used the solution?

I have been acquainted with this solution for approximately eight months.

What do I think about the stability of the solution?

So far, what we have used has been stable.

I have read some reviews where they have expressed that they are not happy with the stability, but so far, I have not faced any such issues.

What do I think about the scalability of the solution?

The scalability is good. If I had to rate it out of five, I would say that it would be a three-point five to four.

We have anywhere from 500 to 750 people who are using this solution in our organization.

How are customer service and technical support?

Technical support is good. Their turnaround time is usually within 24 to 48 hours, but normally we have a response within 24 hours.

Which solution did I use previously and why did I switch?

Previously, we did not work with any other solution.

How was the initial setup?

We have always worked with the demo licenses, which included support from the Tricentis teams. They have always been able to set up the licensing.

I would say that it is not that straightforward.

On average, it did not take more than two to three hours if you know the process properly. To get it started, it will require at least six hours.

What's my experience with pricing, setup cost, and licensing?

The disadvantage is that it is very expensive.

I would like to see better costing packs. There are several features but USD $11,000 for one license is expensive. If it had more interaction and if the license cost was a little less it would be better and rate higher.

What other advice do I have?

The recommendation of this solution depends from client to client and what their requirements would be, the parameters, and what is important to them. 

If the client wants good support and at the same time they want to have a good database included with the Automation Testing Suite, and is ready to spend the money, then we would definitely suggest Tricenta Tosca as a good option.

Again, it is dependant on the client's requirements and what they would want in an automation tool.

If you have Linux or Mac machines, then it gets very difficult to implement Tosca. I would suggest using it. 

For testing, they would want to migrate miscellaneous scripts and use Tosca for those migrations. But, it's very difficult. 

My suggestion would be to go with the Tricentis Suites and the Selenium Automation Suites.

From a positive perspective, I would want people to use the reporting from Tosca. They have very good reporting. The reporting feature is very user-friendly and very easy to use.

I would rate Tricenta Tosca an eight out of ten.

Disclosure: My company has a business relationship with this vendor other than being a customer: partner
PeerSpot user
Buyer's Guide
Download our free Tricentis Tosca Report and get advice and tips from experienced pros sharing their opinions.
Updated: March 2024
Buyer's Guide
Download our free Tricentis Tosca Report and get advice and tips from experienced pros sharing their opinions.