Our most important use case was a carve out. We acquired an organization, so we needed to to carve out their SAP environment. We use it for regression testing. We set up an automated regression test set because we have to test everything to make sure that everything still works. It is SaaS.
The widget's ease of use is the most valuable, which means it allows you or business people to record the automated test scripts. In most cases, it is really good because it is the business people who actually know how the system is being used. The simplicity of the design is valuable, where you can record your transactions, then create your automated scripts. You can automate it at the same time, and the automation features are cool.
Advisor Test management and coordination Concern Affairs Province of Noord-Holland at Provincie Noord-Holland
Jan 25, 2021
What Qualibrate makes very easy to do is to record a process flow. Within five minutes you have a clear document produced by Qualibrate. Instead of using Word, and copying and pasting pictures into it from printscreens, within five minutes what you have was easy to make and it's easy for users to use.
Not everything in SAP works well with Qualibrate. There is a development tool called xpath and you have to program it. We always thought it wouldn't be necessary to program it with Qualibrate, that everything could be solved by Qualibrate without programming, but you have to program some things. Using xpath is more complicated, and not easy for everybody. It would be helpful if there were a no-code solution for this.
There is a module that we would like to have. We would like Qualibrate to design a requirements module so that we can design our testing, our flows, and our scenarios based on our actual requirements. Right now, we're doing that, but we're having to do it outside of Qualibrate. For example, in Excel, we might have a list of 50, 60, or 70 different requirements and combinations of tests that need to be executed, and since that module doesn't exist in Qualibrate, we're doing it offline. We have already vocalized that wishlist to them, and they have acknowledged it, but I have no idea when they're going to get around to deploying something like that. It is probably number one on our list. We're using the testing schedule and execution a little bit. We're not really thrilled with the testing schedules just yet. They just recently enhanced the schedules module. So, I haven't got to play with those new enhancements just yet, but we have noted to the Qualibrate team that we were hoping for some expanded functionality in that space. I think they're working on that, and some of it might've been delivered recently, but there are still some things in their backlog that we're hoping they will deliver. Their support has been quite good overall, but there have been some frustrations recently where we just feel like we're not always being heard. They are very inconsistent. In some cases, their support is very immediate, and then in other cases, there is absolute silence.
What I would really like to see is if you are running scripts in Qualibrate, and there is a defect, then you can have it automatically raise a defect in your own ticketing system. We do not use the defect system in Qualibrate, which is why this would be helpful. We won't want to have to use the ticketing system in Qualibrate in addition to the one we use now. The reporting can be improved. For example, the reports can be better and show details like how many of your scripts have been executed, what the history is, which scripts have not been executed for more than a month, and other types of statistics. It would be nice if when you add or change some specific script in your SAP system, it would automatically check to see what it implied with respect to Qualibrate. For example, it would link to the appropriate Qualibrate script if it needed to be changed. In the context of an end-to-end process, which has already been recorded, if next week I change something in the process then I would like to get an alert that we need to make the relevant change in the process.
We had an issue with SAP when using PDF forms. That was something that was not supported by Qualibrate, but we solved that issue by choosing another solution. That was the only wish we had with Qualibrate. All the other functionality provided is all the functionality we need.
What could be improved would be the intuitiveness of the reporting engine. It does have reporting, i.e., a dashboard, but it is preconfigured, predefined KPIs and datasets. That could be improved because the datasets don't have descriptions, so you really need to know what you're doing. Whereas, it would be great if it could have more descriptions and be easy to build your own KPIs.