What is our primary use case?
We use the solution to help automate our test cases. What we used to do was get manual test cases from the manual testers. They would provide step-by-step descriptions of what application to test and how to launch it, as well as what needs to be tested. The applications were both web-based and Oracle Forms-based. These are the applications that need to be automated in order to be tested. The basic reason why automation was needed was to make this process faster and cheaper. The testers would provide us with test cases, and we would then perform those tests using Java code in a scripting tool. After scripting, we would put them into batch execution mode, or somewhere just from the command line we would trigger them. There was no need of sitting back there and seeing if the test cases were running fine or not. We only focused on the test results in HTML customized reports where we would monitor which test cases had been passed or failed and then we would report those particular test cases.
How has it helped my organization?
There are several advantages to using automation testing. First, it requires less maintenance. Automated tests are specifically targeted to find any bugs or issues in the code and quickly identify them. For example, one automation tester can do the job of ten manual testers. This is a cost-saving for resources.
What is most valuable?
OpenScript has many features that make it useful, including the ability to record and playback. For example, with Selenium, we used to have to inspect the path we needed to identify, but with OpenScript, we just click a button to record all our clicks, and it generates Java code automatically. When updates to the code are needed, we can do it manually using Java code. The best feature of this solution, compared to others, is that we do not need to worry about our test cases being executed in front of us. Even if we are sleeping or away from our computer, the solution will still run the tests and provide us with the results in the morning.
We had an issue where the image-based automation was not there. It was gone. Then after the review I gave and the coming releases, Oracle included that image-based automation as well. Oracle listens to its customers.
What needs improvement?
Oracle Application Testing Suite can improve by covering more browsers as compared to other solutions because they're considering the Edge browser as well, but the solution is working on different Windows operating platforms. For example, in our current Windows 2012 R2 server, if I want to automate the Edge browser, I need to upgrade that particular Windows to Windows 10.1 or some other Windows platform, because it's not supported in Windows 2012 feature. That is an issue. If cross-browsers can be incorporated, then support should be provided. There should be a single operating system where everything can be incorporated.
I have faced issues with some indexing items. For example, the solution is able to derive some properties from the screen, such as button locations or text locations, but there are some elements, for example, unnamed buttons or text, where there is no name or ID or any other identifying information. Indexing doesn't always work, and we have to go to those elements manually and inspect them to determine their class, and then input that information into the system.
For how long have I used the solution?
I have been using the solution for over six years now. Specifically, OpenScript which is one module of Oracle Application Testing Suite.
What do I think about the stability of the solution?
Overall, the solution is very reliable and stable. The applications that we are automating are fluent and it's just a one-time automation that is required unless there is no change in the application that we are automating.
I give the stability an eight out of ten.
What do I think about the scalability of the solution?
The solution is scalable, meaning that there are multiple tools that can be used within the solution itself. This allows for load testing and performance testing, among other new use cases. Currently, only functional testing, performance testing, and load testing are included. This leaves many possibilities for other types of testing that could be included.
I give the scalability a six out of ten.
I have worked with different organizations, so altogether, there are different teams. A ballpark figure of how many people are using the solution would be around 100, but within my current organization, we have ten users.
We are planning to recruit some automation testers so that we can make our solution useful for them as well. I am the only one and I require the team, so their skills will be beneficial to all of us.
How are customer service and support?
The technical support is good. We submit tickets based on severity. When our issue is urgent they respond within 24 hours, but when the issue is low severity and does not affect service they can take their time to respond.
How would you rate customer service and support?
Which solution did I use previously and why did I switch?
I have experience working with Selenium and I'm certified in Tricentis Tosca automation tools. Selenium is a basic version of automation tools that requires inspecting elements manually and passing on information to the solution. Oracle Application Testing Suite is above Selenium in terms of automation because it generates all the information automatically. Tosca is on a higher level again because it scans our screen and puts the code into the solution, which is quicker than Oracle Application Testing Suite.
How was the initial setup?
The initial setup was easy and straightforward, much like installing any other solution. However, some additional manual setups were required once the solution was installed. These were more complex and challenging, but once we got the hang of them, installing the application was much easier.
We can install the solution and set up the issues ourselves if we are the user. However, if we are new to the application, we may need Oracle's support.
The deployment takes around one and a half days.
What about the implementation team?
The initial implementation was completed in-house and if there were any issues after the deployment I would send a ticket to Oracle customer support.
What's my experience with pricing, setup cost, and licensing?
The functional testing tool is free to use. The complete package, including load testing and performance analysis, has a licensing fee.
What other advice do I have?
I give the solution an eight out of ten.
The solution doesn't require any maintenance, but the scripts we are automating do. Those scripts need to be updated frequently because the solution is getting updated. However, if we have set the solution up for the first time and we don't change those settings, then maintenance every three or four years should be fine. When we upgrade the tool, then our scripts need to be upgraded too.
Oracle applications need automation, regardless of whether they are cloud-based or not. Oracle Forms applications need Oracle Application Testing Suite for compatibility. If our applications are only web-based and simple, Selenium is a good, free option.
*Disclosure: My company does not have a business relationship with this vendor other than being a customer.
