What is our primary use case?
Currently, I have a project change in my company, and I am working in mainframe technology and mainframe testing. Mainly, I am currently working with Selenium and Java. Regarding Java frameworks, I am working with Cucumber BDD. For Jira, I am currently not using it, but I am using ADO, which is Microsoft Azure DevOps.
What is most valuable?
Microsoft Azure DevOps provides Agile methodology, and daily we have sprint calls and sprint retrospectives. The stories assigned in the board are in Microsoft Azure DevOps, so every two weeks during sprint planning, the main person managing that board assigns tasks to developers along with the points. The same applies to testers as well, as we need to test the assigned tasks. After two weeks, we either complete that task story or carry it forward. This all will be in Microsoft Azure DevOps, where we periodically check the backlog. The main person will prepare reports, and we raise bugs in Microsoft Azure DevOps. Test planning, uploading test cases, regression test cases, and execution of test cases are all tracked there.
The regression test cases for every story or every month that we have to run are very helpful, as we upload all our regression test cases and execute them along with the evidences. Whenever we go back and refer to the functionality of the earlier one, it is helpful because the test result evidences are also available. The person tracking it finds it very useful, and there is no need to ask for individual reports. If executed there, everything will be in the report when extracted.
I do use Microsoft Azure DevOps Boards for the collaboration part. I am very satisfied with it for collaboration; it is very good. From the beginning till the end we are using it, so it is a good product.
What needs improvement?
I have not integrated Microsoft Azure DevOps with Micro Focus and currently do not use UFT One, so I think integration with Micro Focus would surely help a lot.
For how long have I used the solution?
I have been working with Microsoft Azure DevOps for two years.
What do I think about the stability of the solution?
I would rate stability for Microsoft Azure DevOps as a ten because earlier we had Micro Focus Quality Center, and Microsoft Azure DevOps is a good management tool. I think we can do more with it, especially since today everyone is adopting Agile methodology, covering everything from story planning to sprint planning, retrospectives, and including reports, as well as backlog reports, where many functionalities are available.
What do I think about the scalability of the solution?
I can give scalability an eight.
How are customer service and support?
I had a very good experience with Microsoft technical support. Whenever I raised a ticket or needed help, I received great support. Since I spent most of my career working with UFT One, I can give an eight point five.
Which solution did I use previously and why did I switch?
When I compare Microsoft Azure DevOps with Micro Focus for my use case, Micro Focus allows me to do only a few things in UFT One or ALM, as some parts were missing, especially in an Agile world. Microsoft Azure DevOps is a more complete product for me.
How was the initial setup?
Microsoft Azure DevOps actually has a simple setup process if we use the cloud version, which requires not much setup. The stand-alone version might take more effort, but the cloud version seems simpler. I do not have much idea except they provide a URL for us, which we just access.
What's my experience with pricing, setup cost, and licensing?
I rate Microsoft Azure DevOps price as a one, which means it is a good value.
What other advice do I have?
In terms of Azure Repos, mainly, I do not take reports myself, but higher management wants reports such as stories backlog reports. They will take these reports. On the testing side, whatever regression percentage is covered, and defects raised and resolved, or assigned and fixed, the authorized persons find it helpful to generate various reports.
Regarding Azure Test Plans, the respective product owner and Scrum Master mostly use all these functionalities. As a tester, I execute whichever story is assigned to me along with the test evidences, even for regression. If a test plan exists, I upload test cases and raise any defects. These are my areas of functionality.
I might have that integration with Microsoft Teams, but since I am currently not using it, it is mainly due to my focus on mainframe testing or Selenium with Java. Others who use UFT or LoadRunner for performance testing might have that integration.
Based on my experience, the main benefits Microsoft Azure DevOps provides include saving time for tracking all assigned stories, as everything from the epic to detailed sessions and links is tracked. Once assigned, developers upload unit test cases that I can refer to. Each and every part and functionality is available, which makes it easy for me to refer to during SIT testing, and for defects raised, we can track to whom they are assigned until closed.
I am satisfied with the functionality of Microsoft Azure DevOps because UFT is for functional testing, but integrating with Microsoft Azure DevOps allows us to track from the beginning to the end. I would rate this product an overall ten.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?
Microsoft Azure
Disclosure: My company has a business relationship with this vendor other than being a customer. Partner