What is our primary use case?
Microsoft Azure DevOps is used for end-to-end testing activities, handling all kinds of testing activities like user story creation, epic creation, test case creation, test case execution, data creation, and pipelines execution. It is mainly used for creating stories and test cases, as well as for test execution.
In pipelines, pipeline agents in Microsoft Azure DevOps are used, so it is mainly used for end-to-end QA activities. When a set of requirements is available, the product manager creates specific epics or features and corresponding user stories in Microsoft Azure DevOps, which are passed to the dev team and QA team. The dev team works on the code based on these user stories, and once the code is written and pushed to Git, the product gets deployed for testing.
As a QA engineer, I review all these user stories and start with test case creation. Once the product is deployed, test execution begins.
Once all tests pass, the test cases are updated accordingly, and a full report showing how many test cases passed or failed is visible in Microsoft Azure DevOps.
Automated scripts also run via the pipelines in Microsoft Azure DevOps.
Our organization is fully dependent on Microsoft Azure DevOps for end-to-end QA and dev activities, tracking all requirements, test cases, and test execution reports, as well as all pipeline execution. Everything is handled via Microsoft Azure DevOps, and all codes are kept in this repository.
What is most valuable?
Microsoft Azure DevOps offers very user-friendly features, including pipeline options used for integration.
Whenever something is created or deployed, it automatically triggers the automated scripts, generates reports, and updates the test cases, providing a seamless end-to-end activity.
Everything is done within Microsoft Azure DevOps, allowing managers and heads of departments to have all reports on what everyone else is doing at their fingertips.
They can check the progress of each task and come up with suggestions based on the reports. This provides accessibility to everyone, ensuring visibility on work and timelines, which has had a huge positive impact on the organization structure and team dynamics.
What needs improvement?
No major failures have been observed with Microsoft Azure DevOps, as it is available most of the time.
There are occasional downtimes, but that is the only negative point observed.
One issue noted is that when working on multiple epics, the board or sprint displays tasks only for selected individual projects, so there is no combined dashboard to view all tasks at once.
It is sometimes difficult to navigate through individual projects. Multiple tasks may be allocated, but only tasks from one project are visible on the dashboard at a time, so other projects must be selected to view different tasks.
This can be somewhat cumbersome, though everything else is up to the mark.
I chose nine because there is a limitation with the dashboards; you cannot see all tasks from multiple projects on a single dashboard, which can be confusing. Other than that, everything else is fine.
For how long have I used the solution?
Microsoft Azure DevOps has been used for the last seven years.
What do I think about the stability of the solution?
Microsoft Azure DevOps is definitely stable, as it is available most of the time, with very few downtimes.
Notifications are usually received if downtime is expected, and it has been available about 99% of the time.
What do I think about the scalability of the solution?
Microsoft Azure DevOps is scalable, with multiple options available to scale up the product as needed, given its Microsoft backing.
How are customer service and support?
Customer support for Microsoft Azure DevOps is excellent.
There has been very little downtime, and when requirements arise, they are raised and often get fixed within one or two days.
How would you rate customer service and support?
Which solution did I use previously and why did I switch?
Before Microsoft Azure DevOps, multiple products like
Jira and TestLink were used, which had limitations such as only managing bugs or requiring separate tools for test cases, dashboards, and user stories.
Switching to Microsoft Azure DevOps allows for handling everything within one application.
What was our ROI?
There has been a measurable improvement in productivity of around 40 to 50% after implementing Microsoft Azure DevOps, which has allowed more time to be spent on other things.
Resources have also been reduced by 10 to 20%; this tool enables three persons' work to be done by two or one person.
What's my experience with pricing, setup cost, and licensing?
Pricing experience is limited, as I am a user of this product and not involved in the pricing aspects.
There has definitely been a lot of return on investment from using Microsoft Azure DevOps due to the 40 to 50% increase in productivity, which saves considerable time for other work.
Additionally, resource needs have been reduced by 10 to 20% because of the efficiencies gained.
Which other solutions did I evaluate?
The organization was already in partnership with Microsoft, so other options were not evaluated extensively.
When investigation occurred, Microsoft Azure DevOps was found to be the best option currently available, so it was chosen.
What other advice do I have?
If you are looking for an end-to-end solution for your dev or QA activities, then Microsoft Azure DevOps should definitely be considered.
It provides complete end-to-end activities with excellent customer support, and being from Microsoft, you can expect a very good product.
I would rate this product a 9 out of 10.
Microsoft Azure DevOps should be tried to experience it firsthand, and you will understand its value.
Which deployment model are you using for this solution?
Public Cloud
If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?