Vice President at a energy/utilities company with 10,001+ employees
Real User
Top 20
A very stable and scalable solution which seamlessly integrates all ends of the process
Pros and Cons
  • "The solution is good for everything, including end-to-end planning and its deployment and testing."
  • "The solution should have fewer updates."

What is our primary use case?

I do not recall which version we are using. 

The solution is good for everything, including end-to-end planning and its deployment and testing. 

What is most valuable?

I like that the solution is stable and that all ends of the process are integrated seamlessly into the tool. These are the solution's greatest strengths. 

What needs improvement?

The solution should have fewer updates. We need the updates for July. Microsoft tools are sometimes too feature heavy and offer more features than the person actually needs to use. This is why I did not rate it as a ten out ten. 

While the installation did seem to be pretty straightforward, I believe it took awhile, even though I am not aware of the specifics involved. We initially found ourselves struggling with this process.

For how long have I used the solution?

I have been using Microsoft Azure DevOps for around two years. 

Buyer's Guide
Microsoft Azure DevOps
November 2023
Learn what your peers think about Microsoft Azure DevOps. Get advice and tips from experienced pros sharing their opinions. Updated: November 2023.
744,865 professionals have used our research since 2012.

What do I think about the stability of the solution?

The solution is very stable. 

What do I think about the scalability of the solution?

The solution is very scalable. 

How are customer service and support?

I feel the technical support to be fine. We have not encountered any issues in this regard. 

Which solution did I use previously and why did I switch?

Prior to Microsoft Azure DevOps, we were using Jira and, before this, KFS. 

How was the initial setup?

While the installation did seem to be pretty straightforward, I believe it took awhile, even though I am not aware of the specifics involved. We struggled with this initially.

What about the implementation team?

The installation was undertaken by a consultant. 

There was a team of, perhaps, five engineers involved. 

What's my experience with pricing, setup cost, and licensing?

I am not aware of any licensing subscriptions for the solution. 

What other advice do I have?

I would very much recommend the solution to others. 

I don't see the need for more integration with other platforms, as the solution is already pretty well integrated, at least, that is, for our needs. 

I rate Microsoft Azure DevOps as a nine or ten out of ten. 

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Release Engineer at a computer software company with 11-50 employees
Real User
Scalable, simple installation, but dashboards could improve
Pros and Cons
  • "The installation is straightforward. We can create a whole new organization in less than a day."
  • "The dashboards need bigger with better extensions and layouts. There isn't a workflow related to the statuses on the dashboard. It only lists the statuses. You can have one started, and once done, but everything in between is only in progress and could be in any order you want, it lacks flow."

What is our primary use case?

We use Microsoft Azure DevOps for our source control, change request management, and a small amount of Wiki.

How has it helped my organization?

Microsoft Azure DevOps has helped our organization from having completely automated builds. The developers can send their own code to QA without needing a release manager or lead or IT person moving the code over.

What needs improvement?

The dashboards need bigger with better extensions and layouts. There isn't a workflow related to the statuses on the dashboard. It only lists the statuses. You can have one started, and once done, but everything in between is only in progress and could be in any order you want, it lacks flow.

For how long have I used the solution?

I have used Microsoft Azure DevOps for approximately one year.

What do I think about the stability of the solution?

Last week the builds did stop working for some unknown reason, and then started again. Most of the time the stability is fine, but there are occasions when there's a problem on Microsoft's side, where it creates problems for us.

What do I think about the scalability of the solution?

The solution is scalable but you have to pay for it.

We have approximately 40 people using this solution consisting of developers, QAs, and product owners. We are extensively using this solution in our organization.

I wish the dashboards and the release process were integrated better. The use of Kanban dashboards could be a lot better. They don't have a Kanban dashboard. They have a dashboard with one sprint but it's not exactly the same as a Kanban dashboard. You are not able to do much with them. 

How are customer service and support?

We have not needed to contact the support.

How was the initial setup?

The installation is straightforward. We can create a whole new organization in less than a day.

What about the implementation team?

We did the implementation ourselves. I do most of the maintenance but it is mostly maintenance-free.

What's my experience with pricing, setup cost, and licensing?

There are additional costs for some functionality, such as increased scalability.

What other advice do I have?

My advice to others is for them to do their research before implementing this solution.

I rate Microsoft Azure DevOps a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Buyer's Guide
Microsoft Azure DevOps
November 2023
Learn what your peers think about Microsoft Azure DevOps. Get advice and tips from experienced pros sharing their opinions. Updated: November 2023.
744,865 professionals have used our research since 2012.
CTO at Southernsoft Technologies
Real User
Intuitive and easy to use with good stability
Pros and Cons
  • "The one thing that really stands out to me is how you can filter and how you can do your reporting and filter the tasks and everything by user."
  • "We did have some brief performance issues, however, that was due to putting everything on one epic instead of breaking a project up."

What is our primary use case?

I primarily use the solution on projects often. We use it for our Git repository and the CI/CD.

What is most valuable?

I love how easy the solution is to use. It’s intuitive. I don’t need to reference a manual. Everything is just very naturally laid out.

You can link your tasks and assign people. To me, it just makes sense. The user experience is excellent.

I like the Kanban tasks and their various features. It’s all very straightforward.

The one thing that really stands out to me is how you can filter and how you can do your reporting and filter the tasks and everything by user. Every time I try to do that in Jira, for example, it's a pain.

The stability of the product is quite good.

What needs improvement?

I’m not sure what needs improvement. I don't even think I'm using everything. There are still a lot of things on the testing side that I'm not using. That said, there's, there's a lot that it can do. I wouldn't even know where to get started on discussing what it needs or lacks.

We did have some brief performance issues, however, that was due to putting everything on one epic instead of breaking a project up.

For how long have I used the solution?

I’ve been using the solution for about four years now. It’s been a while.

What do I think about the stability of the solution?

For the most part, the stability is very good. There was one time there was a bit of a performance issue, however, it was just due to the fact that the project manager was overwhelmed. It slowed down and got laggy. We put everything on one story, one epic, and we realized we needed to split it up.

What do I think about the scalability of the solution?

The product can scale. With the projects that I work on I just pick up Azure DevOps. It just makes sense. Everything from the beginning, for example, how the story starts right up to how it gets deployed and everything, is well laid out and you can adjust as needed.

On the project that I'm doing right now, maybe have a team of ten. On other projects, for example, at my previous company, we had a hundred devs or so using it.

How are customer service and support?

Technical support has been very good. We used to call Microsoft and they would help us. They gave great support. We’re quite happy with their responsiveness and level of knowledge.

Which solution did I use previously and why did I switch?

I also use Jira alongside Azure DevOps. I use both of them.

I find DevOps easier to use and better laid out. I find Jira difficult and confusing.

How was the initial setup?

The initial setup is pretty straightforward.

What's my experience with pricing, setup cost, and licensing?

I can’t speak to the exact pricing. It’s not an aspect of the product I deal with.

What other advice do I have?

We’re a customer and an end-user.

I’m a big fan of DevOps. It’s a good project and I haven’t seen anything else like it.

As we’re on the cloud deployment of the solution, we’re always on the latest version.

I’d advise new users, if they are a Microsoft shop, to choose DevOps over Jira. It just makes more sense.

I’d rate the solution at a ten out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Owner and Senior Consultant at a tech services company with 1-10 employees
Real User
Simple to use, numerous add-ons, and versatile work items, but user management is difficult.
Pros and Cons
  • "The work items option is incredibly flexible."
  • "When you compare with Jira, there is a lack of progress features."

What is our primary use case?

A common use case of Microsoft Azure DevOps is the use of work items and then connecting them to Git repositories and their updates. It is primarily used for item and code management.

What is most valuable?

The work items option is incredibly flexible.

There are multiple add-ons available.

It is easy to use.

The entry point is adequate.

What needs improvement?

When you compare with Jira, there is a lack of progress features.

I would like to be able to customize the product using add-ons or a similar mechanism.

Scalability is an area where they could advance and make changes.

Unfortunately, managing users in Azure is a very complicated issue. We also have a problem with one of their other tools, which is Teams. The Team messaging has caused us some trouble because they have what is called organization, in addition to the users, but it doesn't work very well.

Technical support needs improvement.

I would like to see scalability, dashboards, KPIs, measurements, and some visual management assistance improved in the next release.

For how long have I used the solution?

I have been working with Microsoft Azure DevOps for one year.

We are using the latest version.

What do I think about the stability of the solution?

Microsoft Azure DevOps is a stable product.

What do I think about the scalability of the solution?

This solution is used by 20 people in our organization.

It appears to be simple, but based on the work items and project management aspects, I believe there are few options for scaling it up in terms of dashboards and KPIs.

How are customer service and support?

I contacted technical support about managing users in Azure. Unfortunately, they were able to resolve this issue for us.

We tried several times and we did not get the answer we expected to get.

Which solution did I use previously and why did I switch?

I use Jira as well as TFS.

How was the initial setup?

The initial setup is straightforward. It is simple to install.

Other than the initial setup, it does not require any maintenance.

What about the implementation team?

It was implemented internally.

What's my experience with pricing, setup cost, and licensing?

The majority of the components are reasonably priced. Testing is one of the more expensive components. When you compare it, it is approximately $3 per month for the other components and $45 or $50 for the Testing component. It costs ten times as much as the other components.

What other advice do I have?

I would recommend this solution to others who may be interested in using it.

I would rate Microsoft Azure DevOps a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Principal Project Manager at Systems Limited
Real User
Gives you the ability to run test cases, but query functions aren't as helpful as other solutions
Pros and Cons
  • "You can have test cases in DevOps but not in JIRA. And, DevOps has advantages in terms of executing those test cases."
  • "With the query feature, we have to group items, so it becomes difficult for everyone to understand it. It's easier in JIRA, which has filters and other query options."

What needs improvement?

With the query feature, we have to group items, so it becomes difficult for everyone to understand it. It's easier in JIRA, which has filters and other query options. So, I think this query option should be there in the DevOps also. Also, I don't like the DevOps' boards at all. It's more complicated than JIRA, I think. So, DevOps can improve in terms of its boards, work items, and filters. 

Then there is also an issue with user access. We have about 10 to 15 users that we can add to DevOps. But only the first five users have basic level access, and the rest have stakeholder access. That means they can change the task status but not add or do anything. I think Microsoft should remove this restriction from DevOps. With the access restrictions, it's tough for us to add any status for our users or filter anything on the boards. So, Microsoft should add this functionality for the other roles as well.

What do I think about the stability of the solution?

DevOps is a stable solution.

How are customer service and support?

It's average. It's not better than JIRA. It's average because many things need to be improved by Microsoft in all their products.

How was the initial setup?

Setting up DevOps is easy. 

What's my experience with pricing, setup cost, and licensing?

We pay for DevOps when we use it for our clients. But for personal and internal projects, we can use the free version. But there are restrictions on the trial plan. It should also be available for free use. However, the trial version of DevOps is free for only five basic users. So, I think it should be free for others also. And other extensions like test plan creation should also be available for the basic users, at least. We have to purchase the license for this.

Which other solutions did I evaluate?

We use both JIRA and DevOps. The main difference between DevOps and JIRA is the test cases. You can have test cases in DevOps but not in JIRA. And, DevOps has advantages in terms of executing those test cases. You can develop releases from DevOps but not from JIRA. At the same time, JIRA's jQuery is the best. I don't like the grouping and filtering in DevOps. 

What other advice do I have?

I rate Microsoft Azure DevOps seven out of 10. I would recommend it to others. It's a nice and helpful tool.

Disclosure: My company has a business relationship with this vendor other than being a customer: partner
PeerSpot user
Software Engineering Manager at a healthcare company with 1,001-5,000 employees
Real User
Provides the best full integration feature on the market; our most important tool
Pros and Cons
  • "This is an all-in-one, one-stop shop, nothing comes close."
  • "Project management could be improved."

What is our primary use case?

We're using Azure DevOps Services for three things: First, for project management, second, for storing the source code, similar to GitHub Repository, and finally, we use it as our CICD build server or build environment, which builds for us and runs tests and so on. In general, these are the three main use cases for this product. We are large customers of Microsoft and we're on a corporate level with them. We pay extra for support. I'm a software engineer manager. 

What is most valuable?

I like that this solution is all-in-one, a one-stop-shop, it's the killer feature. I haven't seen anything that comes close. I guess GitHub will be close soon, but that's it, there's really nothing right now for that full integration. Other solutions require three tools so this is really a great feature. The solution has a better user interface and better CICD tools compared to what we used previously when we ran TeamCity. I think it scores higher on most things, including better developer ergonomics. Since it's Git-based, there's no training because everyone uses Git. I've found it to also be very customizable so that on all points it's better. This is an important tool for us. 

What needs improvement?

This solution is not as good as Jira when it comes to project management and I think they know it, but it's good enough. I'm very used to it now, so I can work more quickly, but I've had colleagues who are very Jira-focused and they don't like Azure DevOps at all. When it comes to the handling of tickets or tasks or the product backlog, Jira is much more customizable and more intuitive. It's an area that Microsoft could improve. 

The instructions could be a little better. We are doing some weird stuff where we're building some things, including embedded firmware. It wasn't super intuitive to set that up which was an issue although it's something minor and we managed to solve it. I just expected it to be a little easier, although it's not what the solution is built for. We're going a little out of the normal use case. It is a little clunky compared to Jira and hosting your own builds could be a little easier.

I'm aware that they're putting money into GitHub to add more features around vulnerability scans and statical analysis and so on, basically taking on cloud and what have you, as well as Vericode that we are using. It would be great if it was built into the tool. I get things from other vendors that are provided out of the box, and it would be awesome for me to have that with DevOps. 

For how long have I used the solution?

I've been using this solution for several years. 

What do I think about the stability of the solution?

The stability of the solution is good. We've had a couple of dashboards out and they have a nice page share where they show what's out and what's not. A few months back they had some issues with the Active Directory and we were pretty much locked out of some things. We lost Teams for a while and we use that a lot in Azure DevOps. It was quickly fixed. Otherwise, I'm very happy with the stability. 

What do I think about the scalability of the solution?

The scalability of the solution is good and there's no maintenance required. We're a small operation and we could grow by a factor of 10 and it wouldn't be a problem. This is an SaaS and if you need to take care of it, there's something wrong. We use the solution extensively and soon we'll have almost every piece of software, including all our test automation and embedded firmware there so we'll be increasing usage. 

Which solution did I use previously and why did I switch?

The company previously used TeamCity, and I have used Jenkins in the past, the grandfather of everything. Azure DevOps is nicer. Jenkins is very configurable, but a pain. I like Azure a lot more and I think this or something like it, GitHub Actions, for example, is the future.

How was the initial setup?

The initial setup is very intuitive. What I think they could work on is the whole permissions model where you have projects and other things which require permissions and which is not very intuitive. You can do almost everything but I want a more granular permissions model that's also easy to maintain. I don't quite like the way it's set up so there's some work to be done there. I think I'd rather do it in text because it's hard to see everything clearly otherwise. If you have a complex permissions system, it's complex to set up and it's not super intuitive. Compared to AWS, which is a very different system, that aspect of Azure is not very intuitive.

I work in an engineering department so we didn't feel the need to get any help with deployment. If you read the manual, create the sandbox, and test it out you're able to roll it out. It's not that hard. 

What's my experience with pricing, setup cost, and licensing?

We're not paying a lot for this product. As developers, we have a Visual Studio license which is basically free. That's how their licensing model works. Then we have a number of stakeholders who need to do edits in the system, but not work with code necessarily. I believe they're paying $5 a month per user. We also have users who only need to read things and don't need code so I set that up for everyone who needs it. We're probably paying a few hundred dollars per month altogether. That's a minor cost for us; we're not currently hosting anything on cloud, so it's a small cost compared to hosting a solution. 

We ran into a few things where we had to pay more because of the number of concurrent building agents. We had capped it low and the developer was unhappy so we paid a little more to get what we needed and that's been good. I don't like it when you get a big bill and you don't know about it. 

What other advice do I have?

I'm somewhat critical of the documentation for certain things, but overall, the documentation is really good. In general, Microsoft is really good at documentation. It's worth taking a few hours to read it and then you'll know a little about how Access works. If you set up a sandbox, you're not going to destroy anything and you'll learn by trying things out. I would still read the documentation and go in parallel so you can at least know enough and be aware that it's safe to get in there.

We are very heavy users in creating small projects and then sometimes deleting them because they weren't useful but I like that model. Create a little sandbox and go build. We have done our own workflows and they are always tested in a sandbox before going live. That would be my suggestion. 

I rate the solution eight out of 10.  

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
C# Developer at a financial services firm with 51-200 employees
Real User
The nice thing about it is its modular design
Pros and Cons
  • "The nice thing about Visual Studio Code is that it's a modular design. So if you're working on a strange language that has a different syntax, you can just get a plugin that'll format your code for you based on the language it's in."
  • "Microsoft could improve Visual Studio by making it easier to find the plugins you need to get your job done. Maybe they could implement an AI search instead of a simple tech search. Sometimes, people come up with a catchy name for something, and you don't know how it's spelled. For example, a developer might come up with a packet wizard and spell weird, like P-A-K-I-T."

What is most valuable?

The plugins are the biggest thing. I like how Visual Studio is designed as a shell application, and then the plugins make it do what you want it to do.

What needs improvement?

Microsoft could improve Visual Studio by making it easier to find the plugins you need to get your job done. Maybe they could implement an AI search instead of a simple tech search. Sometimes, people come up with a catchy name for something, and you don't know how it's spelled. For example, a developer might come up with a packet wizard and spell weird, like P-A-K-I-T.

For how long have I used the solution?

I've been working with Microsoft Visual Studio since it first came out in 1997, so about 24 years.

What do I think about the stability of the solution?

Visual Studio is very stable.

What do I think about the scalability of the solution?

I don't think scale applies to Visual Studio because it's a developer tool. And I haven't had a lot of experience with massive projects where multiple teams are working on the same source code. I've only worked on a team of a few people.

How are customer service and support?

I think support is probably pretty decent, but I've never had to use it. I just look at Visual Studio's source code to troubleshoot it. 

How was the initial setup?

The setup is pretty straightforward. Visual Studio runs pretty fast.

What other advice do I have?

I'd say Visual Studio is a nine out of 10. If you're thinking about adopting Visual Studio, research the kind of functionality you need. The nice thing about Visual Studio Code is that it's a modular design. So if you're working on a strange language that has a different syntax, you can just get a plugin that'll format your code for you based on the language it's in.

Which deployment model are you using for this solution?

On-premises
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user
Cloud Solution Architect at a tech services company with 201-500 employees
Reseller
Easy to set up, allows for third-party extensions, and is pretty scalable
Pros and Cons
  • "It is possible to add third-party extensions to increase the usability of the product."
  • "Some things like project management, tasks, progress, and having work progress views require us to use some external tools, or to create our own internal tools. These are not native to DevOps. It would be ideal if, instead of searching for third-party solutions, they had these feature sets or capabilities included under DevOps."

What is our primary use case?

We primarily use the solution for our internal development and we have some clients that require some consulting around some DevOps functionality.

We use the product for the development process for the repository, for the tracking of the tasks in the boards, and for the pipeline for CINCD.

What is most valuable?

The test plan is one feature that we are exploring more right now. This is a great feature that we want to deeper into.

We have a solid base. We can do everything with DevOps.

It is possible to add third-party extensions to increase the usability of the product.

The initial setup is very simple. 

We have found the solution to be scalable.

The solution, for the most part, is stable. 

What needs improvement?

Some things, like project management, tasks, progress, and having work progress views, require us to use some external tools or to create our own internal tools. These are not native to DevOps. It would be ideal if, instead of searching for third-party solutions, they had these feature sets or capabilities included under DevOps. They need to expand the solution's offering.

For how long have I used the solution?

While I have used the solution for two years, the company has some personnel that have used it for longer. Our development team may have used it for four or five years. 

What do I think about the stability of the solution?

The product is stable. We had some regional degradations a few months ago, however, it wasn't too much. For the most part, it's reliable and there aren't bugs or glitches. 

What do I think about the scalability of the solution?

The solution is scalable. If we need to expand it we can do so. 

How are customer service and support?

We've never had to contact technical support. I cannot speak to how helpful or responsive they would be, as I've never dealt with them directly. 

How was the initial setup?

The initial setup is very simple and straightforward. It is not difficult or complex. 

We use the online version. We don't have to deploy the tool. We don't have to put in a lot of effort as we already have the pipelines in the TFS. We just move it to Azure DevOps. 

Which other solutions did I evaluate?

I'm a solution provider. I sell Azure DevOps and I have a client that was looking to analyze some differences between Jira and Azure DevOps. Therefore, I have evaluated Jira a bit for them.

What other advice do I have?

We are both a reseller and a partner of Microsoft.

We always use the latest version of the solution. 

I would recommend this product to other companies and users. If a company or a team doesn't know how to work with Azure DevOps, the advice I would give is to find someone that knows the tool and do a POC first to make sure you understand everything a bit better before diving right in. 

In general, I would rate the solution at an eight out of ten.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: My company has a business relationship with this vendor other than being a customer:
PeerSpot user
Process Manager at a marketing services firm with 501-1,000 employees
Real User
User-friendly, good performance, has good support, and connects well with PowerBI
Pros and Cons
  • "We are able to generate many different types of reports from Azure."
  • "There are certain features, and reporting that can only be used in PowerBI, but not directly in DevOps."

What is our primary use case?

We use this solution for project management and delivery.

What is most valuable?

It is easy to use.

We are able to generate many different types of reports from Azure. It connects well to PowerBI. 

The performance is good.

What needs improvement?

They could have more reporting features added to the dashboard. There are certain features, and reporting that can only be used in PowerBI, but not directly in DevOps. 

We would like to have the same calculated reports that can be accessed in PowerBI, available in Microsoft Azure DevOps. 

For how long have I used the solution?

We have been using Microsoft Azure DevOps for the last two and a half years.

What do I think about the stability of the solution?

Microsoft Azure DevOps is a stable product.

What do I think about the scalability of the solution?

It is easy to scale. We have approximately 250 employees in our organization who use this solution.

How are customer service and technical support?

We have contacted technical support. They provided us with a fast resolution.

Which solution did I use previously and why did I switch?

We are using Azure, and TFS now. We are also planning to migrate to AWS as well.

How was the initial setup?

The installation was easy.

We have an IT team of four to manage and deploy this solution.

What other advice do I have?

I would definitely recommend this solution to others who are interested in using it.

I would rate Microsoft Azure DevOps an eight out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Manager of Information Technology Services at a government with 501-1,000 employees
Real User
Has tight integration to project management, development, repository, deployment
Pros and Cons
  • "Most developers and project managers choose the Microsoft tools to begin with because of familiarity, and these new tools are almost an extension of the tools you're already familiar with. There's a lot of knowledge transfer, which helps, rather than bringing in a new product line."
  • "Right now, they tend to have a limit of 1,000 tasks per sprint, and some of their web-based boards, such as the Kanban boards, no longer display tasks. Once you hit over a certain number of task limits, you need to increase those limits."

How has it helped my organization?

All the artifacts are tightly integrated into the repository where you have changed tracking, and you can enforce policies. You can improve the quality of your deliverables. You can actually see the progress you're making towards your goal, and you can even forecast how soon a feature can be completed in the future. So, it's that tight integration of bringing all the parties together right from the project managers to the developers, to the system admin who does the deployment that helps achieve the goal of DevOps. That is, the ease of realization of this DevOps ideal is possible.

What is most valuable?

Most developers and project managers choose the Microsoft tools to begin with because of familiarity, and these new tools are almost an extension of the tools you're already familiar with. There's a lot of knowledge transfer, which helps, rather than bringing in a new product line.

Also, with Azure DevOps there is tight integration to Excel and Office tools so that you can actually even use Excel to do Azure DevOps type tasks. Excel will automatically update the Azure board, your tasks, your company boards, etc. So, there is that condition and familiarity for users.

What I like about it mostly is the tools. You don't need a degree to use them. Also, there's not too heavy a reliance on the CLI.

What needs improvement?

Right now, they tend to have a limit of 1,000 tasks per sprint, and some of their web-based boards, such as the Kanban boards, no longer display tasks. Once you hit over a certain number of task limits, you need to increase those limits. Depending on how big the sprints you're running are, once you hit that 1,000 limit, you now have to start grouping tasks together. It doesn't allow you to track granularly. When you go to the boards and you are rendering the task board, it gets slower to go over that 1,000 limit. If they could improve that to, maybe, 10,000 and still have good performance, that'd be great.

For how long have I used the solution?

I've been using it for eight years.

The version we use right now is the 2020 version, but usually, we try and keep within the last two versions.

Depending on the organization, it can be deployed on-premises or as a cloud solution, usually with Microsoft Azure as the cloud provider.

What do I think about the stability of the solution?

It's very, very stable.

What do I think about the scalability of the solution?

I've used it in organizations with multiple departments using the same installation, and it's scalable. We have about 20 users in multiple departments.

How are customer service and technical support?

Microsoft support is excellent. Even when you don't have support for some lines, you can call them, and a lot of times, they'll give you what's called a grace case. This means that although you don't have a support contract on a product, they'll help you for free.

Normally, when you call and don't have a support agreement, Microsoft will still charge you an hourly rate to give you an engineer to work with you.

Which solution did I use previously and why did I switch?

Microsoft Azure DevOps just provides better integration than Jenkins does. I've been in this industry for 27 years. The whole ecosystem and the fact that most of the developers are already using Visual Studio make Microsoft Azure DevOps a good option, along with the entire integration from the project management side, to the development side, to the repository side, and to the deployment side.

How was the initial setup?

Installing Microsoft Azure DevOps is straightforward. You can have everything set up in three or four hours. It's pretty simple.

Which other solutions did I evaluate?

I've used Jenkins in the past and a group of source repository. I've also used SourceSafe and GitLab.

What other advice do I have?

To run it, to use the tool the way it's designed, you need someone who understands Scrum or Agile project management.

I have used GitLab and other pipeline tools like Jenkins. Azure DevOps combines all of them together, and it beats all of them at everything they do.

On a scale from one to ten, I would rate this solution at nine and advise others to go for it.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Consultant at a computer software company with 11-50 employees
Consultant
Reliable, easy to setup, and feature-rich but there should be better integration with GitHub
Pros and Cons
  • "I definitely like the pipelines and the ease of management once you're in an enterprise."
  • "Definitely, there should be more integration between GitHub and Azure DevOps."

What is our primary use case?

I work as a DevOps Engineer. I use this solution as an end-user.

What is most valuable?

I definitely like the pipelines and the ease of management once you're in an enterprise. 

The controlling security, the ease of access, the free plans, and the developer plans.

I also like the licensing structure in general.

What needs improvement?

I would like there to be more seamless integration with GitHub. 

Azure DevOps seems to be targeted towards enterprises and GitHub is the ugly sister, so to speak, that you come about in the enterprise. 

There is no real interaction between the products, which is a real shame since they are both developed by Microsoft. 

Definitely, there should be more integration between GitHub and Azure DevOps.

For how long have I used the solution?

I have been working with Microsoft Azure DevOps for a couple of years, ever since they changed their name from Visual Studio Team Services.

What do I think about the stability of the solution?

Microsoft Azure DevOps is definitely stable.

Which solution did I use previously and why did I switch?

I have experience with Azure Bicep and Paraform.

How was the initial setup?

The initial setup is quite easy.

What's my experience with pricing, setup cost, and licensing?

The licensing structure is good.

What other advice do I have?

Definitely, I would recommend this solution. I would still look into your team goals and what tools you already know. 

GitHub is more community-driven, with more modules that are easy to access. 

Azure DevOps is more integrated with Azure as a platform, and that is important to consider when you consider DevOps in general or Azure DevOps.

I would rate this solution a seven out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
National Solutions Architect at a computer software company with 10,001+ employees
Real User
Good automation, perfect for agile approaches, and very scalable
Pros and Cons
  • "There are great automation tools."
  • "With Microsoft, I would prefer to have more test plans. It's very difficult to find individual test plan module training."

What is our primary use case?

I primarily use the solution for more of an end-to-end pipeline. 

What is most valuable?

The integration with the full end-to-end suite is great. The integration between the Kanban all the way through, including the traceability all the way through to the other end is very useful. You're able to test and you have your repositories and the ability to integrate with pipelines. 

There are great automation tools. 

The solution is very stable.

The scalability is quite good.

What needs improvement?

Individually, the components and not quite as good as others in the market. For example, the DevOps test plan isn't quite as good as a Micro Focus ALM QC. That said, when you integrate it into that entire pipeline, it's better.

Microsoft initiates changes so quickly, it's hard to keep up. It would be helpful if there was more documentation and more training to go with all of the changes. Chris:

With Microsoft, I would prefer to have more test plans. It's very difficult to find individual test plan module training.

What do I think about the stability of the solution?

The solution is quite stable. It's pretty reliable. there aren't bugs or glitches. It doesn't crash or freeze. 

What do I think about the scalability of the solution?

The solution is very scalable. It's easy to expand.

How are customer service and technical support?

I've had no problems with technical support, however, I'll get put in the fast-track programs. I always get very fast responses. 

Which solution did I use previously and why did I switch?

I also use Micro Focus. For older style waterfall projects, it's best to go with Micro Focus probably, barring pricing and other consideration. However, in an agile environment, a Microsoft Azure-based product such as DevOps is great due to the pipeline and the whole integration end-to-end is just better.

I'm also familiar with Jira, which has better features in various areas. The problem is it moves so fast and new versions are always coming out and it can be hard to keep up.

What other advice do I have?

I'm an implementor. I work with a variety of clients. 

I'd rate the solution at a nine out of ten. It's great for agile and we've been pretty happy with it as an end-to-end solution. 

If you're moving into an agile CI/CD, DevOps is the way to go. If you're still thinking about old manual start testing, Micro Focus is probably the way to go. That said, more standalone manual testing is better supported by Micro Focus.

Disclosure: My company has a business relationship with this vendor other than being a customer: Implementor
PeerSpot user
Director of Development and Support at MEDICARE Planos de Saúde
Real User
Stable, integrates well, and good functionality
Pros and Cons
  • "Microsoft Azure DevOps integrates well with other components, such as Synapse, which is a data warehouse tool of Azure. It is a framework platform for BI and integrated with other tools, such as Power BI."
  • "The solution can improve by adding integration with on-premise tools. The only built-in repository options are GitHub and DevOps."

What is our primary use case?

We are using Microsoft Azure DevOps for the repository for Git.

We are migrating to the on-premise version of GitLab. We do not use any advanced tools. We are planning to do more with DevOps and are evaluating other tools to incorporate in our process of development.

What is most valuable?

We use the functionality of Git for our development. We do not use the other tools that are integrated into the DevOps. We use it because we have an enterprise agreement with Microsoft.

Microsoft Azure DevOps integrates well with other components, such as Synapse, which is a data warehouse tool of Azure. It is a framework platform for BI and integrated with other tools, such as Power BI.

For how long have I used the solution?

I have been using Microsoft Azure DevOps for approximately three years.

What do I think about the stability of the solution?

The solution is stable.

What's my experience with pricing, setup cost, and licensing?

There are other solutions available that are open source and free, such as GitLab.

Which other solutions did I evaluate?

We are switching from Microsoft Azure DevOps to GitLab because we have the infrastructure and we are migrating part of our service to on-premise which includes our VMs. We decided to install GitLab because it is open-source, free, we can install it in-house, and we have some members that have experience with that product. We are now starting to migrate some projects.

What other advice do I have?

I would recommend this solution to companies that use the incorporated services provided, it is very good to adapt as a DevOps tool.

I have not used the solution extensively enough to give the solution a higher rating.

I rate Microsoft Azure DevOps an eight out of ten.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Group Product Manager – Billing and Payments at MultiChoice Group
Real User
Reduces our delivery time for complex projects and is cost-effective and useful for agile delivery
Pros and Cons
  • "It is a really easy way to define all of the features that you need to deliver. You can link those features to epics and break them down into user stories. You can also assign the user stories into sprints for doing your product improvement planning."
  • "The tool has a logical link between epic feature, user story, and task, but when you try to generate a report to show the delivery progress against a feature, it is not easy. To see the percentage completion for a feature or progress of any delivery, it is not easy to draw a report."

What is our primary use case?

We are using it for feature delivery.

How has it helped my organization?

Before we started using Microsoft Azure DevOps, we didn't really have a mechanism for tracking delivery against a feature or feature delivery. It has really helped us in visualizing what we need to deliver and get consensus across cross-functional teams that it is the right thing to deliver.

It allows us to prioritize an organization-wide backlog, which has really reduced our delivery time for complex projects. In fact, we are in the middle of a transformation program. We managed to kick off the program in a month and start the delivery cycle within six weeks of conception. Before adopting this tool, it would have taken us three to six months.

What is most valuable?

It is a really easy way to define all of the features that you need to deliver. You can link those features to epics and break them down into user stories. You can also assign the user stories into sprints for doing your product improvement planning.

It is a really simple tool for prioritizing a backlog, assigning that backlog into sprints, and then tracking the delivery by using sprint capacity, points of time, the velocity of the sprint, etc. It is really useful for agile delivery.

What needs improvement?

There are a couple of things. The tool has a logical link between epic feature, user story, and task, but when you try to generate a report to show the delivery progress against a feature, it is not easy. To see the percentage completion for a feature or progress of any delivery, it is not easy to draw a report. 

It doesn't give you a high-level view of your roadmap for planning a roadmap for delivery and identifying how far you are on that delivery path. There should be the ability to create a product roadmap and then based on the delivery of the user stories, link to the features against that product. We should be able to roll up a view to see how have we progressed against our targets.

When you're accessing it via the web, it works nicely, but it doesn't work for a while if you're trying to access the board via a tablet or mobile device. A lot of the time, we just want to quickly update a task or check a delivery against a sprint by using an iPad or phone. It is not really user-friendly on those devices. It works very well on the laptop but not on other devices.

For how long have I used the solution?

I have been using this solution for 18 months.

What do I think about the stability of the solution?

We've had very few issues with Azure DevOps.

How are customer service and technical support?

There were no issues.

Which solution did I use previously and why did I switch?

We also use Sparx Systems Enterprise Architect. For business process modeling where you are linking different objects in the modeling domains, Sparx is the most appropriate tool. You cannot model business processes in Azure DevOps.

Azure DevOps is more appropriate as a delivery tool for building out the feature roadmap and defining user stories, tasks, features, etc. It is well suited for taking the data and building it into a delivery pipeline. These two tools don't speak well together. A solution was developed to integrate these two, but it doesn't work very well.

How was the initial setup?

It was super simple. We just needed a username and a password. The board was pre-setup by our administrator. In fact, we didn't even have to go through any real training, even though the training was available. It is really intuitive to use.

What's my experience with pricing, setup cost, and licensing?

Its pricing is reasonable for the number of features that you get and the functionality that you can utilize for the agile delivery, which is what we are using it for. I found it extremely cost-effective.

What other advice do I have?

I would rate Microsoft Azure DevOps an eight out of 10. It is the primary tool that we've been using. It works very well.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
IT Project Manager at a energy/utilities company with 10,001+ employees
Real User
Integrates well with other tools, and enables us to perform different functions within one tool
Pros and Cons
  • "I like the fact that there is built-in Power BI. Both are Microsoft tools. So, you can incorporate dashboard capabilities."
  • "The tool was developed for Agile project methodology, but I've noticed that there has also been a try to incorporate what is typically done in MS Project, which is for more sequential Waterfall projects. The problem with that is that it is half-baked for Waterfall projects. If you're going to do it, then either go all the way and allow us to use the tool for both or don't do it at all."

What is our primary use case?

It is used to manage our projects. We basically maintain what would be the equivalent of our project schedules for various projects. So, we capture or create user stories to identify elements that need to be accomplished for the delivery of a project and to track who is responsible for it and the level of effort. We aggregate that within the tool and report out to leadership about the status of when we anticipate completion.

We are using its latest version.

How has it helped my organization?

Its integration with different functions has been very helpful. Previously, we had Microsoft Project schedules, and we did our reporting by using Excel and PowerPoint presentations. We also did testing tracking in other tools, such as HP ALM. Our source code was on Teams Foundation Server. All that can now be done within DevOps, which is a huge benefit. Things that we used to do in different tools can now be done in one tool. 

What is most valuable?

I like the fact that there is built-in Power BI. Both are Microsoft tools. So, you can incorporate dashboard capabilities. 

I also like the integration with the other toolsets, such as Outlook and GitHub. You can do your testing and check your source code within the same tool. That's definitely something really good.

What needs improvement?

The tool was developed for Agile project methodology, but I've noticed that there has also been a try to incorporate what is typically done in MS Project, which is for more sequential Waterfall projects. The problem with that is that it is half-baked for Waterfall projects. If you're going to do it, then either go all the way and allow us to use the tool for both or don't do it at all.

One thing we had to customize ourselves was to create the critical path. You can't do your project dependencies within the tool. We tried using the tool for a Waterfall project, and we had to find a custom approach to do that because. There should be some functionality for the reporting and dependency tracking for the Waterfall projects.

For how long have I used the solution?

I have been working with this solution for two to three years.

What do I think about the stability of the solution?

So far, so good. It has definitely been sized appropriately for our use. We haven't had any issues with it.

What do I think about the scalability of the solution?

We've only been using it for about three years, and so far, it seems to be able to adapt to our growth. We're maturing into it. We're moving in the direction of using it more, and I feel confident that it'll scale appropriately.

We have at least a hundred people using the tool. There are different degrees of people who are using it. Some people are using it in the read mode or view mode to keep themselves informed of where things are. We have some project managers who actually use the tool, and then we have a couple of administrators. I'm one of the administrators for our program. I have a couple of vendor or partner folks who are also administrators. We also have a development team that does some customizations on the dashboard and the Power BI reports that we do. These are pretty much different roles or layers that we have.

We do grant developers access to be able to make their own updates within the tool. Typically, project managers or scrum masters do that, but we also have some team members who are on these projects and have enough understanding of how the tool works and how we're using it. They are able to do their own reporting and their own updates on their statuses.

In terms of plans to increase its usage, we're moving in that direction. Most of our projects are done in Microsoft waterfall project management schedules, but we are being encouraged to move over to more of an Agile approach on our project methodology. Our mandate is that if you're going to do anything Agile, use the DevOps tool.

How are customer service and technical support?

I have not interacted with them. We have a sort of layer for support. I have had to reach out to one of the three resources that we have. He is our true admin at the company who had to reach out to their support, but it has been seldom, at least from my experience.

Which solution did I use previously and why did I switch?

I used Jira while working with a vendor that we had here for one of our projects. They brought that tool from their practice. We were doing that because we had not yet moved to DevOps. After they rolled it out at the organization level, the mandate was to stop using Jira and switch over to Azure DevOps. There are a lot of benefits to Azure DevOps over Jira, but Jira is the one that has a lot of market share on that side.

How was the initial setup?

I wasn't involved in that, but I do know that, just like many tools, there is a learning curve that was associated with that. I have used Jira before, so I had more or less an understanding because it is very similar to Jira, but I know that for other people I work with, it was a completely new concept to use something like this.

For its maintenance, we have a small team. We have about three individuals who do the backend support. So, it is minimal. Obviously, if they have any escalations, then they do go to Microsoft, but we haven't had that happen. It was very minimal. There are plugins that are available to enhance kind of some capabilities of the tool. When we ask for that type of functionality, these three individuals have been able to implement plugins for us.

What other advice do I have?

It is an Agile tool. We were using the tool calling that we were Agile, but we were really doing things in the Waterfall methodology. It was our square peg in the round hole, and that's where I realized that we didn't have the capabilities in DevOps to use it as a Waterfall tool, which makes sense because Agile is a different approach. We've evolved since then, and now, we're doing a bit more Agile when we use the tool. So, a tool is just a tool. There has to be that thinking alignment. Otherwise, it is a square peg in a round hole, and it doesn't quite fit. Your organization and your team have to understand that. Just using the tool doesn't make you agile.

The only problem we had was when we rolled this out, we didn't realize how Waterfall we really were. So, I had to go back and have PMs create additional data elements for us to capture what we really wanted to capture to report in Waterfall. Dependencies weren't tracked, and we had to go back. It almost felt like we had to do rework, and people weren't too happy about that.

I haven't used its mobile device capabilities, but that's definitely something that I would hope to evaluate in the future. 

I would rate Microsoft Azure DevOps an eight out of 10. Overall, I'm pleased with the tool, but there is definitely some room for improvement.

Which deployment model are you using for this solution?

Private Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Software Engineer at Xylem
Real User
Top 20
Stable, straightforward to set up and easy to use
Pros and Cons
  • "The installation is very straightforward."
  • "The price could be lowered. It would be nice if it was cheaper."

What is our primary use case?

Currently, we are using it for the continuous integration and continuous deployment of the CI/CD pipeline available for our projects.

What is most valuable?

The solution is very useful.

It's very easy to use and easy to navigate. It's a simple product to navigate.

The product is very stable; it's being used by quite a few organizations. We find it quite reliable.

The scalability, for now, is good for what we need. 

The installation is very straightforward.

What needs improvement?

We haven't had too much time to really play with the solution and therefore it's difficult to really know if there's anything missing in terms of features. We need more time with it.

The price could be lowered. It would be nice if it was cheaper.

For how long have I used the solution?

I started using the solution a few months ago. It's been about a year or so. We have not used the product for that long just yet.

What do I think about the stability of the solution?

The product is quite stable. There are no bugs or glitches. It doesn't crash or freeze. It's quite reliable in terms of performance. 

What do I think about the scalability of the solution?

The solution is scalable, at least for our purposes. We haven't run into any issues.

We have about 1,000 users on the solution currently.

How are customer service and technical support?

The forums that are available to users are quite helpful and have a lot of information. It helps us troubleshoot very well. We don't usually call anyone directly.

Which solution did I use previously and why did I switch?

We did not use a different solution before using this product.

How was the initial setup?

The product is very straightforward to set up. 

The deployment is fast as well. It only took us about 10 to 15 minutes to have everything up and running. 

What about the implementation team?

I handled the installation myself. I did not need the assistance of a consultant or integrator. It was handled in-house.

What's my experience with pricing, setup cost, and licensing?

It would be nice if the licensing was a bit cheaper.

Our IT team looks after that aspect. I don't deal with tasks such as licensing and payments directly.

Which other solutions did I evaluate?

We did not evaluate other solutions before deciding on this product.

What other advice do I have?

I'd rate the solution at an eight out of ten. So far, we've been very pleased with its capabilities.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
CIO at i cloud seven
Real User
Beneficial reports, highly stable, and excellent technical support
Pros and Cons
  • "The reports have been most valuable. We have created some dashboards allowing us to be able to check our teams, their progress, and mission plans."
  • "Microsoft Azure DevOps could improve by providing better integration with other tools. It is very easy to integrate with Azure, but when you need to integrate with other solutions, such as Amazon Web Services, is difficult."

What is our primary use case?

We are using the tools in this solution mostly for planning our software projects by implementing Scrum. We use repositories, and create timelines for continuous deployments and integrations.

What is most valuable?

The reports have been most valuable. We have created some dashboards allowing us to be able to check our teams, their progress, and mission plans.

What needs improvement?

Microsoft Azure DevOps could improve by providing better integration with other tools. It is very easy to integrate with Azure, but when you need to integrate with other solutions, such as Amazon Web Services, is difficult.

For how long have I used the solution?

I have been using this solution within the past 12 months.

What do I think about the stability of the solution?

Microsoft Azure DevOps is highly stable.

How are customer service and technical support?

The support from Microsoft is great, if we need to solve some problems with Azure they are ready to help us. The support has been excellent.

Which solution did I use previously and why did I switch?

Previously we used Visual Studio but then we changed some of our repositories for our projects to the cloud and now we use Microsoft Azure DevOps.

How was the initial setup?

The solution is easy to install and it took us three months to implement. This includes the support for our teams and for them to come up with their strategy to manage our projects.

What other advice do I have?

My advice to others wanting to implement this solution is they need to think about their inter-process before moving to this kind of solution. In many cases, we start to configure some projects using the tools, but if we do not have our roadmap and do not define our goals, we cannot take full advantage of the tools. There should be a lot of planning before moving to the projects.

I rate Microsoft Azure DevOps a nine out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user
Technical Content Writer at a computer software company with 51-200 employees
Real User
Top 5Leaderboard
High performance, easy to use, and reliable
Pros and Cons
  • "The most valuable feature is the ease of use and performance."
  • "There could more integration with other platforms."

What is our primary use case?

The solution can be used for immutable infrastructure or for microservices.

What is most valuable?

The most valuable feature is the ease of use and performance.

What needs improvement?

There could more integration with other platforms.

For how long have I used the solution?

I have been using this solution for approximately two years.

What do I think about the stability of the solution?

I have found the stability good.

What do I think about the scalability of the solution?

We have approximately 20 people using the solution in my organization.

How are customer service and technical support?

The technical support from Microsoft is really good.

What's my experience with pricing, setup cost, and licensing?

We purchase the solution on an annual basis.

Which other solutions did I evaluate?

I have evaluated AWS.

What other advice do I have?

I would recommend this solution.

I rate Microsoft Azure DevOps an eight out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Director of R&D and Testing at a recreational facilities/services company with 1,001-5,000 employees
Real User
Good monitoring, good support, and good stability
Pros and Cons
  • "Monitoring is most valuable."
  • "Its interface could be more user-friendly. It could be simplified for users with no prior knowledge. There should also be better tutorials."

What is our primary use case?

We are using it for managing the teams and planning the screens and scope of work. We are also using it for building pipelines for automation of builds.

What is most valuable?

Monitoring is most valuable.

What needs improvement?

Its interface could be more user-friendly. It could be simplified for users with no prior knowledge. There should also be better tutorials.

What do I think about the stability of the solution?

It is stable.

How are customer service and technical support?

Their technical support is pretty good.

What about the implementation team?

Our IT department installs this solution.

What other advice do I have?

Before using this solution, I would advise getting somebody who really knows how to use this solution and learning about how to do customizations based on your organization's needs.

I would rate Microsoft Azure DevOps an eight out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Managing Director at a tech services company with 201-500 employees
Real User
Simple and easy to use for all our CI/CD automation needs
Pros and Cons
  • "The simplicity and ease of use are two features that we have found to be most valuable."
  • "The solution can be improved by having better integration with other cloud platforms."

What is our primary use case?

We use the solution for all our CI/CD automation needs.

What is most valuable?

The simplicity and ease of use are two features that we have found to be most valuable.

What needs improvement?

The solution can be improved by having better integration with other cloud platforms.

For how long have I used the solution?

We have been using Microsoft Azure DevOps for a couple of years.

What do I think about the stability of the solution?

The product is stable.

What do I think about the scalability of the solution?

The solution is scalable.

We have plans to increase usage so that it will be on an org-wide scale. We plan to go up from our present number of 100 users to 300.

How are customer service and technical support?

We've never had occasion to utilize technical support.

How was the initial setup?

As the solution is cloud-based, installation was not required.

What's my experience with pricing, setup cost, and licensing?

We pay a monthly license for Microsoft Azure DevOps.

What other advice do I have?

The solution is cloud-based.

There are 150 people using this product in our organization, only end-users. 

There are five people responsible for deployment and maintenance. Anyone who wishes can make use of the solution.

I would recommend this solution to others contemplating its use.  

I rate Microsoft Azure DevOps as an eight out of ten. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Delivery Lead - Agile Coach at a tech services company with 201-500 employees
Real User
Scalable, reliable, and useful continuous integration and deployment
Pros and Cons
  • "The most valuable features are continuous integration and deployment, and simplicity."
  • "The active directory password system needs some improvement because many times the password for the active directory expires before the set time."

What is our primary use case?

I am using the solution to create continuous integration and deployment agents on the server environments. We are also involved in some projects where we create user stories and features created on the solution.

What is most valuable?

The most valuable features are continuous integration and deployment, and simplicity.

What needs improvement?

The active directory password system needs some improvement because many times the password for the active directory expires before the set time. Additionally, in the beginning, when I get the repository and check in my code on the dashboard to see who made changes, it shows that another user made the change that did not. This could be fixed in a future release.

For how long have I used the solution?

 have been using the solution for three years.

What do I think about the stability of the solution?

The solution is stable.

What do I think about the scalability of the solution?

I have found the scalability of the solution to be good.

How are customer service and technical support?

I did not contact support but I was able to find all the information I needed on the internet.

How was the initial setup?

The installation is straightforward.

What's my experience with pricing, setup cost, and licensing?

There is a license for this solution.

What other advice do I have?

I have experience with other solutions and with this one, you can add many addons without any difficult configuration. It has all the code and related items together, it is a total package.

I highly recommend this solution to others.

I rate Microsoft Azure DevOps a nine out of ten.

Which deployment model are you using for this solution?

On-premises
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
CTO at Cantier Inc
Real User
We use it for all of our development activities, and it is a complete solution with good reliability and scalability
Pros and Cons
  • "You get a complete solution with Azure DevOps. You can do everything in one place, starting from requirement gathering until you release the product. It is a reliable, scalable, and handy product."
  • "Its testing features are limited and can be improved a little more. They should provide more options from the testing and build perspective. Currently, we have to use a third-party product for testing. It would be great if it has more than one testing tool."
  • "They have brought a lot of new collaboration features in the latest version. We haven't used those features, but they should continue to expand it more on the collaboration front so that two developers can look at the code and work at the same time. It will be helpful for working from home."
  • "Its UI can be easier and more customer-friendly. The UI can be improved from the project management and agile perspective."
  • "Its price can also be reduced. It would be great if they are a little bit more competitive in terms of pricing because many open-source products are currently available in the market."

What is our primary use case?

We are a product company, and we use Azure DevOps for product development. It is our backend platform, and we use it for all of our development activities.

What is most valuable?

You get a complete solution with Azure DevOps. You can do everything in one place, starting from requirement gathering until you release the product. It is a reliable, scalable, and handy product.

What needs improvement?

Its testing features are limited and can be improved a little more. They should provide more options from the testing and build perspective. Currently, we have to use a third-party product for testing. It would be great if it has more than one testing tool. 

They have brought a lot of new collaboration features in the latest version. We haven't used those features, but they should continue to expand it more on the collaboration front so that two developers can look at the code and work at the same time. It will be helpful for working from home.

Its UI can be easier and more customer-friendly. The UI can be improved from the project management and agile perspective.

Its price can also be reduced. It would be great if they are a little bit more competitive in terms of pricing because many open-source products are currently available in the market.

For how long have I used the solution?

I have been using DevOps within the last 12 months.

What do I think about the stability of the solution?

It is definitely a reliable solution. That's why we have been using it for quite some time.

What do I think about the scalability of the solution?

It is scalable. There are no issues in terms of scalability. Currently, we have around 100 users. Its usage will definitely increase because a lot of new projects are coming.

How are customer service and technical support?

When migrating from TFS to Azure DevOps, we didn't get great support and response from Microsoft.

How was the initial setup?

Its initial setup was a little complex for us. We had been using TFS for quite some time, and migration was a bit difficult for us. We didn't get great support and response from Microsoft. We had limited resources in terms of support, and that's why it took us longer to figure out how to migrate from TFS.

What's my experience with pricing, setup cost, and licensing?

It has an annual subscription. It can be cheaper for partners. Many open-source products are available in the market, and it would be great if they can be a little bit more competitive in terms of pricing. A lot of startups are looking for an open-source, free, or cheap solution. If they can accommodate such requirements, it will be good for the product in the long run.

What other advice do I have?

I would rate Microsoft Azure DevOps an eight out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Lead solution architect at a recreational facilities/services company with 10,001+ employees
Real User
Easy to use and very stable
Pros and Cons
  • "The product is easy to use and very stable."
  • "The ability to integrate Microsoft Azure DevOps with other platforms and Microsoft products can be improved."

What is our primary use case?

Broadly speaking, we use the product for .net websites, APIs, data integration, migration, data analysis, job orders, and workflows.

What needs improvement?

The ability to integrate Microsoft Azure DevOps with other platforms and Microsoft products can be improved. 

For how long have I used the solution?

We have been using Microsoft Azure DevOps for more than seven years.

What do I think about the stability of the solution?

The product is easy to use and very stable.

What do I think about the scalability of the solution?

The product is scalable.

How are customer service and technical support?

We feel our experience with technical support to be straightforward. They have responded to our requests for help or support in good time and make themselves available for questions.

How was the initial setup?

The installation of Microsoft Azure DevOps is straightforward. The steps are already in place and one only need follow them. We were able to handle this by ourselves.

The product is deployed to the cloud and we have five developers responsible for this. 

What other advice do I have?

We are using the latest version of the product.

Our organization has five people who are using it. 

We plan to continue to use Microsoft Azure DevOps because our development or our environment is one of Microsoft's.

My advice to someone considering implementing the product is that it is good. I work in a Microsoft school so this is the environment with which everyone is acquainted.

I would rate this solution a nine out of ten. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Application Architect at a manufacturing company with 10,001+ employees
Real User
A user-friendly DevOps server with a useful backlog item creation feature
Pros and Cons
  • "It's very user-friendly, and the documentation is good. The most valuable feature is backlog item creation, where we pick features and other things. The burndown chart created for projects to be maintained by the development teams is also useful."
  • "Integration and plugins for other tools could better. Like if you want to integrate the DevOps with other tools that are in the market. This could be for the engineering tools to check code quality, application security tools, and DevOps dashboard tools."

What is our primary use case?

We use Microsoft Azure DevOps to maintain our project. We create a project in a good DevOps, and then we add the backlog items. The product owner adds the backlog items, and then the development team. The repository is also built into that. We have a private Git report for the project. Under reports, we can create a repository for the big projects and maintain the source code. 

Developers can commit and make a full request. For example, configure Jenkins, reconfigure Jenkins with the repository credentials, and then use it for linking. We don't use the pipeline available to us, and we use Jenkins for CSC.

How has it helped my organization?

In our organization, Microsoft Azure DevOps helps senior leadership go in and check the project status and how much effort has been put in by the development team. They can also pick, choose, and add features to be used by the development team. It's like a backlog management tool that helps improve and support projects. 

What is most valuable?

It's very user-friendly, and the documentation is good. The most valuable feature is backlog item creation, where we pick features and other things. The burndown chart created for projects to be maintained by the development teams is also useful. 

What needs improvement?

Integration and plugins for other tools could better. Like if you want to integrate the DevOps with other tools that are in the market. This could be for the engineering tools to check code quality, application security tools, and DevOps dashboard tools. 

They could also make the implementation easier. The test plan also has basic features that are not user-friendly. It should also have integrations with test automation tools. We need a test plan, automation testing, and EA-based testing.

For how long have I used the solution?

We have been using Microsoft Azure DevOps for more than four years.

How are customer service and technical support?

We haven't got any issues with the technical support area.

How was the initial setup?

The initial setup is very straightforward. 

What's my experience with pricing, setup cost, and licensing?

Licensing cost per user is approximately $11 to $15. We have about 400 users, but not all are active. We have around 200 to 300 active users.

What other advice do I have?

I would recommend this solution to new users if it's a simple project. If you want JIRA, you'll need to have JIRA software for backlog management. 

On a scale from one to ten, I would give Microsoft Azure DevOps an eight.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Partner at a tech services company with 1-10 employees
Real User
Integrates seamlessly, good technical support, but lengthy implementation
Pros and Cons
  • "This solution works with other Microsoft solutions pretty easily. It was easy to integrate everything into all the other tools that we were using. It integrates very seamlessly."
  • "The installation time of this solution depends on the environment it is being implemented in. We had a couple of projects that took around two weeks of implementation. This included the whole integration of the DevOps and everything together."

What is our primary use case?

The company that we were working with was in development using a Microsoft platform. We used Azure to integrate the complete project management and DevOps work.

What is most valuable?

This solution works with other Microsoft solutions pretty easily. It was easy to integrate everything into all the other tools that we were using. It integrates very seamlessly.

What needs improvement?

I have not come across information for integrating this solution with others, such as ServiceNow. I am not sure if the integration would be straightforward to implement. There should be readily available information to accomplish these integrations.

For how long have I used the solution?

I have been using the solution for approximately two years.

What do I think about the scalability of the solution?

The project that we were using the solution for was a small implementation, I cannot fully comment on how scalable it is. I did not have enough data to comment if it was good. However, we did not have any issues.

How are customer service and technical support?

The customer support is good.

How was the initial setup?

The installation time of this solution depends on the environment it is being implemented in. We had a couple of projects that took around two weeks of implementation. This included the whole integration of the DevOps and everything together.

What about the implementation team?

We had an expert that did the implementation of the solution for us. He did not face any problems.

What's my experience with pricing, setup cost, and licensing?

There is a license for this solution.

What other advice do I have?

We plan to continue offering this product to our customers and I would recommend it.

I rate Microsoft Azure DevOps a seven out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user
Director of Strategy at a financial services firm with 1,001-5,000 employees
Real User
Easy to use, with good monitoring and tracking
Pros and Cons
  • "I like the tracking and that we can monitor our velocity."
  • "When converting to DevOps, it was difficult to map."

What is our primary use case?

We are an agile shop. We use it to build our sprints and for our user stories. We have everything aligned in epics and we track all of our requirements and our velocity.

What is most valuable?

We are still getting used to it and there is a lot that I haven't looked at yet. For me, at this early stage, the most valuable features are the basic functionality. This includes the ability to build and customize sprints.

I like the tracking and that we can monitor our velocity.

It took a bit longer to figure out, but now that we have, it's easy to use.

What needs improvement?

When converting to DevOps, it was difficult to map.

For how long have I used the solution?

I have been using Microsoft Azure DevOps since October 2020 when we converted from Jira to DevOps.

What do I think about the stability of the solution?

It's stable now that it is up and running. It was a steep learning curve, but not the fault of DevOps. We did not put together adequate training.

What do I think about the scalability of the solution?

Others in the company may have scaled this solution. I have not explored this area yet.

How are customer service and technical support?

I have not contacted technical support.

Which solution did I use previously and why did I switch?

Previously, we were using Jira. Now that DevOps is running, I find that for what I am doing, does the same things as Jira. The main difference is in naming convention and layout.

How was the initial setup?

I wasn't part of the conversion from Jira to DevOps but it was a painful process. We lost data, things didn't map. My Scrum Master who used it was not happy with the process.

What other advice do I have?

I would rate Microsoft Azure DevOps and eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Installation Engineer at a manufacturing company with 10,001+ employees
Real User
Stable, scalable, and good for source code control and task management
Pros and Cons
  • "Most of the features are very valuable for us, especially the source code control and task management."
  • "The main issue that I have is the connection speed. Sometimes, the response is too slow. I am based in Taiwan, and I am not sure if it is because of broadband or something else. Its initial configuration is also a little bit difficult."

What is our primary use case?

We are trying to move our entire DevOps cycle to Azure DevOps. It includes test management, source code control, and some parts of CSED.

It is deployed on the cloud, so we always have its latest version.

What is most valuable?

Most of the features are very valuable for us, especially the source code control and task management.

What needs improvement?

The main issue that I have is the connection speed. Sometimes, the response is too slow. I am based in Taiwan, and I am not sure if it is because of broadband or something else.

Its initial configuration is also a little bit difficult.

For how long have I used the solution?

I have been using this solution for almost one year.

What do I think about the stability of the solution?

It is stable.

What do I think about the scalability of the solution?

It is scalable. Currently, we have around ten users. We hope to increase its usage.

How are customer service and technical support?

I didn't have to get in touch with them. I didn't have any technical issues.

Which solution did I use previously and why did I switch?

We have used Jira and TFS. Microsoft Azure DevOps is very useful in terms of management. We are trained to be the users of the DevOps services, but with Jira and TFS, we also had to manage the server, which we didn't want. We wanted to eliminate this kind of effort and just wanted to publish our own developments without having to manage the server.

How was the initial setup?

It is a cloud solution, so there is no installation. Its initial configuration takes some time and is not very easy. 

What other advice do I have?

I would rate Microsoft Azure DevOps an eight out of ten.

Which deployment model are you using for this solution?

Public Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Especialista Devops at a tech services company with 201-500 employees
Real User
Easy to install, stable, and scalable with valuable Pipeline and Release features
Pros and Cons
  • "Azure Pipeline and Azure Release are most valuable. I use Azure DevOps through pipeline and release."
  • "It should have security features for scanning the code and checking it for vulnerability and security. Currently, I am using other tools for this. It should also have integration with other tools to improve security."

What is our primary use case?

I have many microservices, and I am using Azure DevOps to deploy my microservices and build a global platform for payments.

What is most valuable?

Azure Pipeline and Azure Release are most valuable. I use Azure DevOps through pipeline and release.

What needs improvement?

It should have security features for scanning the code and checking it for vulnerability and security. Currently, I am using other tools for this. It should also have integration with other tools to improve security.

For how long have I used the solution?

I have been using this solution for two years.

What do I think about the stability of the solution?

It is stable.

What do I think about the scalability of the solution?

It is scalable. Currently, we have 400 users, and they are DevOps engineers and developers.

How are customer service and technical support?

They have helped me with the problems. They are very good.

Which solution did I use previously and why did I switch?

I have only used Azure DevOps.

How was the initial setup?

It is very simple to install. Its deployment takes a very short time.

What other advice do I have?

I would recommend this solution. I like Azure DevOps.

I would rate Microsoft Azure DevOps a nine out of ten.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user
User at a tech services company
Real User
Highly functional, powerful capabilities, and scalable
Pros and Cons
  • "Some of the valuable features are the functionality and the wide range of capabilities."
  • "Not all companies use the same methodology which could limit the use of this solution."

What is our primary use case?

We implement this solution to those wanting to improve their processes to make their business function better.

What is most valuable?

Some of the valuable features are the functionality and the wide range of capabilities.

What needs improvement?

Not all companies use the same methodology which could limit the use of this solution.

For how long have I used the solution?

I have been using the solution for approximately two years.

What do I think about the stability of the solution?

The stability of the solution is great.

What do I think about the scalability of the solution?

I have found the scalability good. We have approximately four specialists and ten testers using the solution in our organization.

What other advice do I have?

I would recommend this solution to others if they have tools with Microsoft and the proper infrastructure because not all customers work with this methodology in the development team.

I rate Microsoft Azure DevOps a nine out of ten.

Which deployment model are you using for this solution?

Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Technical Director at a transportation company with 10,001+ employees
Real User
Allows us to easily build and deploy applications
Pros and Cons
  • "Overall, so far we have no major issues to report."
  • "I think that the integration is to some extent, immature."

What is our primary use case?

We use this solution for continuous integration. It provides us with strategic analysis. We use it to create and deploy virtual machines. In short, we mainly use it for integration and deployment.

Currently, there are five to ten of us working on conception. Soon, there will be more than 200 of us using this solution. 

What is most valuable?

The most interesting subject for me is the deployment part where you build virtual machines and enable them to learn. That's interesting to me.

What needs improvement?

As I'm in the very early stages of this story, this is a hard question for me to answer. However, I think that the integration is to some extent, immature.

Overall, so far we have no major issues to report. 

For how long have I used the solution?

I have been evaluating this solution for roughly six to eight months. 

How was the initial setup?

The initial setup was quite straightforward.

What's my experience with pricing, setup cost, and licensing?

The licensing costs are reasonable. 

Which other solutions did I evaluate?

We also evaluated GitHub and GitLab. We actually have one deployment that is already ongoing in GitLab. 

Currently, we're evaluating both GitLab and Microsoft. We're trying to get a sense of which one is better for us. 

What other advice do I have?

Overall, I would give this solution a rating of eight out of ten. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
System engineering project Manager at a healthcare company with 51-200 employees
Real User
Good testing, helpful tracking dashboard activity, and test execution
Pros and Cons
  • "I really like the Microsoft DevOps survey."
  • "I would like to see DevOps have the ability to give us something with a compatibility or traceability matrix."

What is our primary use case?

I am familiar with the VSTS environment, grading tests, plan, and tracking dashboard activity.

In my previous company, we used this solution to create test cases, test reports, test execution, task boards, and we use the dashboard for the product activity.

What is most valuable?

I really like the Microsoft DevOps survey.

What needs improvement?

I would like to see DevOps have the ability to give us something with a compatibility or traceability matrix.

I have never seen a table or a Matrix in DevOps for traceability for either software or hardware upgrades. I am not aware of whether the website has these capabilities.

I had planned to recommend this product to my current company but the traceability is missing and could not consider it.

For how long have I used the solution?

I have been using this solution for three or four years.

What do I think about the stability of the solution?

It has some bugs that we reported and they have been fixed, which is good.

What other advice do I have?

I would rate Microsoft Azure DevOps a nine out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Software & Cyber Section Manager at a aerospace/defense firm with 5,001-10,000 employees
Real User
Integrates will with Git and other Microsoft products and scales well
Pros and Cons
  • "Microsoft has good integration with its other products, such as Office, Teams, et cetera."
  • "We would like some bidirectional synchronization. It's the requirement if you want to analyze it to software requirements, et cetera. That's something that most of the tools aren't that good at."

What is our primary use case?

In the first years, we had the solution, we did not use it for all of its models - not for the full life cycle. Now, within the past year or year and a half, we wanted to make the best out of it. We now use all the models and all the development lifecycle.

What is most valuable?

The product has integrated all the relevant models of task management requirements, source control, back management, test management, et cetera. You have a full ALM suite.

The connection to Git, which was bought by Microsoft, is also good. We use Git as a version control tool. 

Microsoft has good integration with its other products, such as Office, Teams, et cetera. 

The solution has proven itself to be very mature and robust. It's quite stable.

The scalability potential is very good. 

What needs improvement?

I'm not sure if "missing" is the right phrase, however, I am interested in, with all of these tools, if the connection to requirements management tools like DCRM, DOORS, et cetera, would be possible. That's a weak spot in most of the vendors.

We would like some bidirectional synchronization. It's the requirement if you want to analyze it to software requirements, et cetera. That's something that most of the tools aren't that good at.

For how long have I used the solution?

I've been using the solution for around three or four years at this point. It's been a while.

What do I think about the stability of the solution?

The product is mature and robust and quite stable. I haven't experienced any problems at all with it. It doesn't crash or freeze. It doesn't seem to have bugs or glitches that affect it. We have the support in-house on servers and we haven't had any problems with defining collections for example.

What do I think about the scalability of the solution?

It is my understanding that the solution is very stable. As an example, our organization has many teams and many departments and we use it across them all the time with no problem. We started using it originally when we had several teams, and now we have tens of teams, and it scaled up to meet our needs and we haven't had any issue with doing so.

Which solution did I use previously and why did I switch?

We also use Jira. I myself do not use Jira, however, it is used by other teams and colleagues within our organization.

How was the initial setup?

I can't speak to the implementation process, as our IT handled it. I was not a part of the initial setup. I can't speak to if it was complex or straightforward, or how long it took to set up.

Which other solutions did I evaluate?

We are currently evaluating both Jira and DevOps against each other. We use both in several development units. Lately, I've been looking for some comparisons and reviews, and material regarding those platforms and the comparison between them. I'm wondering to myself whether it's good for our company to have both, or to choose one of them to be the standard platform of our company. That's the main subject that I'm interested in.

What other advice do I have?

We are customers and end-users. We don't have a business relationship with Microsoft.

I'm a manager, and therefore I don't personally use it on a daily basis anymore, however, I manage teams that work directly with the product.

I'd rate the solution at an eight out of ten. If I compare it against other products, it holds its own. It's quite a good solution overall and we've been happy with its capabilities.

I would recommend it to other organizations or companies. I'd advise them, however, to use the source control and to wisely choose which kind of collection they want to set up and configure. It's something very important that will set a company up for success. 

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Data Base Administrator at a tech services company with 51-200 employees
Real User
Stable, scalable with good cloud infrastructure, and good support
Pros and Cons
  • "I like the cloud infrastructure of Microsoft Azure DevOps."
  • "I would like to see new features added."

What is our primary use case?

We use this solution for cloud administration, cloud infrastructure, the database, as an application server, development, and more.

What is most valuable?

I like the cloud infrastructure of Microsoft Azure DevOps.

What needs improvement?

I would like to see new features added.

For how long have I used the solution?

My corporation is currently using this solution.

What do I think about the stability of the solution?

I have had no issues with the stability of this solution.

What do I think about the scalability of the solution?

Scalability-wise, I have not had any problems.

How are customer service and technical support?

Everything is fine with our internal customers and our corporation.

Technical support is good.

What's my experience with pricing, setup cost, and licensing?

I don't have a problem with the pricing.

What other advice do I have?

I would rate Microsoft Azure DevOps a ten out of ten.

Which deployment model are you using for this solution?

Hybrid Cloud
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
XBRL Specialist at a financial services firm with 1,001-5,000 employees
Real User
Very stable and provides a nice and integrated environment for working in teams and implementing the DevOps philosophy
Pros and Cons
  • "It is easy to use. The shared repository is useful. Everything is in one environment."
  • "It is not that intuitive. Sometimes, it is hard to find some of the functions. I would like to have an old-fashioned menu structure to be able to easily find things. Its environment setup is not very good. They should improve the way it is set up for different screens and make it easier to find functionalities and maintain team members."

What is our primary use case?

I am using it as a developer in the agile scrum area.

How has it helped my organization?

It has improved the team cooperation for building, developing, and releasing systems.

What is most valuable?

It is easy to use. The shared repository is useful. Everything is in one environment.

What needs improvement?

It is not that intuitive. Sometimes, it is hard to find some of the functions. I would like to have an old-fashioned menu structure to be able to easily find things. Its environment setup is not very good. They should improve the way it is set up for different screens and make it easier to find functionalities and maintain team members.

For how long have I used the solution?

I have been using this solution for one and a half years.

What do I think about the stability of the solution?

It is very stable. If it doesn't work, it is usually because of network issues.

How are customer service and technical support?

I didn't need support from Microsoft. Any need for support was internally fulfilled by my colleagues.

What other advice do I have?

I would recommend this solution. It is a nice environment for working in teams and implementing the DevOps philosophy. It provides good support for that.

I would rate Microsoft Azure DevOps an eight out of ten.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Support Level 3 for the Finance systems at World Vision International
Real User
Functional user interface, with good support and pricing
Pros and Cons
  • "One of the main features is the user interface is very good."
  • "The user management in the solution could improve."

What is our primary use case?

We use the solution for performance testing in general.

What is most valuable?

One of the main features is the user interface is very good.

What needs improvement?

The user management in the solution could improve.

For how long have I used the solution?

I have been using it for four years.

How are customer service and technical support?

The support for this solution has been fine.

What's my experience with pricing, setup cost, and licensing?

The price is reasonable for the solution.

What other advice do I have?

I rate Microsoft Azure DevOps a nine out of ten.

Which deployment model are you using for this solution?

Public Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Amazon Web Services (AWS)
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Assurance Manager at a energy/utilities company with 5,001-10,000 employees
Real User
Robust functionality, good integration, continually enhanced, and easy to scale
Pros and Cons
  • "They have been lately adding features to the services on a regular basis. Every two weeks, they are adding functionality to Azure DevOps Services to match it with what Azure DevOps Server or on-prem would offer. So, we continue to get more robust functionality. My favorite right now is that they are starting to open up the API availability within Azure DevOps Services. Another thing that I like about Azure DevOps is that you can use it with any of the products that are on the market. You can integrate it with Jenkins and other open-source products to complete that fully functional CI, CD, CT, CM, and CS pipeline. It continues to enhance."
  • "We are currently in the process of moving all of our on-prem to the cloud platform. We are trying to make that move and host the majority of our DevOps services in the cloud because the cloud is where most of the things are going nowadays. However, the process of this transfer is not straightforward, and it could be a lot easier. Microsoft hasn't provided the maturity for migration tools. It could be a lot easier in that respect. I want to see them continue to advance the API capabilities. They could add some more robust functionality to the administrative layer within ADO services. There are a lot of configuration elements that you need to take care of at the organization level and the project configuration level from an administrative capacity. When you're dealing with process templates and things of that nature, you have to do them all manually. Being able to automate some of that using scripts or API functionality would be really nice."

What is our primary use case?

We're doing a full continuous integration (CI), continuous delivery (CD), continuous testing (CT), security, delivery, and monitoring.

We're currently using TFS 2013, TFS 2017, Azure DevOps Server 2019 update one, and Azure DevOps services, which is the SaaS cloud platform. I manage all of these.

It is deployed on Azure DevOps Server and Azure Services' private cloud.

What is most valuable?

They have been lately adding features to the services on a regular basis. Every two weeks, they are adding functionality to Azure DevOps Services to match it with what Azure DevOps Server or on-prem would offer. So, we continue to get more robust functionality.

My favorite right now is that they are starting to open up the API availability within Azure DevOps Services. 

Another thing that I like about Azure DevOps is that you can use it with any of the products that are on the market. You can integrate it with Jenkins and other open-source products to complete that fully functional CI, CD, CT, CM, and CS pipeline. It continues to enhance. 

What needs improvement?

We are currently in the process of moving all of our on-prem to the cloud platform. We are trying to make that move and host the majority of our DevOps services in the cloud because the cloud is where most of the things are going nowadays. However, the process of this transfer is not straightforward, and it could be a lot easier. Microsoft hasn't provided the maturity for migration tools. It could be a lot easier in that respect.

I want to see them continue to advance the API capabilities. They could add some more robust functionality to the administrative layer within ADO services. There are a lot of configuration elements that you need to take care of at the organization level and the project configuration level from an administrative capacity. When you're dealing with process templates and things of that nature, you have to do them all manually. Being able to automate some of that using scripts or API functionality would be really nice.

For how long have I used the solution?

I have been using this solution for about nine years.

What do I think about the stability of the solution?

It has actually been pretty stable. Some of the early gen ones were not so stable. Before Microsoft started communicating with the end-users, they would make changes in the middle of the workday, which was a bit frustrating because things would change, which would impact the end customers because they weren't expecting that change. Microsoft wouldn't communicate with tenant administrators and tenant owners, but now, Microsoft has gotten a lot better about articulating their roadmap and communicating when those kinds of changes are coming down the pipeline. We are now able to communicate that out to our tenants and the end-users working within our projects. There is a lot better communication in that respect, which makes it easier for us to make customers aware of what might be coming, what is going to cause changes for them, what are the timeframes in which those things are going to hit their views, and what to expect from those things and additional functionalities.

What do I think about the scalability of the solution?

For the cloud, it has been really good. For on-prem too, it is easy enough to scale out. TFS also has always been pretty easy to scale out.

In terms of the number of users, currently, we're in a transition because we were just acquired by another company. So, we're leaving our parent company, and we're going to a new company. The numbers that I have are in flux. Our current numbers are at about 600 for just our existing or old company. I've been asked to stop onboarding my users and projects until we move our current organization into our new operational tenant in the new company, but I'm projecting that we'll have between 2,000 to 4,000 people.

How are customer service and technical support?

I use it all the time. They're very good when you get to the right queue. So, when it is working, it is great. I would rate them a nine and a half out of ten because I always think people have room for improvement, but they've been very good and supportive.

It works great for us especially now because we've kind of been divested from our old company to our new company. When we were with our old company, it was a little bit mired because of the way our enterprise architecture was. My requests didn't go to a North American team. It went to an EU team, and then I had to work within EU hours to get support, whereas I am in North America. That was a little tricky. Our old parent company was parented in the UK, Ireland, and Scotland.

Which solution did I use previously and why did I switch?

I've used other solutions in tandem, and I have been an administrator for them. For example, I've used Jira and Confluence products, which is Atlassian. I've also used Remedy, but I'm not sure if they're still in the project management. I have also managed HP Performance Center and Tricentis. I've actually been administrating these for the last two years for this company.

I also use UCD, which is another very similar product. It does a lot of the same things and is also agnostic, just like Azure DevOps. You can use both of these with any of the products that are on the market.  

How was the initial setup?

It is pretty straightforward on the administrative side, but I've been working with this technology for a long time. It really falls in line with the majority of Microsoft products. If you're familiar with the Microsoft stack, it follows their pretty standard setup. You go through a similar process. It is just about knowing the nuances that Microsoft has when you're doing a farm configuration or a farm setup and the recommended prerequisites before you get started.

If we're talking about new end-users who are going from an older version of TFS to Azure DevOps Server or Azure DevOps Services, there is going to be a bit of a delta because the technology is different. There is a slight learning curve. Of course, it has got fancier bells and whistles and a jazzier user interface. It has softer edges and things have moved from left to right. Things that you found on the left side have again moved back over to the right side for administrative or usability functions. Your security elements and the things that you used to see on the left side have again switched back to the right side. These are the kinds of nuances about which you would need to educate your end-users. You need to get them used to the boards and how to use those. If your company is transitioning from a CMI model to an Agile model, it is going to be very important for the folks who are administrating your projects and your project managers to know how to configure the projects themselves, how to use Teams, and how to use permissions. Security becomes even more important because a lot of that really influences how you see the information within your project, and how you manage your boards, your sprints, and the work items that you allocate to your scrums or sprint users.

As you're going through different stages of your project, you have your pipelines and repos where your more development-centric users are going to be. I try to allocate out two different kinds of users that we're going to have and target them when I'm educating my folks. You have a kind of power user, and you have your regular contributor user. It is important to make this distinction because there are folks who are going to be doing basic or just regular contributor work. They will just contribute to the work items that are on a board or within a sprint. You're also going to have users who need to be slightly elevated, which is going to be that basic plus test plan. You need to understand how those affect your subscription and billing towards that subscription and how to manage that when they're not actively using it. You need to monitor this and enroll them back to a stakeholder so that you're not constantly incurring costs against your pay-as-you-go subscription costs. Everything is pay-as-you-go once you get into the cloud.

What other advice do I have?

I would ask those who are looking into implementing Microsoft Azure DevOps if they are already on the Microsoft stack of products. If they are, I would highly recommend them to use Azure DevOps Services or Azure DevOps, because they're already paying for that as part of their E-agreement. So, they should take full advantage of that because it is part of their licensing agreements. They should exploit what they're paying for because they are already paying a lot of money for Microsoft products.

Both UCD and ADO are the best products in the current DevOps space right now. They're both agnostic, and you can plug and play and integrate them with the majority of the tools in the market. You can integrate them with Jenkins and other open-source products, and open-source is where everything is going when you move to the cloud. Having that flexibility and viability within your company and business, no matter whether you're a small or large company, is a huge benefit. That will allow you to be flexible and deliver to on-prem or container.

Microsoft is extremely flexible, and they are listening to feedback and hearing what customers are saying. I've worked with Microsoft for almost 20 years now, but I took kind of a two-year sabbatical. Most of that time, I was developing out their SharePoint Online O365 platform. I stepped away for two years and then I transitioned over to DevOps because they really weren't taking feedback that was being provided by customers, and they were ignoring the customer experience, but their new CEO has kind of refocused Microsoft's outlook on the customer experience and is putting the priority back where it needs to be. They're doing a much better job in terms of incorporating feedback. They're continuing to advance and advent their product, and they are keeping ahead of and staying in touch with what technology is doing from a CI/CD pipeline perspective. This is why I am looking forward to continuing to use them.

I would rate Microsoft Azure DevOps a nine out of ten.

Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
PeerSpot user

This is a very popular and trusted site. They also have a strong customer support service and now the work is easier with this software. I am super happy.

Senior .NET Engineer at Advance Storage Products
Real User
Helpful in tracking issues and works extremely well in terms of the build time, but it is complicated and should provide the ability to write your own scripts
Pros and Cons
  • "The automated bill feature is most valuable. As with most software developers, I can build code on my machine, but if one of my coworkers can't build the same code on theirs, there are always issues in trying to track it down. The automated bill process makes it a lot easier to track down where the issues are and find out what bugs aren't being included for whatever reason."
  • "They should expand it from just a PC, software, or server development platform to other kinds of software or engineering systems so that it is not necessarily built around a normal PC with a server. I would like to see the ability to write my own scripts in my own compiled program or online. Right now, there are things that you can do in the user interface, but you can't do them programmatically and vice versa. I want to see them both. If I can do it in a script, I should be able to do it from the user interface, and if I can do it in the user interface, I should be able to do it in a script."

What is our primary use case?

We are using it for the source-code repository, automated bill process, very limited automated testing, and tracking trouble tickets or feature requests. We are using its latest version.

What is most valuable?

The automated bill feature is most valuable. As with most software developers, I can build code on my machine, but if one of my coworkers can't build the same code on theirs, there are always issues in trying to track it down. The automated bill process makes it a lot easier to track down where the issues are and find out what bugs aren't being included for whatever reason.

What needs improvement?

They should expand it from just a PC, software, or server development platform to other kinds of software or engineering systems so that it is not necessarily built around a normal PC with a server.

I would like to see the ability to write my own scripts in my own compiled program or online. Right now, there are things that you can do in the user interface, but you can't do them programmatically and vice versa. I want to see them both. If I can do it in a script, I should be able to do it from the user interface, and if I can do it in the user interface, I should be able to do it in a script.

For how long have I used the solution?

I have been using this solution for a total of four years.

What do I think about the stability of the solution?

From what we've used it for so far, I have not seen any problems.

What do I think about the scalability of the solution?

We're using perhaps 10% of what it is capable of doing. It is far more capable than what we are using right now. With further experimentation and training, I'll probably go from 10% utilization of its capabilities to about 50% or 60% in the next couple of months. We'll never use 100% of what it is capable of doing, but it should handle 95% of everything we need to do. We can always write our own plugins to handle the side things that we need.

Scalability is not really applicable with the code that we write, but the build times and things like that typically take under 15 seconds before we get our responses back. So, it works extremely well.

In terms of the number of users, there are six of us who are software developers. Some of the managers might also partially use the reporting capabilities.

How are customer service and technical support?

I haven't called them up.

Which solution did I use previously and why did I switch?

I've used JIRA and a number of different systems going back almost 20 years. We were doing our development using Microsoft tools, and it just made sense to use what they integrate with. Azure DevOps is the perfect environment because we're using Microsoft technology for other stuff. It is always going to have slight favoritism towards the other Microsoft tools.

How was the initial setup?

The basic setup works very quickly, but there are so many things and options.

What about the implementation team?

We did it ourselves, which is one of the problems. We don't know what we're doing.

What's my experience with pricing, setup cost, and licensing?

I don't know what we pay, but I do know what I've seen online. If we switched to JIRA, we will basically have to double our costs because we still have to pay for the DevOps licensing. We're probably spending $100 a month on it. It has only standard licensing fees.

What other advice do I have?

It is a really complicated product. All DevOps stuff is complicated. The advice that I would give to anybody doing DevOps is to have a goal in mind of what you want to do. Then the product will do what you wanted it to do. 

I would rate Microsoft Azure DevOps a four out of ten because I don't know it enough to rate it.

Which deployment model are you using for this solution?

Private Cloud

If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

Microsoft Azure
Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Software Architect at a mining and metals company with 10,001+ employees
Real User
Compatible with our entire ecosystem
Pros and Cons
  • "It's got something that you won't find in other products."
  • "With an ecosystem that has been up and running for some time, you won't have the full-flexibility that you would have with a new ecosystem."

What is our primary use case?

We use Microsoft Azure DevOps for application lifecycle management, including source control-related things, pipelines, and also for work item management. In short, the whole ecosystem.

Within our organization, there are roughly one thousand core developers using this solution. We also have stakeholders, product vendors, Scrum masters, testers, and manual testers. 

What is most valuable?

Mainly the source code solutions and the pipelines. Work item management and the manual test I/O. Test automation, end-to-end testing, and the manual test experience. It's got something that you won't find in other products. The work item management is good enough for small to medium-sized teams, and for large projects with plenty of teams collaborating with each other.

We can achieve the boundaries of the system. Potentially, we could do it with other tools like Jira. Still, with Microsoft Azure DevOps, we can manage everything.

What needs improvement?

Currently, if you would like to use the full-set of customization features, for example, the process templates, the HL process, or the Scrum process, if you start from scratch right now, you'll have these options. But if you've been working for several years in an established ecosystem, then you're based on an old-fashioned way of working and you won't be able to use the recent customization features.

There are options to get around this, especially if you move to the cloud or if you copy things and migrate them, but that's a huge amount of work. It's best if you start from scratch in a new project — in a new environment. With an ecosystem that has been up and running for some time, you won't have the full-flexibility that you would have with a new ecosystem.

For how long have I used the solution?

We have been using this solution for roughly 10 years. 

What do I think about the stability of the solution?

This solution is stable. I don't have anything negative to report. 

What do I think about the scalability of the solution?

Microsoft Azure DevOps is very scalable. It uses techniques from Microsoft itself, so if you have the knowledge of how to deal with that, you can scale it up and out as you wish.

How are customer service and technical support?

Technical support is good. We have had a few cases where we needed support and they contacted us immediately. There was a willingness to find a solution and determine if there was a bug or if it was an oversight. We have a good relationship with Mircosoft support.

How was the initial setup?

The initial setup is easy.

What's my experience with pricing, setup cost, and licensing?

Most of our developers have an MSDN license which is linked to the Visual Studio development environment. 

We also have a corporate license for other products like Windows Server — it's all included in one package. An additional license is not required for the on-premise solution. If you go to the cloud, it's a different story. Most of the things that we need and use are incorporated in the corporate solution — there are no additional costs.

What other advice do I have?

Overall, on a scale from one to ten, I would give this solution a rating of eight. 

It could be a little bit more flexible in terms of work item management. Apart from that, I can't really think of many features that are missing. It supports all kinds of ecosystems; there are a lot of possibilities when it comes to interacting with other ecosystems. 

Try to follow the market standards. There's a whole huge community that supports it. The market is evolving very fast. Microsoft is acquiring other companies. They recently bought GitHub. It's hard to say which solution will survive — DevOps or GitHub. That may be an issue in the future. 

Which deployment model are you using for this solution?

On-premises
Disclosure: My company has a business relationship with this vendor other than being a customer: partner
PeerSpot user
Project Manager at a computer software company with 11-50 employees
Real User
Straightforward to set up with good test cases but need more project tracking features
Pros and Cons
  • "The pricing seems to be reasonable."
  • "I would like to see a bit more project tracking."

What is our primary use case?

I'm using it for specifications of the requirements, for example, or a user for research specifications. I'm also using it to build up test cases right now.

What is most valuable?

Overall, the solution is pretty good. It fulfills most of our requirements.

The stories and test cases on offer are great.

The initial setup was pretty self-explanatory. It was straightforward.

The pricing seems to be reasonable.

What needs improvement?

The solution needs to add the capability for building live documents. 

I would like to see a bit more project tracking. There should be more Kanban views. There maybe should be a few more reports. If the reporting was increased a bit, it would make it so that you can check a bit more information around the progress of the project. That would help with project management and progression. 

For how long have I used the solution?

I've been using the solution about twice a week for the last few months. It hasn't been that long and it's not a daily occurrence. In total, it's maybe only been two or three months.

What do I think about the stability of the solution?

So far, I've found the solution to be quite stable. There are no bugs or glitches. It doesn't crash or freeze. It's quite reliable.

What do I think about the scalability of the solution?

We have about 3 people using the product currently in my company, and about 30 customers.

How are customer service and technical support?

I've never had to contact technical support. We haven't faced any issues that would require us to. Therefore, I have not idea how they would be. I can't speak to how knowledgeable or responsive they are. At this point, I have no insights to share.

Which solution did I use previously and why did I switch?

I have worked with other DevOps tools previously. I've worked with Jira and Polarion in the past. I haven't necessarily worked with them together or consecutively. It all depends on individual project requirements. 

That said, I am not using Polarion anymore.

How was the initial setup?

The initial setup was not overly complex. It was pretty straightforward. A company should have too much trouble with it.

What's my experience with pricing, setup cost, and licensing?

The pricing of the solution seems to be pretty good. It doesn't strike me as being too high.

What other advice do I have?

I'm just a customer and end-user. I don't have a business relationship with Microsoft.

Overall, I would rate the solution at a seven out of ten. It's been okay so far. We're satisfied with the solution overall.

Disclosure: I am a real user, and this review is based on my own experience and opinions.
PeerSpot user
Senior Support Analyst at ONS
Real User
An end-to-end DevOps toolchain for developing and deploying software
Pros and Cons
  • "Before using this solution, we had to deploy our applications, from pre-production to production, manually."

    What is our primary use case?

    We use Azure DevOps as a way to organize our development. As a means of facilitating application deployment from pre-production to production. We use it to organize our environment and identification systems. If you don't have the power or permission to do something, you can't do it. With Azure DevOps, we can create profiles that developers can use right away to go from pre-production to production.

    What is most valuable?

    Microsoft Azure DevOps is a very useful system. Before using this solution, we had to deploy our applications, from pre-production to production, manually.

    What needs improvement?

    We are entry-level users when it comes to Azure DevOps. We haven't had to set up anything complex as of yet. So far, we are very satisfied with this service.

    What do I think about the stability of the solution?

    This solution is very stable. On a scale from one to ten, stability-wise, I would give it a rating of nine.

    What do I think about the scalability of the solution?

    I've never had to scale it up or down, so I can't comment on that.

    How are customer service and technical support?

    If we experience any issues, I am not the one who contacts support. Other team members handle that.

    How was the initial setup?



    What about the implementation team?

    We had some hands-on help from Microsoft engineers with deployment, so for us, it was straightforward. 

    What other advice do I have?

    Overall, on a scale from one to ten, I would give this solution a rating of nine. If Microsoft Azure DevOps were more accessible in south Brazil, I would give it a rating of ten. Although, the reason for this may be due to the price.

    Which deployment model are you using for this solution?

    Hybrid Cloud
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Senior Project Manager at a computer software company with 5,001-10,000 employees
    Real User
    Interface simple, easy to learn workflows, and scalable
    Pros and Cons
    • "Some of the valuable features are the interface and the workflows are easy to learn and to manage."
    • "There are some areas that need improvement such as tracking."

    What is most valuable?

    Some of the valuable features are the interface and the workflows are easy to learn and to manage. It has all the features that are required on each account.

    What needs improvement?

    There are some areas that need improvement such as tracking. There is not anything major that needs to be improved in the future, just minor adjustments are needed. The solution works well.

    For how long have I used the solution?

    I have been using the solution for a few years.

    What do I think about the stability of the solution?

    The solution is stable.

    What do I think about the scalability of the solution?

    I have found the solution to be scalable, we have approximately 30 people using it.

    How are customer service and technical support?

    I have not used the support. However, you receive all the documentation with the solution needed.

    What other advice do I have?

    I would recommend this solution, it is a good tool to use.

    I rate Microsoft Azure DevOps an eight out of ten.

    Which deployment model are you using for this solution?

    Public Cloud
    Disclosure: My company has a business relationship with this vendor other than being a customer: partner
    PeerSpot user
    Senior Soft Engineer at SECP
    Real User
    Top 10
    A user-friendly Azure DevOps server with a great user interface, but the testing environment could be better.
    Pros and Cons
    • "It has a good GUI, and it's very user-friendly."
    • "The testing environment and different pipelining concepts can be improved."

    What is our primary use case?

    We are exploring this solution. There is not enough protection in the environment at the moment. It's been almost six months since we started the process of exploring the DevOps environment in Microsoft Azure DevOps.

    We have a customized development methodology so that it is easily marked to our existing environment. Currently, we required that all these systems blend easily in this one environment. We can actually use all the large frameworks within DevOps properly and automate most of our support, starting from planning through support to deployment.

    What is most valuable?

    It has a good GUI, and it's very user-friendly. It is also a familiar environment as we are used to it. All our users are very comfortable working with it. I think the Azure methodology and all those DevOps features in the dashboard are very effective in our environment. 

    It's very implementable in our environment compared to the other DevOps environments which we experienced. I won't name them, but this one part of DevOps we have found very easy in our environment because the infrastructure there is fairly supportive and very integrable to the current DevOps environment we use.

    What needs improvement?

    The testing environment and different pipelining concepts can be improved. It can also be more user-friendly. They can actually incorporate all those other features, current tools and have those mind maps.

    They could add some good analytic features. I think they can be more enriched with some good reporting features. They can also improve the designing tools.

    For how long have I used the solution?

    We have been using Microsoft Azure DevOps for about six months. 

    What do I think about the stability of the solution?

    Microsoft Azure DevOps is a stable product. I feel it's stable enough for us at the moment. 

    How was the initial setup?

    The initial setup is not overly complex. It's fairly straightforward. Other than the Java environment variables which lack documentation, it's not complex and easy to follow.

    What's my experience with pricing, setup cost, and licensing?

    The main agile features are very expensive.

    What other advice do I have?

    On a scale from one to ten, I would give Microsoft Azure DevOps a seven.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    President & CEO at Modern Requirements
    Real User
    Fully integrated, good testing and can act as a single source of proof, excellent support
    Pros and Cons
    • "The most valuable feature is that it's fully integrated, where we have a single place to do everything that we need."
    • "Requirements management is an area that can be improved."

    What is our primary use case?

    I used Azure DevOps for work item management, sprint planning, source code repository, continuous integration, continuous build, and continuous release. I build whole chains.

    What is most valuable?

    The most valuable feature is that it's fully integrated, where we have a single place to do everything that we need.

    Testing is really good, it has come a long way.

    It is the single source of proof or the single system of record that does everything you need, you don't have to put the different pieces together to form the whole chain.

    We can do everything in one single platform, which is why it does a good job.

    What needs improvement?

    Requirements management is an area that can be improved.

    Integration with Microsoft teams would be a good idea.

    For how long have I used the solution?

    I have been using Microsoft Azure DevOps for five years.

    What do I think about the stability of the solution?

    It's stable. It's been pretty good, especially in the last two years.

    What do I think about the scalability of the solution?

    There are no issues with scalability. We have approximately 50 people in our organization who are using it.

    How are customer service and technical support?

    We have contacted technical support and they are excellent. I would rate them a nine out of ten.

    Which solution did I use previously and why did I switch?

    I am using a mismatch of tools from HP and Atlassian, but they did not give us an integrated toolchain. Microsoft Azure does it exceptionally well.

    How was the initial setup?

    It is reasonably straightforward, but it is only as straightforward as the problems that you are trying to solve.

    If you are trying to set up the whole chain, then the problem is complex, and the solution has to be as equally complex.

    What's my experience with pricing, setup cost, and licensing?

    The price is reasonable, but of course, you can find others that are cheaper such as Atlassian. But, if you look at the more serious products like Polarion, it's very competitive. 

    If you have good Microsoft programs, it's nearly free.

    What other advice do I have?

    I would certainly recommend this product.

    There are a lot of parts to the toolchain for DevOps, so take each area at a time. My advice is to take one step at a time, don't overdo it, and over time build out all of the capacity difficulties. Automation is also one of the biggest things.

    Overall, it seems like a really good solution.

    I would rate it a ten out of ten.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
    PeerSpot user
    Product and Systems Director at SPCM
    Real User
    Top 5
    Great automation capabilities, allows for easy integration with other tools and is quite stable
    Pros and Cons
    • "The initial setup is very easy."
    • "It would be great if I could integrate with a human resource type of software that could control timesheets."

    What is our primary use case?

    We use the solution to store all our source codes. It's a solution that stores everything. We are an in-house development and we produce a lot of codes.

    We also use it to control our development process. We follow some methodologies. Every every team has a different methodology, for instance, Chrome, Agile, et cetera. The whole process from the planning process until we deploy the solution, everything is controlled by DevOps.

    What is most valuable?

    The solution is very good at automating various aspects of the DevOps process. You can automate almost everything. You don't have any human intervention. It's almost automatic. As long as you finish your code and put it in, the software gets the code and tests it. If it is okay, it will go ahead and integrate it and put it in production without any human intervention. This is excellent.

    The tool allows you to connect with many external tools. You can improve the whole process that way. We use a couple of things, however, there is a plethora of things you can put together in your solution.

    The initial setup is very easy.

    What needs improvement?

    Despite the fact that you can automate most of the things, you still have to produce some scripts. There are things that are not very user-friendly. The tasks are achievable, however, it's not easy. You have a lot of steps until you can get the thing automated.

    In the past, Microsoft DevOps was integrated with Microsoft Project. Out of the box. Right now, it's no longer that way. That would be interesting to have.

    It would be great if I could integrate with a human resource type of software that could control timesheets.

    For how long have I used the solution?

    I've been using the solution for 15 years now. It's been a while. It's well over a decade of experience.

    What do I think about the stability of the solution?

    The product is extremely stable. We've used it for 15 years and haven't had any serious issues. There are a few bugs or glitches but nothing tha can comprimses the day to day operation, and they usually fixed in the next release. It doesn't crash or freeze, though sometimes gets a bit slower due to databes overheadd, so maintance has to be done. It's reliable.

    What do I think about the scalability of the solution?

    We are a small team, and therefore we don't need to scale. However, I've heard both that it grows 10% a year without issue and that it scales very easily and very well. As far as I know, a company can scale it if they need to.

    We have between 50 to 70 people using it, including staff and managers, et cetera.

    How are customer service and technical support?

    I have used technical support a couple of times. Typically, it's good. It's usually a couple of hours and then, they answer you. Nevertheless, you can go to the online site and most of the time you can solve the problems just by reading. They have a lot of documentation available. 

    That said, when we dealt with them directly, they were pretty fast. I'd say we are satisfied with their level of service.

    How was the initial setup?

    The initials tup is not complex. It's a very easy, very straightforward process. A company shouldn't have any trouble with implementation. It only takes a couple of hours. It's pretty quick to deploy for DevOps purposes.

    What other advice do I have?

    We are just a customer.

    We intend to move from on-premises to the cloud next year.

    I'd recommend this solution. It's a worthwhile investment.

    I would rate the solution at a nine out of ten. We've been quite satisfied with it overall.

    Which deployment model are you using for this solution?

    On-premises
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Technical Engineer (Retail Group) at a retailer with 10,001+ employees
    MSP
    A comprehensive, easy-to-use, stable, and well-integrated solution that does everything in the development life cycle
    Pros and Cons
    • "All features are good. Pipelines feature is great, and Boards and Artifacts features are also really good. It is really good at what it does. It is very comprehensive, and it has some really great aspects to it. It is very easy. It is probably one of the easiest to use DevOps tools in the industry, and it is well integrated."
    • "The administrative capabilities of the tool need a huge improvement. Its Wiki and reporting also need a lot of improvement. Their support can also be better."

    What is our primary use case?

    It is used for development and life cycle management within the company. We use the SaaS version. It is called Azure DevOps services.

    How has it helped my organization?

    It has absolutely improved the way our organization functions from a development lifecycle point of view. It has enabled teams to be more Agile and flexible.

    What is most valuable?

    All features are good. Pipelines module is comprehensive, Boards and Artifacts modules are also really extensive.

    It is really good at what it does. It is very comprehensive, and it has some really great aspects to it. It has a easy to use UI. It is probably one of the easiest to use DevOps tools in the industry, and it is well integrated.

    What needs improvement?

    The administrative capabilities of the tool need a huge improvement. Its Wiki and Reporting functions also need a lot of improvement. Their support can also be better.

    For how long have I used the solution?

    I have been using it ever since it was created in 2012

    What do I think about the stability of the solution?

    It is very stable.

    What do I think about the scalability of the solution?

    It is very scalable because it is on the cloud. We have a very large user base and they're all IT-related. The users are engineers, product managers, and management. It is the entire IT organization.

    How are customer service and technical support?

    We use their technical support a lot. We have internal support, but we will also reach out to Microsoft to resolve problems. Their support is very good, but there is always room for improvement. It depends on the subject area. Sometimes, they have people who are not as well versed as others.

    Which solution did I use previously and why did I switch?

    We've been pretty much on the Microsoft products. We used to use Team Foundation Server, which was a Microsoft product. Before that, it used to be Visual Source Safe. We also used to be on PVCS, SVN and CVS.

    How was the initial setup?

    Being a SaaS solution, there is no setup.

    What about the implementation team?

    It was implemented in-house as we have a high level of in-house expertise in the ALM space.

    What's my experience with pricing, setup cost, and licensing?

    This area is very different for each and every organization and I would recommend that they research cost and pricing for their situation.

    Which other solutions did I evaluate?

    No, we did not evaluate any other options since we are heavily tied to the Microsoft stack. However over time, we have adopted other platforms (Java, Node, Python and others) since Azure DevOps is cross platform compatible with Linux, Windows, iOS and Andriod.

    What other advice do I have?

    If you're looking for a cross-platform solution that end-to-end does everything in the development life cycle, this would be a very good solution for you. If you're looking for a more siloed product that is specifically focused on one particular area of the lifecycle, this is definitely still an option, but you should also evaluate other options as well (Atlassian, IBM Rational,  MIcro Focus ALM, GitHub etc) for completeness.

    I would rate Microsoft Azure DevOps a solid eight out of ten. It is really good at what it does, but it also has some solid areas of improvement that are needed. Once they have addressed those, it could be hard to beat.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Chief Operating Officer Executive at a cloud provider with 11-50 employees
    Real User
    Allows you to create a bridge for maintenance and support, directly to the client
    Pros and Cons
    • "We can forecast tasks and the number of hours a task will take and can compare it with how long a task actually takes."
    • "The communication could work better, especially for the development team."

    What is our primary use case?

    We use it to manage the project. We create the product backlog, and we put our tasks into the DevOps schedule.

    How has it helped my organization?

    Azure DevOps allow you to create a bridge for maintenance and support, directly to the client. We can forecast tasks and the number of hours a task will take and can compare it with how long a task actually takes. The Timetracker function allows us to put all this together. Before Azure DevOps, we had difficulty predicting how long tasks would take, considering all the parts that must work together.

    What is most valuable?

    We have a component server, which is basically a tracker. This is very useful for us to itemise the start and end of tasks to evaluate the resources required, based on price. So it's very valuable. It is important to be able to inspect the items required in a project.

    What needs improvement?

    The communication could work better, especially for the development team. The important thing is that the tracker tools provide adequate communication, as do other tools. It seems to be lacking in DevOps and is an area which could be improved. We also need to improve publishing in production. In the future, we would like Azure DevOps to work with automated tasks regarding publishing. Better integration with existing source code is another area, which would benefit from improvement. The search repository could be more comprehensive, and visualisations could be optimised, further.

    For how long have I used the solution?

    We have been using Azure DevOps for around two years. We are a Microsoft partner, so we use Azure DevOps as part of that partnership.

    What do I think about the stability of the solution?

    Stability is excellent. Initially, we had some problems with performance, but nowadays it's okay. Maybe they improved the server.

    What do I think about the scalability of the solution?

    It's good scalability, but we need to improve the process by understanding it a lot more.

    How are customer service and technical support?

    We never actually contacted support. The best plan is to read through all the documentation, but getting the right documentation for your specific project is not always easy to find, as there is so much to go through.

    How was the initial setup?

    It's average, because we need to research what we are trying to achieve, and the platform has rich functionality. This is a good thing, but it can also mean setup is very complicated. However, we usually find that after testing more, we find our way around what we are trying to achieve.

    What about the implementation team?

    Our deployment took about three months, as we tracked it. Following that period, we needed another month to integrate a new component into the setup. We implemented it ourselves, with one of our team. We have about 10 users using Azure DevOps, but we have 2 people to provide the deployment out of those. These are developers. We have a small team for DevOps, including the manager. We need our staff to be flexible and agile in our team to take on various DevOps tasks.

    What's my experience with pricing, setup cost, and licensing?

    As a Microsoft Partner, you get a discount on the pricing. Licensing costs are around $80 a month for DevOps, but for Azure, it is about $200 a month.

    Which other solutions did I evaluate?

    We tried other tools, but Azure DevOps has a richer toolset, and it fits in better with our process. To some extent, as we are a Microsoft partner, we didn't seriously consider other options. However, we did look at Jira and Gitlab as potential alternatives.

    What other advice do I have?

    I would rate Azure DevOps as an 8 out of 10. I would ensure that DevOps' use is planned, in detail, including the implementation before using the software. I would also ensure you have a thorough knowledge of the main components of the system. This will ultimately save hours of work.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
    PeerSpot user
    Director at a computer software company with 10,001+ employees
    Real User
    Easy to comprehend and easy to use but the pricing should be easier to manage
    Pros and Cons
    • "The simplicity is very good and the customer experience is also great."
    • "It should be easier to manage Licenses especially because it's in the cloud."

    What is our primary use case?

    My team uses this solution for the CI/CD deployment, and code check-ins.

    We are also using Azure Boards for tracking our work, all of the requirements, the backlogs the sprints, and the release planning.

    What is most valuable?

    What I like the most is that it is easy to comprehend, and it's easy to use.

    The simplicity is very good and the customer experience is also great.

    What needs improvement?

    I am not suggesting this solution should be cheaper. I would like to see a bucket of licenses. for example, 10 licenses or 100 licenses that could be monitored to know how many of those licenses have been used. The price would be deducted accordingly.

    I should not have to contact Microsoft daily to request a license or two. There should be a mechanism in place where you are able to find out where you are out of 100 licenses, or that you have used 90 licenses in that year.

    I should be given a credit line of 10 licenses at the end of the year or at the end of the month.

    It should be easier to manage licenses, especially because it's in the cloud. You should know the usage and based on the usage, you should be able to make decisions.

    For how long have I used the solution?

    I have been using Microsoft Azure DevOps for one year.

    We are using the latest version.

    What do I think about the stability of the solution?

    It's a stable product. I have not experienced any issues.

    What do I think about the scalability of the solution?

    This is an area that has yet to be explored fully. We haven't taken it to this level.

    We are a team of 25 to 30 members, which is fine for us. Every time we scale up we need a new license and that takes time, it's not just a click and it's done.

    I don't know if it will be scalable for 200 to 300 people.

    Which solution did I use previously and why did I switch?

    Previously, I was working with Jira.

    How was the initial setup?

    I was not involved in the installation. My team completed it.

    What's my experience with pricing, setup cost, and licensing?

    Price is an area that could be improved. There are products on the market with a fixed price of 50 or 100 people, you are a bucket price. 

    With Azure, you have to pay for every user.

    It's good to have a bucket such as 50 to 100, or 100 to 200, and flexible pricing.

    The issue may be from having more than one license. When you procure one license or two licenses, it becomes difficult.

    It should be easier to procure a license, it should not be one by one. We don't know how many members I will have on my team three months from now.

    What other advice do I have?

    We plan to continue using this solution.

    I would recommend this solution, but I would not know their business needs.

    Based on the various features, the deployments, licensing, pricing, and the customer experience, I would rate Microsoft Azure DevOps a seven out of ten.

    Which deployment model are you using for this solution?

    Public Cloud
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    DevOps Manager at a tech services company with 51-200 employees
    Real User
    A DevOps solution with a great pipeline feature
    Pros and Cons
    • "Everything that's related to the pipeline has been very good."
    • "I'd like to have something better for the test plan."

    What is our primary use case?

    We use Microsoft Azure DevOps to store our code, manage our code, and publish it.

    How has it helped my organization?

    Before we used Azure DevOps, our team used to promote the code manually. What they did was publish, copy the files and paste them on the server or run lines of code to get our services in production. That takes a lot of time. With the pipeline we're using, that time was reduced by ten times. We're ten times faster now.

    What is most valuable?

    Everything that's related to the pipeline has been very good. We're using this to promote our code and to secure it. The library and all the stuff that we can manage inside the pipeline is helping us a lot.

    What needs improvement?

    I'd like to have something better for the test plan. The test plan seems to be really manual even now. There's a lot of stuff to do there, and it could be improved. 

    Sometimes, it's also difficult for us to handle all the connections with iOS. iOS connections are really very difficult. We're using a different product, which is part of Microsoft, called App Center. But sharing from Azure DevOps to App Center has been difficult. They should try to improve things related to iOS development or iOS production.

    For how long have I used the solution?

    I've been using Microsoft Azure DevOps for the last five years.

    What do I think about the stability of the solution?

    I wouldn't complain about stability. Sometimes we have a couple of maintenance windows, which is okay. We actually had a couple of problems, but I don't remember. I would say that it's under normal standards. I wouldn't complain about it.

    What do I think about the scalability of the solution?

    Microsoft Azure DevOps is scalable. It was easy to grow.

    How are customer service and technical support?

    If I ever raised any kind of a question to technical support, it was pretty good. I have asked a couple of questions in the technical area. They helped me, and it was good and pretty fast.

    Which solution did I use previously and why did I switch?

    We used to use another solution, but I don't remember which one. We switched because of a big contract that our company had with Azure. We were going to have our servers with Azure, and it looked like they reviewed the pricing and made the change.

    How was the initial setup?

    The initial setup was really easy. I didn't even manage this before, but I'm the one who is running this now, and it's pretty easy. Something that made me a little bit confused was all the permissions you have to give to teams and people. Sometimes it's kind of tricky, but it's understandable.

    Lately, the deployment's taking a little bit longer than before. I don't know what happened. I'll say that before our deployments took us maybe a couple of minutes. I didn't even measure that, but now it sometimes takes up to 40 minutes or an average of 30 minutes for each deployment.

    What about the implementation team?

    I implemented Microsoft Azure DevOps by myself.

    What other advice do I have?

    I would advise potential Microsoft Azure DevOps users to start exploring the free options, which are pretty good. I use it myself as an independent. As soon as you start using it, you'll know that you have to pay because it's a good tool that we can have to manage our code.

    On a scale from one to ten, I would give Microsoft Azure DevOps an nine.

    Which deployment model are you using for this solution?

    Private Cloud
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Tech Lead DevOps (Manager) at a tech services company with 11-50 employees
    Real User
    Provides a range of tools and technologies, but integration needs to be improved
    Pros and Cons
    • "This platform provides a large span of tools and technologies."
    • "I would like to see better integration and collaboration between tools."

    What is our primary use case?

    We are a reseller of solutions and provide maintenance to our customers. Azure DevOps is one of the products that we have experience with.

    Our customers use this product when they want to enter the DevOps space and integrate or consolidate all of their existing tools. It allows them to communicate seamlessly between development, their operations, and other team members.

    What is most valuable?

    This platform provides a large span of tools and technologies.

    What needs improvement?

    I would like to see better integration and collaboration between tools. There are different companies offering different tools, and how well something is integrated contributes to the completeness of the solution. 

    The platform needs to be updated because things are still in the process of change.

    For how long have I used the solution?

    I have been working with Microsoft Azure DevOps for almost three years.

    What do I think about the stability of the solution?

    We have had no complaints about stability.

    What do I think about the scalability of the solution?

    Scalability has not been a problem.

    How are customer service and technical support?

    We have not been in contact with technical support.

    How was the initial setup?

    The initial setup is complex. It really depends on those who are using it in the company and exactly what they're utilizing with respect to tools. It also depends on whether they want to integrate it.

    What about the implementation team?

    We have an in-house team for deployment.

    What's my experience with pricing, setup cost, and licensing?

    The price of this solution is fair.

    What other advice do I have?

    There are a lot of different tools on the market such as Jira, so I would look at DevOps as one option and how it is going to handle things in your environment.

    I would rate this solution a six out of ten.

    Which deployment model are you using for this solution?

    Hybrid Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: My company has a business relationship with this vendor other than being a customer: Integrator
    PeerSpot user
    Senior Consultant at CMEx
    Consultant
    User-friendly with good reporting features assist with managing my test plans, and the support is responsive
    Pros and Cons
    • "The creation of test plans is valuable and I like the reporting features."
    • "I have not been able to use the integration with automation features, such as test management automation, with a framework that is written in Java."

    What is our primary use case?

    We are a small product team and we do software development. I'm part of the testing team and I use Azure DevOps to manage all of my test activities. This includes my test plan, where I create my test cases, write test scripts, execute them, and publish the results using the dashboards.

    What is most valuable?

    I like a lot of the features in Azure DevOps.

    The creation of test plans is valuable and I like the reporting features that it offers. For example, I like the charts, as well as reporting progress.

    The interface is user-friendly.

    What needs improvement?

    I have not been able to use the integration with automation features, such as test management automation, with a framework that is written in Java. Currently, Azure offers frameworks that are written in C#. I have not found anything in the Microsoft documentation to say that it supports other languages.

    For how long have I used the solution?

    I have been using Microsoft Azure DevOps for approximately two years.

    What do I think about the stability of the solution?

    Being a SaaS product, sometimes we experience hangs. However, that is okay because in general, it is very much stable. If there are any outages then I get prior notification of such events.

    What do I think about the scalability of the solution?

    I have not tried scaling it. In my team, we have approximately 30 people who are using it.

    How are customer service and technical support?

    For me, the first point of contact is my internal organization and not Microsoft directly. However, if there are any changes that require Microsoft's intervention then there is an intermediate team who coordinates it. The response has been pretty good and I am happy with the support.

    Which solution did I use previously and why did I switch?

    I have used several tools in the past including Zephyr and the Rational Quality Manager.

    How was the initial setup?

    The initial setup is pretty straightforward. We needed to set up a Microsoft account, and that gives access to the projects. Basically, the IT department or IT administrators take care of the access.

    As a member of the team, once access is provided, I can just start using it. It is plug-and-play, as far as I'm concerned.

    What's my experience with pricing, setup cost, and licensing?

    It is a subscription model and I only pay for what I use.

    Which other solutions did I evaluate?

    Very recently, I was doing comparative studies of available test management solutions on the market and I find Azure DevOps to be pretty good.

    What other advice do I have?

    Overall, this is a good product and I recommend it.

    I would rate this solution an eight out of ten.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Head Of Technology at Elogroup
    Reseller
    Excellent integration; enables us to see all the steps in the lifecycle of our clients
    Pros and Cons
    • "Provides us with user histories."
    • "Templates could be improved."

    What is our primary use case?

    The first time I used the solution was to create a build for an Oracle application called SOA. We generated all the features in Azure DevOps to create the build and then we created a workflow. We are partners of Microsoft and I'm head of technology.

    How has it helped my organization?

    We have the histories, and are able to estimate the efforts of each story. It means that I can measure it from each developer and I have the match from each developer. We can also check it from the lead time to see whether there are any problems in storage that may not be mature. It gives us control. 

    What is most valuable?

    We use Gitch as a version control and the integration is very good. We are also using the features for the product backlog that's released every day so we have the user histories. We can track it from the histories to the code. You can see all the steps in the life cycle we use with our clients. We also like to use the estimate integration feature where you have two or three developers that estimate different efforts for each history. I think Azure is easy to integrate with any other type of solution to improve your delivery.

    What needs improvement?

    I think the templates could be improved. It's not easy making the jump from one project to another so we're now integrating using a different partner. I believe the price could be improved when scaling. It's a simple calculation, the number of users times $11, which is approximately the cost. But if you have a large number of users you should be able to reduce the per user cost the more you scale. I think it's something Microsoft could do for us. 

    For how long have I used the solution?

    I've been using this solution for five years. 

    What do I think about the stability of the solution?

    This is a very mature and stable solution. 

    What do I think about the scalability of the solution?

    We have about 100 users; developers, engineers and admin. The platform doesn't require any maintenance but we have one DevOps engineer to support the DevOps for the applications that we integrate with the platform. There are two types of scalability, the first is scaling my team, moving from 100 to 200 users, which is easy to do. The second is structure but  I haven't yet tested scalability in terms of increased structure.

    How are customer service and technical support?

    Actually, we don't have a lot of experience opening tickets with technical support. All tickets that we did open were dealt with quickly. 

    Which solution did I use previously and why did I switch?

    I used IBM where I worked previously but didn't have a lot of experience with it. 

    How was the initial setup?

    We had some initial difficulties, because the solution is not commonly used here. Jira and Microsoft are the most common solutions but it's not usual to use everything inside the platform. It was a cultural change that we implemented here in our team and to convince them was more difficult than to use the platform itself. We used an integrator for deployment but we don't do that in every case. In some of our deployments, hosting the most popular software development languages, like Java or .NET makes it easy to create the deployment mode. But when you have different platforms on development, it's more difficult to configure. We're on an SaaS platform, so deployment was very easy.

    What's my experience with pricing, setup cost, and licensing?

    We have 100 users and the cost is $11 per user. There's an additional cost if you want to use the integrated test plan. You have the option to just change your license and you can use the automated test integrator.

    Which other solutions did I evaluate?

    We looked at Jira Confluence and it was our second option. On Jira, we have our environment in Azure, and it was easier to adopt Azure DevOps instead of Confluence. Because Confluence is specifically for Azure DevOps, we can integrate it with everything that we are already using.

    What other advice do I have?

    It's very easy to start using this solution because the first five licenses are free. As a result, it's easy to track and compare with other solutions and it's easy to scale. 

    I would rate this solution a nine out of 10. 

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
    PeerSpot user
    Ismail Kiswani - PeerSpot reviewer
    Manager at Al-kiswani
    Real User
    Good CI/CD pipeline and testing automation that is both stable and scalable
    Pros and Cons
    • "The most valuable features of this solution are the CI/CD pipeline, and the testing automation."
    • "They have to add more features such as schedules and more flexibility in the platform."

    What is our primary use case?

    We are using this solution for CI/CD projects, for Scrum, Agile planning, testing, and business management system solutions. 

    We are also using it for continuous integration, and continuous delivery of DevOps.

    I am also using the Git Repositories, which is the main source control for me in the organization. We were using it on-premises and now planning to move it to the Cloud.

    They are calling it repository and they are supporting an old protocol, which is a popular protocol called Git repository.

    What is most valuable?

    The most valuable features of this solution are the CI/CD pipeline, and the testing automation.

    It's good that they are bringing more options to this environment, and to deploy to virtual machines.

    What needs improvement?

    The testing agents needs to be improved, they need to work on it.

    They can enhance the areas related to continuous integration and build automation. They can add more technologies for the build.

    The integration with the Azure infrastructure as a code and include more templates for infrastructure as a code in the continuous integration phase and the build phase.

    They can add more flexibility to the continuous deployment.

    Artifact management is also an area that needs some enhancements.

    I think automation and integration with the CI/CD lifecycle it's good but it's using agents.

    I am using a different tool for testing automation because I have not found any use cases on it. This feature is not covered. I'm using only testing and business management. I'm not using the testing automation feature that is provided by Azure DevOps.

    I would like to see more integration with other platforms and more flexibility.

    They have to add more features such as schedules and more flexibility in the platform. This will allow me to build my space and time based on the schedule and based on a calendar.

    I would also like to see a release calendar so that I can plan my releases based on my sprints. 

    This is required and it would give this solution more maturity. Between Scrum, Agile Planning, or Project planning with the build and deploy prophecies.

    For how long have I used the solution?

    I have been using Microsoft Azure DevOps for three years.

    We are using the latest version of this solution.

    What do I think about the stability of the solution?

    It's a stable solution. We have not experienced any issues.

    What do I think about the scalability of the solution?

    It's a scalable product. We have more than 50 users in our organization using this solution.

    I plan to continue using it in the future.

    Which solution did I use previously and why did I switch?

    Previously, I used TeamCity, Jenkins, I used Chef, and many other technologies.

    How was the initial setup?

    The initial setup is straightforward, it's a cloud service, so it's plug and play.

    What other advice do I have?

    I would recommend Microsoft Azure DevOps for other users who are interested in using it.

    I would rate this solution an eight out of ten.

    Which deployment model are you using for this solution?

    Public Cloud
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Chief Digital Officer (CDO) at a financial services firm with 201-500 employees
    Real User
    Easy to use, stable, and helps speed up production
    Pros and Cons
    • "Typically the sprints themselves and managing the tasks have essentially eliminated our need for reporting."
    • "Some of the queries, the way they're built, need to be looked at. We need better query tools."

    What is our primary use case?

    We primarily use the solution for our Agile teams, however, we started off using it with our executive suite. Our executive team now meets in sprints every day. Sometimes it's a short 15 minutes, other times it can be up to an hour. We have two-week sprints and daily scrums associated with it. We've also rolled that down from the executive. We've got seven formal Agile teams running throughout the organization across our businesses. We probably have at least 40% of our staff now trained in Agile and using DevOps to execute the projects.

    How has it helped my organization?

    As an Agile team, we're now able to move much faster than we could, even pre-COVID.

    What is most valuable?

    Typically the sprints themselves and managing the tasks have essentially eliminated our need for reporting. That in itself has had a huge effort on the number of meetings. In the past, you would almost wait a month before you could get all the executive teams together. Now, we've got meetings daily. Due to the regular meetings, we're utilizing daily scrums and two-week sprints, and we've been able to move a lot faster than we've ever had before as far as initiatives. 

    Frankly, throughout this whole COVID situation, being able to respond the way we have to some of the changes that were going on has been amazing. I don't think that would have happened if we weren't an Agile team.

    What needs improvement?

    There are a lot of features that we could probably work with a bit differently as we learn more about the tool. Right now, we're just really using it from a task management perspective. We've only been using it a year. There may still be more to learn and unpack.

    Some of the queries, the way they're built, need to be looked at. We need better query tools.

    Being able to report back to boards, to regulators, and the activities and stuff would be helpful. The queries do require somebody else to actually write them. There should, however, be a way to make things a little simpler in that space. Right now it's on us to figure out how to get better at making queries effectively and in such a way we're just not reporting on tasks complete.  

    We track the associated feature story. In many ways you can actually go back and see the story, and see the progress you've made on initiatives due to the fact that you can see all the decisions that have been made along the way. If there's a way that person could dig into that and pull more information or insights, that would be very helpful as it would assist us in improving future projects or even help us forecast on an existing project. 

    For how long have I used the solution?

    I use the solution daily. We launched it in the company in January. We've been using it across all our Agile teams here for 12 months here.

    What do I think about the stability of the solution?

    The stability of the solution is very good. I haven't had issues with bugs or glitches. It doesn't crash or freeze. It's a reliable solution.

    What do I think about the scalability of the solution?

    The solution's level of scalability is good. We're a smaller organization. We've only got 300 people in total, and out of those, probably 40% of our entire staff use the product. About 120 people probably are in there on a daily basis. That's everyone from executives down to programmers. It's extremely cross-functional across our organization.

    How are customer service and technical support?

    I haven't had to reach out to DevOps themselves personally, so I wouldn't have experience there. However, if we ran into any issues, my technology teams would contact them.

    Which solution did I use previously and why did I switch?

    We didn't previously use a different solution. That's why we looked for an automation tool. We switched to DevOps mostly due to the fact that our development team was utilizing DevOps as part of their own Agile operations. A number of teams were also already sort of experienced. There are a number of individuals in the company who were experienced that way, and we had homegrown support in some ways when we launched it. It just made sense to go with DevOps as opposed to bringing in something new.

    How was the initial setup?

    The initial setup wasn't complex. It was pretty straightforward. We didn't run into any issues that complicated the process of implementation.

    Which other solutions did I evaluate?

    We did look at Jira briefly, however, it didn't look that different from DevOps and we knew many of our team members were already comfortable with this solution so we didn't pursue it.

    What other advice do I have?

    We're just Microsoft customers. We don't have any business relationship with the company.

    I'm not sure which version of the solution we're using.

    I'd strongly recommend the solution to other organizations. I can't see us ever reversing back now after being on this for a year.

    Overall, I would rate the solution at an eight out of ten. It's relatively easy to use and it does what we need it to do.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Manager Systems Engineering at a manufacturing company with 10,001+ employees
    Real User
    Helps to improve productivity but specific disciplines need to be addressed
    Pros and Cons
    • "We can eliminate some of the middleman processes."
    • "It should be able to handle the different types. There is ecosystems engineering, and there is software applications engineering. There is a need to bring these teams together, but the disciplines don't integrate very well, and so it won't work."

    What is our primary use case?

    We use Azure DevOps to place our corporate servers into the cloud. We perform evaluations in the cloud for clients. Occasionally, we provide a hybrid solution in a specific cloud. For corporate work, we usually use a different cloud. With Microsoft Azure DevOps, as with any DevOps, it is not always possible to identify specific use cases. How do you identify a specific feature from a hundred requirements into a specific use case? It is very easy to lose detail. Traditional teams and ways of working methodically for safety-critical systems are not always prepared to handle that. It is important to be able to handle hundreds of detail-oriented requirements.

    How has it helped my organization?

    Azure DevOps is now used for safety-critical systems, whereas in the past the traditional approaches were used in requirements management. This is more like the traditional waterfall model. Improvement is always unique to productivity. That's why we switched to Microsoft Azure DevOps. The software teams prefer it to IBM.

    What is most valuable?

    We can eliminate some of the middleman processes. In the process, we are merging DevOps with development and operations. So developers act like our operation team as well. That concept is a great exchange. It brings a high level of visibility. It helps the team and department cohesion, which helps to improve productivity. 

    It also includes a high level of traceability and elimination of some of the unwanted silos in productivity. Testing and transparency need to be defined within the boundaries. If a backlog occurs, you should be able to group them as a whole. This means there is a backlogging to the team, as opposed to individual areas. Each area needs to be visible to other areas, at all times.

    What needs improvement?

    Microsoft needs to consider ruggedization and addressing specific disciplines. Fundamentally what I mean by that is you cannot merge everything. It should be able to handle the different types. There is ecosystems engineering, and there is software applications engineering. There is a need to bring these teams together, but the disciplines don't integrate very well, and so it won't work. For example, there is expertise in an area, and they tend to view the project from their own perspective. 

    For example, the software UI/ UX team needs to view it from the UX perspective. Application engineers need to view it from the application viewpoint and the engineering perspective is different again. Although we need to be cohesive in our approach, we need to keep some boundaries as well. The idea of containers arises, such as those provided by the open source software product Kubernetes. We need to containerize different disciplines and then merge them. As a manager, I should be able to ask the formative team to focus on their creative section, and that their task is completed. In the Application layer, you also focus on their requirements and you establish traceability. Other teams may also be involved in linking to the overall requirements.

    For how long have I used the solution?

    I have been using Azure DevOps for one year. It has been used in the company for about two years. It is used in the cloud and on-premises, as a hybrid cloud solution.

    What about the implementation team?

    We implemented on-premise as a hybrid solution, and on the cloud.

    What other advice do I have?

    I would give Microsoft Azure DevOps a six out of 10. Microsoft Azure DevOps is not perfected yet, as it needs to be more user friendly. If it can achieve that it will eventually reach a 10.

    Which deployment model are you using for this solution?

    Hybrid Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Computer engineering student at a educational organization with 501-1,000 employees
    Real User
    Covers the entire development lifecycle and the reporting is good
    Pros and Cons
    • "It's a complete solution that has everything you need."
    • "I think that they have some menus there that are not very well placed."

    What is our primary use case?

    We are using this solution for workflow management, especially when using a Kanban board to monitor the small assignments. Also, some programming for some of the disciplines. It's still in its infant stages.

    What is most valuable?

    It's a complete solution that has everything you need. 

    It covers all of the development workflows to the initial planning, testing, coding, and even to launch the subsequent feedbacks.

    Also, it has marketing reports.

    It's very promising. They are very well positioned to take over some pretty heavy contestants in that area.

    What needs improvement?

    I think that they have some menus there that are not very well placed. For example, I was searching for some extensions in the marketplace and I couldn't find my way back to the console. It's not very well designed.

    The general user interface is nice. It's intuitive, but I had the luck to discover something that is not very well designed. The fact that I can't return back to the console is very strange. I couldn't find my way back. I had to log off and log on again and get back to the console in a very awkward way.

    For how long have I used the solution?

    I have been using this solution for a few weeks.

    We are using the latest version.

    What do I think about the stability of the solution?

    It's a stable solution.

    What do I think about the scalability of the solution?

    As per the documentation that I have read, it's pretty scalable. My brother, who works with this solution practically every day, says it's scalable.

    We plan to continue using this solution.

    How are customer service and technical support?

    I have not yet had any experience with technical support.

    Which solution did I use previously and why did I switch?

    Previously, I just used GitHub, so just Version Control for code and not much more. 

    I used also their integrated development environments including Visual Studio Code and Visual Studio. These solutions are built by Microsoft.

    How was the initial setup?

    It's straightforward. With the cloud solution, there is no installation.

    I could create the main console for the project very quickly, with just a name and description and the rest is the default.

    What other advice do I have?

    This is a product that I can recommend to other users.

    I would rate this solution an eight out of ten.

    Which deployment model are you using for this solution?

    Private Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Project Manager at Shell Exploration & Production Co.
    Real User
    Good organization and structure, and the scheduling works well
    Pros and Cons
    • "What I like the most is the DevOps Boards. It's easy to create a hierarchical project structure, assign tasks to people, and to track their tasks."
    • "I would like to automate notifications on sprint planning. When we are getting to the end of sprint planning, we would be automatically notified."

    What is most valuable?

    What I like the most is the DevOps Boards. It's easy to create a hierarchical project structure, assign tasks to people, and then track their tasks.

    I also like the scheduling functionality.

    What needs improvement?

    I would like to automate notifications on sprint planning. When we are getting to the end of sprint planning, we would be automatically notified. 

    Also, it would be nice to have a percentage complete. For example, if a task is in progress, how much of it is complete, how much is left outstanding. I'd like that to be something that the assignee fills in and that automatically reports back to me.

    For how long have I used the solution?

    I have been using Microsoft Azure DevOps for six months.

    What do I think about the stability of the solution?

    It's a stable solution.

    What do I think about the scalability of the solution?

    Microsoft Azure DevOps is scalable.

    How are customer service and technical support?

    I have not contacted technical support.

    Which solution did I use previously and why did I switch?

    Previously, I used Microsoft Project. We chose to use Microsoft Azure DevOps because I needed something that my stakeholders could access.

    How was the initial setup?

    The initial setup was very straightforward.

    The time it takes to deploy is dependent on the type of deployment. Deployment of software, or deployment of the project into the software? 

    It took me a week to deploy the project into the software. It's approximately 800 PBIs.

    What other advice do I have?

    Before implementing Microsoft Azure DevOps, I would suggest doing your research on how to configure it. It is a product that I recommend

    I would rate this solution an eight out of ten.

    Which deployment model are you using for this solution?

    Private Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Senior Business Analyst │ Microsoft Power BI & Power BI App Development at a energy/utilities company with 1,001-5,000 employees
    Real User
    Free for up to five users, secure, easy to use, and integrates well with other Microsoft products
    Pros and Cons
    • "What I like the most about this product is that it's free and it's secure."
    • "The user interface could be improved."

    What is our primary use case?

    We are using Microsoft Azure DevOps for tracking the requirements and tracking the issues.

    Any issues that we have, are tracked and logged.

    Also, we check the developer's workload.

    It can be used for different purposes as well. For example, it can be used by software companies and different software teams for collaboration.

    What is most valuable?

    What I like the most about this product is that it's free and it's secure.

    You can easily assign it.

    It integrates well with other Microsoft products, such as Outlook.

    If we experience a login issue, it sends a notification to one of my developers and you also receive an email notification, ensuring that there is no way that a developer can miss working on it or miss seeing it in emails.

    What needs improvement?

    The user interface could be improved.

    For how long have I used the solution?

    I have been using this solution for approximately two years. 

    What do I think about the stability of the solution?

    It's a stable solution, we have not experienced any issues.

    What do I think about the scalability of the solution?

    We have not had to scale it, as we have a very small team with only four members who use this solution on a daily basis.

    How are customer service and technical support?

    We have not had to contact technical support. There hasn't been a need, it's very simple.

    If you have any issues, you are sent a link through email, you click on the link to address your specific requirements and close it.

    You will receive an email notification to confirm that the case is closed.

    Which solution did I use previously and why did I switch?

    Previously, we were using Microsoft Excel. We decided to use Microsoft Azure DevOps because it allowed us to assign tasks and get a notification.

    How was the initial setup?

    The initial setup is simple.

    It was easy to deploy and within a day, I was able to learn it and work on it.

    What about the implementation team?

    I did not use a vendor or an integrator, I did it on my own. It's a Microsoft product and we all use Microsoft.

    What's my experience with pricing, setup cost, and licensing?

    Microsoft Azure DevOps is free for up to five users and allows you to track a maximum of three projects.

    What other advice do I have?

    I would recommend this solution. It's a good tool and it's free.

    Instead of spending money on premium tools, you can at least start with Microsoft Azure DevOps and then upgrade it slowly.

    You can learn how to use this tool in less than a day.

    If you have Microsoft 365, this comes with it for free.

    It doesn't require any maintenance.

    I would rate Microsoft Azure DevOps an eight out of ten.

    Which deployment model are you using for this solution?

    Private Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Consulting services manager at a computer software company with 11-50 employees
    Real User
    Good user interface, constantly updated, and the technical support is prompt
    Pros and Cons
    • "It is a well-integrated product in terms of the development lifecycle."
    • "It would be very useful if it had better integration with Microsoft Word because we would like to be able to define the priority requirement document and add it to different stages of the backlog."

    What is our primary use case?

    We primarily use Azure DevOps for the early phase of software development projects. We don't use it for building the software. Rather, it is for development support. It handles management of the features, the composition, the definition of requirements, and checking our requirements against the use cases. 

    What is most valuable?

    Since it is a cloud product, it is constantly updated and not the responsibility of the user.

    The quality of the user interface is very good.

    It is a well-integrated product in terms of the development lifecycle. There are different functional areas from the requirements to finish including test management, product development, and deployment. I do not personally make use of all of these components together, but I understand from my colleagues that make wider use of it that everything integrates nicely.

    What needs improvement?

    It lacks integration with Office 365. It would be very useful if it had better integration with Microsoft Word because we would like to be able to define the priority requirement document and add it to different stages of the backlog. Currently, it is difficult to do this. There are some third-party products for this but they are either quite expensive or do not function properly.

    I would like to see the requirement management links between work items improved.

    An API to develop custom functions would be useful because we work with a large integrator that uses TFS, the on-premises version, and have seen what they do. One of the advantages of it is that you can develop using the XML approach to customization. Essentially, the customizability is more in-depth. This could be done, even without going to the code level, if they provided an API or and SDK. Although the interface currently used for customization is good, we sometimes find it limited. It would be more complex to use but also allow for greater potential.

    For how long have I used the solution?

    I have been using Azure DevOps services for two years.

    What do I think about the stability of the solution?

    This is a stable service.

    What do I think about the scalability of the solution?

    I would say that it is scalable. On a recent project, we had a lot of users and did not experience any issues in terms of performance.

    How are customer service and technical support?

    I have only been in contact with technical support on one occasion and they gave me a good and prompt answer. From my experience, I can say that I am satisfied.

    Which solution did I use previously and why did I switch?

    I do not personally have experience with other products, although the company has some experience with Jira.

    What other advice do I have?

    In summary, this is a good product but I would like to see better Office integration and API support.

    I would rate this solution an eight out of ten.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: My company has a business relationship with this vendor other than being a customer: partner
    PeerSpot user
    Co Founder and Technical Architect at Think NYX Technologies LLP
    Reseller
    Top 10
    Easy to onboard and use, with complete integration between pipelines and testing
    Pros and Cons
    • "The most valuable feature is the complete integration between test cases, pipelines, and issue management."
    • "The test management section needs to be improved."

    What is our primary use case?

    I am a consultant and this is one of the tools that I use to help develop solutions for my clients.

    What is most valuable?

    The most valuable feature is the complete integration between test cases, pipelines, and issue management.

    What needs improvement?

    The test management section needs to be improved. It is easy to use but they can make changes such that it is more comfortable for the users.

    I would like to see a full-quality dashboard added. For example, if I am not using their pipeline then I would still like to see the dashboard available.

    For how long have I used the solution?

    I have been using Azure DevOps for more than two years.

    What do I think about the stability of the solution?

    I have found it stable, so far.

    What do I think about the scalability of the solution?

    This product is very scalable. I am currently using it for about 10 users and if I want to add more then I have to pay more money.

    How are customer service and technical support?

    I have not yet been in a position where I needed technical support for this product. In the past, I have dealt with Microsoft's technical support for other products and I have found them to be fine.

    Which solution did I use previously and why did I switch?

    I have also worked with similar tools such as GitLab, GitHub, Bitbucket, and then Jira.

    Because I am a consultant, I work with multiple tools and the choice is that of my client.

    What's my experience with pricing, setup cost, and licensing?

    I find that the pricing is good, and it is competitive with the other vendors in the market.

    What other advice do I have?

    My advice to anybody who is considering Azure DevOps is that it is quite easy to onboard. It is a good product if you really want to work in a close-knit environment.

    I would rate this solution an eight out of ten.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Subdirector General at a tech company with 51-200 employees
    Real User
    Helps us to maintain order and keep track of the status for each of our projects
    Pros and Cons
    • "The most valuable feature is that it brings order to our projects, and we know the status of each one at every moment."
    • "This product would be improved if the helpdesk were included."

    What is our primary use case?

    We are a software development company and we use DevOps practices to manage our application development lifecycle. This is our primary use case. We don't have a production environment for the applications that we develop. Rather, they are given to our customers when they are production-ready.

    The management includes service requests, incidents, issues, etc.

    What is most valuable?

    The most valuable feature is that it brings order to our projects, and we know the status of each one at every moment.

    What needs improvement?

    This product would be improved if the helpdesk were included.

    What do I think about the scalability of the solution?

    We are a small company and have not had any problems with scalability.

    How are customer service and technical support?

    Technical support is good and we haven't had any problems with them.

    What's my experience with pricing, setup cost, and licensing?

    We don't have any complaints about the pricing.

    What other advice do I have?

    I would rate this solution a nine out of ten.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: My company has a business relationship with this vendor other than being a customer: partner
    PeerSpot user
    Software Architect at EML
    Real User
    Easy to implement, good CD pipeline, and very stable
    Pros and Cons
    • "The initial setup is quick and easy."
    • "The functions have too much dependency right now, so it makes it really, really hard to upgrade and make a change in the code."

    What is our primary use case?

    We normally use DevOps. On the application, everything has gone DevOps, however, we don't use the functions. All applications developed there have gone under Azure or AWS. We normally develop them to be able to not be dependent on anything, so if we want to deploy them in another environment, we can deploy them easily. If we want to use it in Azure, we use it in Azure. If we want AWS, we use it in AWS.

    What is most valuable?

    I like the CD pipeline. It's the most valuable feature for us. It's so easy to integrate into the CD/CI environment. I mostly love that one.

    The initial setup is quick and easy.

    What needs improvement?

    The functions have too much dependency right now, so it makes it really, really hard to upgrade and make a change in the code. 

    If you want to use the DPR it's a bit harder due to the fact that it's only 30 days.

    For how long have I used the solution?

    We've been using the solution for a year and a half at this point.

    What do I think about the stability of the solution?

    The stability of the product has been good so far. I can't say that I've witnessed glitches. There aren't bugs. It doesn't crash or freeze. It's reliable, as far as I can tell.

    What do I think about the scalability of the solution?

    We don't have any issues with the scalability of the solution. If we need to, we're able to scale.

    How are customer service and technical support?

    We've never contacted Microsoft for technical assistance. 

    We are Microsoft partners. We have several Azure experts on our development team, and we have a tech that came from the US and did the training for us. We have a very strong understanding of the product and therefore we don't need help with troubleshooting or anything of that nature.

    Which solution did I use previously and why did I switch?

    We also currently use AWS, however, I prefer Microsoft's solution as it's a bit easier to use overall.

    How was the initial setup?

    We did not find the initial setup to be complex. The implementation is straight forward. 

    Deployment is quick and typically only takes a few days or so.

    We have ten people that handle maintenance. They are in different parts of the world. We have two in Australia, for example, and two in the USA.

    What's my experience with pricing, setup cost, and licensing?

    The cost can get pretty high if you aren't paying attention to what you are doing.

    What other advice do I have?

    We're partners with Microsoft.

    I'd highly recommend Microsoft, and I recommend it more than any other solution. Everything is very simple and straightforward. The only worry for some organizations may be the cost. You need to be really, really careful.

    I'd rate the solution overall nine out of ten. I think it's really, really great. If the functions were a bit better, I'd give it a full ten out of ten.

    Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
    PeerSpot user
    DevOps Engineer at Simprints
    Real User
    The least expensive of the competitors in this class continues to develop and benefits Microsoft users
    Pros and Cons
    • "Azure is an advantage when working with other Microsoft solutions."
    • "Azure has not yet advanced to the performance level of the other major competitors and is missing integration with important technologies."

    What is our primary use case?

    I took a part-time job doing a mentorship to guide the students on how to use cloud computing on the AW and Azure cloud resources. For that project, we go through each and every service on cloud computing that is part of the service platform. The new technology is called server-less technology. The goal of the mentorships is showing students how to fundamentally use these resources and explain the advantages and disadvantages of cloud computing over on-premises solutions.  

    What is most valuable?

    Currently, I do not know if there is really a single feature that stands out as the most valuable. If you consider our use case and that we were using Azure essentially as a teaching tool, it was the tool itself that was valuable.  

    I do not have in-depth experience with Microsoft Azure, but it is like other services such as AWS. Currently, the number of services are increasing on Azure actually at a faster rate than with Google Cloud. If you are working with Microsoft products like Office 365 the best cloud solution would be on Azure services. The cost is also better than AWS.  

    Microsoft has also built an association with other cloud products for helping to migrate your licenses to the cloud. This works out well if you have a substantial investment in licensing for Microsoft products on-premises. Being able to bring that license to the cloud is a good transitionary solution.  

    What needs improvement?

    I have been running reports on the availability of the major competitors in the cloud services to use as a demonstration in webinars and comparison of services. The most available solution on the cloud in user availability by minutes is Google Cloud. Google is the number one solution and the second one is AWS. The third one is Microsoft Azure.  

    Compared to the availability of the other two major cloud solutions, Microsoft Azure needs to make an improvement in their availability. This report suggests that the Azure team needs to do some major changes to match the availability of the other services and make the product more competitive.  

    In DevOps (software development and IT operations), server-less architecture and QNX platform integrations are things that need to be added to Azure. Currently, I am not sure that this is the case. But previously, I have had experience trying to use Azure with service and integration with the QNX platform and it is not as good as Google Cloud. Azure has improved its current set of data services on the cloud. But Google Cloud is doing more right now to bring those technologies and make them available to developers or enterprise solutions. So, QNX integration needs polishing.  

    For how long have I used the solution?

    We have been using the product for only the last two months.

    What do I think about the stability of the solution?

    I have not experienced any issues with stability.  

    What do I think about the scalability of the solution?

    In general, I have seen no real issues with scalability. It is a cloud platform and scalability should usually be available on demand.  

    Which solution did I use previously and why did I switch?

    I used Google Cloud on one of my previous projects but currently, we are using the on-premise solution. So we are hosting everything locally on-premises. We do not have any current cloud provider for the business as a whole. We are using AWS for security and backup for the production environment but mostly we rely on the on-premise solutions at the moment.  

    We use the S3 compute instance of AWS only. We do not use any other AWS services. We just use VM's that we create on the S3 instance.  

    How was the initial setup?

    Setup is not so much of an issue as the product is on the cloud. The services are essentially on demand for the product. What you do with the services is what may take more time and consideration.  

    What's my experience with pricing, setup cost, and licensing?

    I am not comfortable sharing the details of cost because there may be different pricing schemes, but compared to AWS, Azure is less expensive. So in the pricing in this class of services, Azure is good. It can work well for small to medium enterprises. But this solution is may not be good for those who are not enterprise-level users. Small cloud computing providers have better pricing than the bigger cloud computing providers like AWS and Microsoft Azure and may be a better choice for non-enterprise use.  

    Still, Azure is priced better than AWS. Price may not be the only thing to consider.  

    Which other solutions did I evaluate?

    I have had the opportunity to use a variety of different solutions and it has not really come down to a situation where one is replaced with another. There is an ongoing evaluation of the products as newer technology including the most well known, like AW, Google, and Azure. AWS is the most expensive cloud hosting. In my estimation, that is the best product right now, but things are changing quickly.  

    What other advice do I have?

    On a scale from one to ten where one is the worst and ten is the best, I would rate Microsoft Azure DevOps as an eight-out-of-ten. It is not quite up to the level of other offerings in some ways but it is improving all the time.  

    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Principal Engineer at a tech services company with 201-500 employees
    Real User
    User-friendly, has a powerful test manager, and the reporting capability is good
    Pros and Cons
    • "Fields can be customized and the reporting is good."
    • "Proper Gantt charting should be a feature that is included because as it is now, we have to create it ourselves."

    What is our primary use case?

    We use Azure DevOps for managing our workflow, as well as the CI/CD.

    How has it helped my organization?

    We use the CD/CD for all of our deployment lifecycles.

    What is most valuable?

    The CI/CD portal is very user-friendly.

    The platform is very easy to manage. It is easy to manage repositories between the business users and corporate users.

    Fields can be customized and the reporting is good. The APIs that are exposed can generate management reports.

    The most valuable feature is the test manager. 

    Integration is easy to do. The single-sign-on facility is there in every aspect including Azure DevOps, Active Directory, our portals, and all of our development sites.

    What needs improvement?

    Proper Gantt charting should be a feature that is included because as it is now, we have to create it ourselves.

    We would like to have an indicator of the percentage of occupancy. Suppose a person is working on two different domains, and we have 70% on one project with 30% on the other, it should be able to report that. As it is now, we have to manually enter that data. If this functionality were provided then it would make it easier for users.

    For how long have I used the solution?

    We have been using Azure DevOps for the past two to two and a half years.

    What do I think about the stability of the solution?

    We have had issues, usually related to the APIs, but the support team has always helped us to resolve them.

    How are customer service and technical support?

    The Microsoft support team is prompt to respond and very good.

    What's my experience with pricing, setup cost, and licensing?

    The price is cheaper than Jira and some of the other competing tools.

    What other advice do I have?

    Overall, this is a good product and if the Gantt chart and occupancy reporting features are added then it will be the most powerful one in this space.

    I would rate this solution an eight out of ten

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Senior Project Manager at a marketing services firm with 10,001+ employees
    Real User
    Good traceability and dependency-tracking features
    Pros and Cons
    • "There are a lot of helpful features available for tracking dependencies."
    • "Improving the metrics that are readily available on the dashboard would be very helpful."

    What is most valuable?

    The key thing I find benefits me is the ability to track right from the feature and determine what has happened. I have a direct link to the test and the metrics that are available.

    There are a lot of helpful features available for tracking dependencies.

    What needs improvement?

    The dashboard could be improved. Although there is flexibility in configuring it, there are some metrics that we have to configure ourselves. Improving the metrics that are readily available on the dashboard would be very helpful.

    I would like to see better integration with third-party solutions, where if they are part of the DevOps pipeline then the reporting could be made available on the dashboard.

    Having some form of check modeling integrated into Azure would be useful.

    For how long have I used the solution?

    I have been using Azure DevOps for the past four years.

    What do I think about the stability of the solution?

    We have had no issues in terms of stability.

    What do I think about the scalability of the solution?

    The offerings in terms of scalability are good.

    How are customer service and technical support?

    We have not had to depend much on Microsoft support for DevOps and project management. However, I can say that the general support that we get for Azure is good.

    Which solution did I use previously and why did I switch?

    I have some experience with Jira from Atlassian, although I have worked with Microsoft Team Foundation Server from the beginning.

    How was the initial setup?

    The initial setup was straightforward. While we were migrating, we had training from Microsoft, which was helpful.

    Which other solutions did I evaluate?

    I haven't really looked into other options.

    What other advice do I have?

    Overall, this is a good product and one that I recommend. The features it has have helped us, especially with tracking dependencies.

    I would rate this solution an eight out of ten.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
    PeerSpot user
    Director | Information Technology / Quality Engineering at a performing arts with 1,001-5,000 employees
    Real User
    Good user interface, easy to implement, and offers good reporting
    Pros and Cons
    • "The solution is easy to implement and easy to use."
    • "One thing I would note is that it's hard to know what is included or not in the product. Especially when you begin to try and compare it to other solutions. When you go to a site like VersionOne, they tell you Azure DevOps doesn't have this or that, and when you go to Microsoft, it says VersionOne doesn't have this or that. They could do a better job of laying out exactly what is on offer so customers know going in exactly what they'll get."

    What is most valuable?

    The most valuable aspect of the solution is the complete tool orchestration within the DevOps. It's great for operations, monitoring, and building tests for deployment.

    I like the user interface. It's excellent.

    The solution is easy to implement and easy to use.

    We've been using their documentation seamlessly. It's been great.

    I love it because we have Microsoft Exchange Office 365 and we have all those reports already in place (especially if you're using quality reporting). We get that as an add-on. It comes within the package, so everything is very compatible. The analytics on offer are also very good.

    The solution offers great plugins and has great integration capabilities. It runs on configuration management tools like Ansible and Puppet. The monitoring they have for plugins is also excellent. 

    Whatever you might need, they seem to have it.

    What needs improvement?

    We're quite happy with the tool right now. We're not really using it too much. We are also just starting on it, to be honest, so what we've needed so far we've found that it offers. There isn't anything missing that I can see. 

    One thing I would note is that it's hard to know what is included or not in the product. Especially when you begin to try and compare it to other solutions. When you go to a site like VersionOne, they tell you Azure DevOps doesn't have this or that, and when you go to Microsoft, it says VersionOne doesn't have this or that. They could do a better job of laying out exactly what is on offer so customers know going in exactly what they'll get.

    For how long have I used the solution?

    I've been using the solution for three years.

    What do I think about the stability of the solution?

    In terms of stability, I would say we have no problem with the solution. We have been using the tool for all of our projects and we have no problems with that aspect. If users use virtual missions when they run the testing, everything is even easier.

    What do I think about the scalability of the solution?

    Scalability, at least for the time that we have been using the solution, hasn't been a problem. We are able to adjust and expand any time of VMs. Any organization that needs to grow its usage should be able to do so easily.

    Currently, 40 people are using the solution for one of the projects we're running. We have whoever you could think of in an agile team on it. Everybody from the business analyst to the product managers, to the testers, to the developers, and even to business end-users are on it.

    I'm not sure if our organization plans on expanding its usage in the future.

    How are customer service and technical support?

    I've never personally had to contact technical support, and I haven't heard from anyone in my team about any negative results. I'm not sure if I'd be able to evaluate their services at this time.

    Which solution did I use previously and why did I switch?

    We previously used Jira, however, we have not switched over completely to Azure DevOps. We now use both.

    How was the initial setup?

    With manuals, the implementation is much easier. It is quite straightforward.

    We are not doing any kind of maintenance on the solution. We don't need to because it's so fast. We are not paying for everything in terms of infrastructure development. 

    What's my experience with pricing, setup cost, and licensing?

    I'm not sure about the pricing. It's not an aspect of the solution I currently deal with.

    Which other solutions did I evaluate?

    We're currently looking at VersionOne and CollabNet just to see how they compare to what we currently use, which includes Microsoft Azure DevOps.

    I'm new to this company. I've been here only for a year. The previous company, I was using Agile Central, which I really liked because of the user interface. Central was previously called Rally. However, after coming to this company, as they have Jira, I've been using Jira and also, for this one project, Microsoft Azure DevOps. I need to begin considering what I should do at an enterprise level. I'm looking at a variety of options including Microsoft DevOps, VersionOne, CollabNet, and a few more. 

    Since we have Microsoft Azure DevOps already in place, I would like something that's similar and competitive. 

    What other advice do I have?

    I'm not sure which version of the solution we're using at this time.

    I personally just love using Microsoft DevOps. I would recommend the solution to anyone. Organizations considering the solution should just go for it and they should get the complete orchestration.

    I'd rate the solution eight out of ten. I don't think that I have explored everything extensively yet. Any product definitely will have its own gaps, and since I'm not in a position to understand it 100%, I want to play it safe on ranking it at eight.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: I am a real user, and this review is based on my own experience and opinions.
    PeerSpot user
    Lead Technical Consultant (Information Technology) at a construction company with 1,001-5,000 employees
    Real User
    Top 20
    A stable, all-in-one solution that is easy to deploy, but some areas need to be improved
    Pros and Cons
    • "I like the entire tool because it is a one-stop-solution for DevOps."
    • "There are certain areas in Azure DevOps that are better in other products."

    What is our primary use case?

    We are a manufacturing company and I am a technical consultant who is responsible for managing the software applications that are outsourced for development. In this role, I have gained experience using Microsoft Azure DevOps.

    I have also used it as a software developer in companies that I previously worked for.

    What is most valuable?

    I like the entire tool because it is a one-stop-solution for DevOps.

    The Scrum functionality in project management is helpful, as are the code repositories. It has support for pipelines.

    What needs improvement?

    There are certain areas in Azure DevOps that are better in other products. These are things that I need to more fully explore.

    For how long have I used the solution?

    I have been working with Azure DevOps for approximately four years.

    What do I think about the stability of the solution?

    The stability is good and I haven't had any issues with it.

    What do I think about the scalability of the solution?

    At this time, the majority of our software application development is outsourced so there is not much in terms of DevOps. However, in the future, I am planning to implement DevOps here. Once that happens, I expect that our usage of this solution will increase.

    How are customer service and technical support?

    I have not needed to contact Microsoft's technical support.

    How was the initial setup?

    The initial setup is straightforward and easy. It takes very little time to deploy.

    What about the implementation team?

    I deployed this solution without any help.

    What other advice do I have?

    Personally, I like this product and it is one that I recommend. That said, based on my experience, I cannot say that it is perfect.

    I would rate this solution a seven out of ten.

    Which deployment model are you using for this solution?

    Public Cloud

    If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

    Microsoft Azure
    Disclosure: My company has a business relationship with this vendor other than being a customer: Partner
    PeerSpot user
    Senior Director at Cloud Technovation
    Real User
    Good for the staging environment through to the production environment
    Pros and Cons
    • "Azure enables us to create a staging environment through to a production environment in an easier way and then get the code and run that."

      What is our primary use case?

      Building fast and reliable, amplified feedback loops in all stages of our software delivery and operations lifecycle. The business strives for built-in quality to ensure that everyone have correctly done their job. 

      I trust my team with peer reviews of our designs, code, test and infrastructure.

      How has it helped my organization?

      I'm familiar with Azure DevOps in the sense that my group directive has based the administration, architecture, and development on Azure. So whichever hat that I need to wear at the time that's the one I can wear.

      What is most valuable?

      I would say that Pipelines is Azure's most valuable feature. Also generally, Azure enables us to create a staging environment through to a production environment in an easier way and then get the code and run that. It also has decent pull requests and things like that.

      What needs improvement?

      Azure DevOps is a very cross-platform product. One of the issues that I have currently with the company is that they are using two different parts of technology. They were using JIRA for their sprint work and they were also using Confluence, as well as other Enterprise software. I advised them that all their sprint planning, backlog work, and everything else, can be done out of Azure DevOps from one central place. I know the Microsoft team will always look at improvements because I know that they are constantly looking at improvements to products while listening to their customers and looking at a global scale. I'm keeping my ear to the ground, as I always do.

      The product keeps evolving and at the moment there are a lot of good parts There are petabytes of data. Anytime somebody does a pull request or anything else, Microsoft is notified about it. So if somebody, somewhere is always looking at that and watching, that can be a revolutionary product. It's a product that can continuously grow and evolve in time. Even if it is not yet what you call a finished article, it's a growing and evolving product.

      Everybody has a slightly different take on what solutions or what part of the solution they would like to be improved. You can always improve a platform. Microsoft is always listening to customers and they will bring out a new version. The platform is quite user-friendly at the moment because you can use any program or language with it. You can't say you need another program, because as far as I'm concerned the main ones can be integrated with Azure. The newer ones like Go, as well as older ones like Python, Java, and PSP,  can all be integrated with that platform.

      I suppose when we hear about that release, I have no doubt that because Microsoft captures a lot of metrics and information that they monitor, like capturing data about what or how people use their product, they can see where the usage is and where they might want to remove a feature. That analysis and also comes from Microsoft's monitoring capabilities.

      For how long have I used the solution?

      I've been using this solution for five years.

      What do I think about the stability of the solution?

      I thought it was very stable. They didn't have any shaky moments. Predominantly with Azure DevOps you need one thing only: a solid internet connection. If you've got a solid Internet connection, you just push everything up to the platform or run an integral request. I haven't had any issues with that. Some people might have, but it all comes down to their internet connection.

      What do I think about the scalability of the solution?

      This solution is extremely scalable.

      It helps a lot in Microservices or service technologies. Using the infrastructures of code enables a productivity increase of a thousand percent. I was speaking with a company that was pulling 12 requests at one time but using competitive technology like DevOps they were able to pull over 2000 requests at the same time. It's extremely scalable and you can use it to scale down when it needs it. It's a completely autonomous product, that allows you to scale whatever you need.

      I have five or six back end developers that use it every day. They learn every day, so whatever code or scripts they write are in Azure DevOps. They're not using any another tool to do it, they are pulling it with the platform because you can't tell other people about a platform if you aren't using it yourself. The first thing they do is log on to DevOps.

      There will be an increase in our usage of the product. We are looking to expand at some point. The more people that come on board, the more use there is for the product.

      How are customer service and technical support?

      We haven't had a requirement to contact their technical support. I have contacted their technical support before under some other projects and got a really good response from the person on the other end of the phone. They are always looking to help you solve more solutions as quickly as they possibly can.

      I don't think I have had a bad experience; I've always had continuity. They were able to get me the problem resolved, whether it was a P1 or P4 issue. I've never had a problem with the technical support.

      Which solution did I use previously and why did I switch?

      I have experience with Amazon Web Services. As the Azure product has matured a lot in the last two to three years, it deserves its market share at the moment. We were using other products, like Visual Studio, a web service which is an old name for Visual DevOps. We were also using things like Team Foundation Server (TFS). We were just using some of the older tech.

      How was the initial setup?

      The initial setup was straightforward.

      What about the implementation team?

      We did the implementation ourselves.

      I'm working on the high-level design and the low-level design so I know where we're going to start, and whether we've got a blank slate. I've worked with many firms in the past and companies have their own design in place. Usually, some of these companies material is outdated and Microsoft will probably move the bar several times. We are Microsoft accredited so we stay in touch with the technology more recently than most. We've constantly been informed of the latest technology and the latest products that are evolving on the platform. That includes those that are in preview, which I hope will become available, as well as those that are going to be deprecated. We're basically in full harmony with Microsoft and their products.

      What was our ROI?

      We most definitely achieved an ROI.

      What's my experience with pricing, setup cost, and licensing?

      Check out the pricing information from Azure Cost and analysis information.

      Which other solutions did I evaluate?

      No Visual Studio Team Services and Visual code were the preferred options.

      What other advice do I have?

      The first thing that I would suggest is to read the documentation for the platform. The online documentation changes pretty much every other week; there is always something new coming out. Practice, practice, and practice. Test, practice, and repeat. You need to know your way around the platform and the only way to do that is by hands-on practice. You can't break the environment, but you can speed things up on the thirteenth hour. It depends on how you configure things since every configuration is different. It's an excellent product that is taking into account current technology, yet also flexible enough to use with future technology.

      At the moment I would rate Azure DevOps as a nine out of ten. The reason I wouldn't give anything a ten is because it's constantly evolving. There is room for improvement, as this is not the finished article at all. The reason I would give it a nine is the information to get the best usage out of the product is readily available. I've been using Microsoft tech for over 25 years now and back in the day it was difficult to get information out of Microsoft even when you were an MCPN. You would have a special link to go through a Microsoft back door to gain information. That's completely different to the advice that you would get related to Microsoft.com. Now Microsoft is completely different with everything readily available. You can download it in pdot format and the document could be 2000-3000 pages. They leave no stone unturned.

      The only problem I would say at the moment is a friend of mine said that the Microsoft test book is taking a long time to come out because he wants to take the exam. Some people need to read the information and retain the information that way. Sometimes you go on these courses that are not run by Microsoft directly. They can be very flaky and don't have all the information or experience of using the product in normal working life.

      If there is anything I would ask for, it's to get the documentation out on hardback so that we can add it to our libraries. That would be very good.

      Which deployment model are you using for this solution?

      Public Cloud

      If public cloud, private cloud, or hybrid cloud, which cloud provider do you use?

      Microsoft Azure
      Disclosure: I am a real user, and this review is based on my own experience and opinions.
      PeerSpot user
      IT System Manager at a financial services firm with 1,001-5,000 employees
      Real User
      A stable solution with a reasonable licensing fee and excellent technical support
      Pros and Cons
      • "Technical support has been excellent. On that side, Microsoft is very good. The customer support of Microsoft has really improved this past year. On the cloud side also we are very satisfied because it offers very good support."
      • "The solution could work to improve their reporting."

      What is most valuable?

      The Repos, Wikis, and pipelines are all excellent features.

      What needs improvement?

      The solution could work to improve their reporting.

      For how long have I used the solution?

      I've been using the solution for nearly one year.

      What do I think about the stability of the solution?

      The stability of the solution is good.

      What do I think about the scalability of the solution?

      The scalability of the solution is good. I would give it a four or five-star rating. We have plans to increase usage. Right now we have about 100 users on the solution.

      How are customer service and technical support?

      Technical support has been excellent. On that side, Microsoft is very good. The customer support of Microsoft has really improved this past year. On the cloud side also we are very satisfied because it offers very good support.

      Which solution did I use previously and why did I switch?

      We did not previously use a different solution.

      How was the initial setup?

      The initial setup is straightforward. We just implement it from the cloud. We took it and configured it with our local website infrastructure, so there was nothing much to do.

      What's my experience with pricing, setup cost, and licensing?

      There is a licensing fee of $6/user per month. That's not too much money for us. There aren't really any additional costs beyond that.

      Which other solutions did I evaluate?

      We considered using Jenkins, but we decided to use Azure DevOps because we have an enterprise agreement with Microsoft. It was much easier.

      What other advice do I have?

      We are using the public cloud deployment model.

      Potential users should not hesitate to move to Azure DevOps. It keeps on progressing and keeps on adding new features all of the time, so it's a solution that I would highly recommend people use.

      I would rate the solution eight out of ten.

      Disclosure: I am a real user, and this review is based on my own experience and opinions.
      PeerSpot user
      User at a energy/utilities company with 10,001+ employees
      Real User
      They fix issues and add new features quite regularly and it offers many analytical capabilities
      Pros and Cons
        • "They do very frequent releases, there's a complete change in UI kind of stuff. Sometimes it feels like they change it too often."

        What is most valuable?

        The ability to interact with various other Azure services like for a deployment or using CICD was very helpful because when we leverage it for Azure IT helps. There's no CICD pipeline available. They provided us with some of the plugins to deploy that onto the Azure IOT edge.

        What needs improvement?

        They do very frequent releases, there's a complete change in UI kind of stuff. Sometimes it feels like they change it too often. They fix issues and add new features quite regularly which is good. 

        They leverage a lot of new features, new features get released frequently, and sometimes the change management on our side is a bit complicated because we'll see something and there's an entirely different way how it is presented. You need to get it all working again.

        Previously we asked them for more analytics on top of what they already had so that we could look at it comprehensively and see how the projects are progressing. They implemented these changes for us. 

        For how long have I used the solution?

        I have been using Azure for the last couple of years.

        What do I think about the stability of the solution?

        It's stable. It's good. If there are some features missing we connect with the Microsoft team and then they get it developed and we utilize it.

        What do I think about the scalability of the solution?

        It is very scalable. We use it for quite a lot of projects including running the data and all that stuff. We do quite a lot of analysis and analytics on top of that.

        We have hundreds of users using this solution.

        How are customer service and technical support?

        We don't really use technical support for incidents but more for developing new features. 

        Which solution did I use previously and why did I switch?

        I've been using Microsoft based solutions, like VST and then like before that DSS. It was a natural progression from VSTS into Azure DevOps.

        How was the initial setup?

        The initial setup is straightforward. We've been using Microsoft products for a while. 

        What other advice do I have?

        It's a good tool, quite rich, it has a lot of features, and quite a lot of analytical capabilities which are built on top of it so that you can see how your projects are going and all that stuff. It's a good tool.

        I would rate it a nine out of ten.

        Disclosure: I am a real user, and this review is based on my own experience and opinions.
        PeerSpot user
        Murat Gurkas - PeerSpot reviewer
        Product Owner at ZettaLABS
        Real User
        Its configurable dashboard offers various display options for the stakeholders of the project

        What is our primary use case?

        Agile scrum project management of a software product in a start-up company. We are a team of 11 people located in different countries.

        How has it helped my organization?

        We have team members in different locations of the world. Azure DevOps is the main communication tool between the product owners, UX designers, and developers.

        Its configurable dashboard offers various display options for the stakeholders of the project.

        What is most valuable?

        • Dashboard
        • Query
        • Sub-tasks configuration
        • Extensions library
        • Visual Studio and other MS product integrations.

        What needs improvement?

        • It would be better to have a free-text query editor. 
        • Product management/roadmap planning features are missing.
        • Parent Column is added in listings and we expect to see it in queries as well

        For how long have I used the solution?

        Less than one year.

        What do I think about the stability of the solution?

        Refreshing the browser is needed when a data is updated. I am expecting Microsoft to prepare an Azure DevOps application running on PC and downloaded from the MS app store.

        What's my experience with pricing, setup cost, and licensing?

        It is easy to use if you are already familiar with Microsoft products. 

        Disclosure: I am a real user, and this review is based on my own experience and opinions.
        PeerSpot user
        Enterprise Agile Coach at Knowit Require
        Real User
        A user-friendly and intuitive interface, but it lacks integration with other products and tools
        Pros and Cons
        • "My first impression of DevOps, after using Jira, is that it has a much better, more intuitive, and more user-friendly interface."
        • "I would like to see better interoperability with the agile scaling frameworks."

        What is our primary use case?

        We are currently involved in a financing exchange project, and we use this solution to keep track of the exchange activities within the backlog. We are not taking advantage of the repository and the code stuff at this stage. 

        What is most valuable?

        The most valuable feature for us at this stage is the Azure Boards.

        I really like the user interface. For comparison, I have been using JIRA for several years now, and I am rather skilled at using that tool. The reason for my using Azure DevOps is because my client uses it. My first impression of DevOps, after using JIRA, is that it has a much better, more intuitive, and more user-friendly interface. That first impression is still valid, today.

        What needs improvement?

        There is a lack of integration and portability with other tools and products.

        I would like to see better interoperability with the agile scaling frameworks.

        When I first started using Azure it was impossible to figure out how to do the configuration correctly. Perhaps there should be a configuration environment that hides some features and is not open for everyone.

        I find it difficult to find some of the features, although it may be that they are not enabled, or perhaps I have to take some time to better understand the tool.

        For how long have I used the solution?

        Four months.

        What do I think about the scalability of the solution?

        I cannot really comment on the scalability of this solution. We are running in a microenvironment with only a few users and a few integrations. It is enough for us at the moment, but if we want to go forward and continue to work with it then that will be a discussion for later.

        We have approximately fifty users right now. There are three or four administrators, and the remainder of them are end-users.

        How are customer service and technical support?

        I have not contacted technical support. Coincidentally, I needed support today, so I went online to find the answer. The toolkit for helping yourself is there, but perhaps it should be more integrated into the solution.

        Which solution did I use previously and why did I switch?

        I have used JIRA for several years, and although I am impressed with the interface in Azure DevOps, JIRA still has better integration with other tools.

        How was the initial setup?

        The initial setup for this solution is much easier than for that of JIRA.

        What other advice do I have?

        My advice for anyone implementing this solution is to have an expert for every fifty users of the solution. This person is responsible for configurations and so forth.

        If you have a Microsoft environment then this is an easy choice for you, but if you don't then I think that JIRA would be a better choice.

        I would rate this solution a seven out of ten.

        Disclosure: I am a real user, and this review is based on my own experience and opinions.
        PeerSpot user
        Software Architect Consultant at a tech consulting company with self employed
        Consultant
        Helpful for multi-platform release management, but more flexibility is needed for automated testing
        Pros and Cons
        • "All of the features related to release management are very good."
        • "Better integration with the Linux operating system would be an improvement for this solution."

        What is most valuable?

        All of the features related to release management are very good. We use release management and dev management, and the dashboard is good. The ability to specify multiple platforms in release management, by using Docker, is valuable.

        What needs improvement?

        Better integration with the Linux operating system would be an improvement for this solution.

        I would like to see more third-party plugins; by comparison, the open source solution, Jenkins, has thousands of plugins available.

        The Wiki for this solution is not very good.

        There is a problem when you want to run a release pipeline for an organization that needs enhanced security. There is no option to configure a dynamic login for a station that is running the tests. The only solution in the platform is to configure an agent that uses a fixed username and password login. There is no option to change the username or password for the login dynamically. If I want to run multiple tests, with different users, then I cannot do it. When it comes to running tests, it needs an option to use different users or authentications. This is a very important feature that is missing.

        For how long have I used the solution?

        More than five years.

        What do I think about the stability of the solution?

        This solution is very stable.

        What do I think about the scalability of the solution?

        Scalability is not particularly relevant. It depends on what kind of scaling you want to do. Generally, it has very good support for scaling.

        There are hundreds of developers using this solution.

        How are customer service and technical support?

        We only had one issue, and I would rate their technical support at medium, based on that experience. The issue was related to shrinking a database, where it was not working well. It took a long time for Microsoft support to fix the problem.

        Which solution did I use previously and why did I switch?

        We did not use another solution prior to this one. However, I use other tools in conjunction with Azure DevOps. One of these is Jenkins, for CICD, and I also use the Atlassian Suite.

        How was the initial setup?

        The initial setup for the latest version was very straightforward. The upgrade was quick and lightweight.

        What about the implementation team?

        I handled the implementation on my own.

        What other advice do I have?

        This is a solution that I would recommend.

        Azure DevOps is a leading platform, but some things can be better. 

        I would rate this solution a seven out of ten.

        Disclosure: I am a real user, and this review is based on my own experience and opinions.
        PeerSpot user
        it_user1101249 - PeerSpot reviewer
        Senior Project Manager at a financial services firm with 5,001-10,000 employees
        Real User
        Moving our automation and testing to a cloud-based solution has made it easier to work with and maintain
        Pros and Cons
        • "It's graphical representation and tools are easy to use."
        • "Non-functional testing such as security testing, log testing, and performance testing can be improved with a better visualization."

        What is most valuable?

        The two most valuable features are Azure Pipelines for DevOps automation, and Azure Test Plan for test management.

        It is quite easy to create a pipeline, from continuous integration to automated testing, to continuous delivery, performance testing, and continuous deployment. It's graphical representation and tools are easy to use.

        The automated testing in DevTest is the big advantage of Azure DevOps.

        What needs improvement?

        Non-functional testing such as security testing, penetration testing, and performance testing could be improved. 

        For how long have I used the solution?

        Two years.

        What do I think about the stability of the solution?

        This Cloud solution is very stable.

        What do I think about the scalability of the solution?

        We have approximately one hundred users, the majority of which are developers. There are some project managers and team leads, as well as different levels of management who present to stakeholders.

        Currently, two or three of our development teams use Azure DevOps. In the future, we plan to include five more teams. This will grow the number of active users from one hundred to two or three hundred.

        How are customer service and technical support?

        I have not used Microsoft support directly. We have an internal support team that is dedicated to Office 365, Azure DevOps, and other Microsoft solutions.

        Which solution did I use previously and why did I switch?

        Prior to this, we used Team Foundation Server versions 2017 and 2018 on-premise, and it was a stable solution.

        We also used the Atlassian stack, including Jira, Bamboo, and Confluence, all on-premise. The problem is that the on-premise version has an expiry. We moved to a cloud solution because it is easy to support, easy to upgrade, and easy to stage our products. It is distributed between our offices, as we have development teams split into different locations around the country. The cloud-based solution is the best way to integrate our development effort.

        I have also worked with HP ALM/Quality Center in the past.

        How was the initial setup?

        The initial setup for this solution is quite easy.

        What about the implementation team?

        Our internal DevOps team handled the implementation.

        Which other solutions did I evaluate?

        I have worked with other products, and this is the best solution in the market in 2019.

        What other advice do I have?

        Deployment of solutions on Azure DevOps is a perfect way to provide Disaster Recovery and High Availability. This is a straightforward solution, and I would suggest not wasting any time looking at others.

        Right now, this is the best solution.

        I would rate this solution ten out of ten.

        Disclosure: I am a real user, and this review is based on my own experience and opinions.
        PeerSpot user
        System Engineer at a tech services company with 51-200 employees
        Real User
        User-friendly with good management features
        Pros and Cons
        • "The user interface is very friendly."
        • "I would like to see more customization available to the administrator."

        What is most valuable?

        I like the management features and the user interface is very friendly.

        What needs improvement?

        It is not clear what features have been added or enhanced since the last version. My customer used a previous version and it did not meet their expectations, so clarification with respect to the new version is needed on their website or other venues.

        I would like to see more customization available to the administrator. You need to change the workflow of the end result.

        For how long have I used the solution?

        Trial/evaluation for approximately one week.

        What do I think about the stability of the solution?

        I did not load the application heavily, but it was stable.

        What do I think about the scalability of the solution?

        I only tested this solution with a single user. I think that it is scalable, as long as you increase the resources as you move to a larger scale.

        How are customer service and technical support?

        I have not been in touch with technical support yet.

        How was the initial setup?

        The initial setup is very simple.

        What about the implementation team?

        I performed the setup myself, on my laptop.

        What other advice do I have?

        I would advise someone considering this solution to use Microsoft because it is very user-friendly, it can run on small levels of applications, can be calibrated to the application, it can be scaled to a larger scale, from small scale to larger scale. It's very stable, you just need to increase the receptors if you need to scale to a larger scale. 

        I would rate this solution a nine out of ten.

        Disclosure: I am a real user, and this review is based on my own experience and opinions.
        PeerSpot user
        Technical Architect at Dwr Cymru Welsh Water
        Real User
        Allows for source control and CI/CD pipelines

        What is our primary use case?

        Full DevOps suite.

        How has it helped my organization?

        Allows for source control and CI/CD pipelines while linking back to the work items on the Kanban board.

        What is most valuable?

        CI/CD pipelines and repositories.

        What needs improvement?

        Information to make it easier to choose items from the marketplace (like MS verified), etc.  Otherwise, every item requires a full InfoSec review.

        For how long have I used the solution?

        Less than one year.
        Disclosure: I am a real user, and this review is based on my own experience and opinions.
        PeerSpot user
        PeerSpot user
        Lead DevOps and Release Engineer-L2 at ITWORX
        Real User
        It's a matter of integration to have only one platform for all your software development life cycle

        What is our primary use case?

        • Source code management
        • Git repository management including a visualizing for the pull requests process
        • Build automation
        • Continuous integration
        • Project management
        • Test management 
        • Release automation
        • Deployments automation
        • Artifacts management
        • Package management
        • Agile planning 
        • Dashboards and reports
        • Requirement management
        • Work estimation 
        • Capacity management
        • Backlogs and Kanban boards for different teams
        • Load test 
        • Integration test automation and unit test projects with status reports on the test results.

        How has it helped my organization?

        Azure DevOps helps us to implement all our DevOps practices with a complete end-to-end cycle starting from code commit till the production deployment including continuous feedback.

        This enables us to release the silos between the teams and enhance collaboration. Also, it gives us more control on the project delivery lifecycle and to fix the issues more earlier than before as we are aligned and working on one integrated system which can give us reports about any piece of info.

        What is most valuable?

        • Linking the project teamwork (bugs, tasks, user stories, test cases ) with the code, build, release, delivery
        • It's a matter of integration to have only one platform for all your software development life cycle.

        What needs improvement?

        • Enable more control on Application Insights integration to open different types of work items as this is area still need more enhancements.
        • Test management extension is too high to be paid on a monthly basis.
        • Test and feedback chrome extension still need more development as they are not very stable.

        For how long have I used the solution?

        One to three years.
        Disclosure: I am a real user, and this review is based on my own experience and opinions.
        PeerSpot user
        Daniel Hall - PeerSpot reviewer
        Daniel HallTechnical Architect at Dwr Cymru Welsh Water
        Real User

        I'd add that the reliability needs improving, there have been a few outages lately, had numerous issues where marketplace modules install but cannot be used and the live updates on running pipelines stop working. As it matures I can see it being a strong competitor

        See all 3 comments
        Buyer's Guide
        Download our free Microsoft Azure DevOps Report and get advice and tips from experienced pros sharing their opinions.
        Updated: November 2023
        Buyer's Guide
        Download our free Microsoft Azure DevOps Report and get advice and tips from experienced pros sharing their opinions.