Try our new research platform with insights from 80,000+ expert users

Microsoft Azure DevOps vs Nolio Release Automation comparison

 

Comparison Buyer's Guide

Executive SummaryUpdated on Jan 7, 2025

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

ROI

Sentiment score
6.8
Microsoft Azure DevOps offers positive ROI, enhancing productivity and efficiency, with challenges in integrating non-Microsoft tools noted.
Sentiment score
6.0
Nolio Release Automation enhances continuous delivery reliability but may require licensing updates; standard setups implement quickly, boosting efficiency.
On a scale of one to ten, where ten is the best, I would say ROI is an eight.
 

Customer Service

Sentiment score
6.8
Microsoft Azure DevOps support is generally responsive and helpful, with high documentation ratings but occasional delays in complex issues.
Sentiment score
6.7
Nolio Release Automation customer service is efficient and responsive, but users seek improvements in expertise and regional support.
Resolving issues took time since understanding our unique problems was not always straightforward for support teams.
I would rate technical support from Microsoft for Microsoft Azure DevOps an eight out of ten.
 

Scalability Issues

Sentiment score
7.4
Azure DevOps is highly scalable, adaptable for small to large teams, supporting seamless growth and complex projects effectively.
Sentiment score
7.0
Nolio Release Automation offers flexible scaling for many, although some face limitations with HA capabilities and infrastructure challenges.
The scalability has left me pleased, not just for our teams in Europe, the Middle East, and Asia, but as we expanded into North America, Africa, and even Australia.
 

Stability Issues

Sentiment score
7.9
Microsoft Azure DevOps is highly stable with excellent support, quick issue resolution, and users rating its reliability highly.
Sentiment score
6.4
Nolio Release Automation's stability varies; newer versions improve performance, yet large-scale deployments sometimes experience challenges and slowness.
Its stability might be attributed to its legacy as an on-premise solution that has been in development for more than 25 years.
The solution is stable, and we did not encounter any stability issues.
Everything works ninety-nine percent well.
This might be because it is a six-year-old version, and we are supporting nearly 1,500 applications and 15,000 to 16,000 agents.
 

Room For Improvement

Microsoft Azure DevOps users seek enhancements in integration, project management, UI, testing, collaboration, documentation, and workflow integration.
Users seek better UI, stability, documentation, integration, and cost-efficiency in Nolio Release Automation for improved user experience.
Out of the box, the solution is effective, yet with advancements in AI, it has the potential to be more intuitive.
Instead of customers having to try many options themselves, they benefit from practitioner recommendations.
Those processes are a bit difficult for some customers who may not have technical knowledge and don't go through the entire documentation.
It is one of the greatest tools for continuous deployment, yet its popularity remains limited.
 

Setup Cost

Microsoft Azure DevOps is cost-effective, especially for small teams, but prices can vary with additional features and usage.
Enterprise buyers find Nolio Release Automation expensive due to setup costs and licensing complexities, but appreciate CA's customized pricing support.
They don't even provide a POC where you can have a sandbox or stuff that you can go through and see how exactly it's costing.
I find it to be expensive.
The price and licensing of Microsoft Azure DevOps were fair.
 

Valuable Features

Microsoft Azure DevOps offers seamless tool integration, intuitive UI, and comprehensive CI/CD features ideal for software development management.
Nolio Release Automation offers user-friendly, no-code deployment with flexible OS support, reducing errors and operational costs.
I can't approve my own request and move the code around without a review.
No organization would use just one vendor, and the goal is about what works well, is scalable, performs well, and offers a reasonable total cost of ownership.
Our company organized a training session with a certified Azure expert, which was extremely beneficial for adopting best practices during the initial three months.
 

Categories and Ranking

Microsoft Azure DevOps
Ranking in Release Automation
1st
Average Rating
8.2
Reviews Sentiment
7.0
Number of Reviews
135
Ranking in other categories
Application Lifecycle Management (ALM) Suites (2nd), Enterprise Agile Planning Tools (1st)
Nolio Release Automation
Ranking in Release Automation
7th
Average Rating
7.8
Reviews Sentiment
6.9
Number of Reviews
51
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of August 2025, in the Release Automation category, the mindshare of Microsoft Azure DevOps is 33.0%, down from 40.5% compared to the previous year. The mindshare of Nolio Release Automation is 1.1%, up from 0.8% compared to the previous year. It is calculated based on PeerSpot user engagement data.
Release Automation
 

Featured Reviews

Ivan Angelov - PeerSpot reviewer
Facilitates agile transformation with potential for enhanced intuitiveness
What I liked about the solution is that it offers numerous features that are not available by default unless you are agile. Transitioning from the traditional Waterfall model to an agile methodology was challenging for us. Until 2020, our team predominantly worked with the Waterfall approach, using local tools like ServiceNow. We had a few team members who were familiar with Agile ISO, but none had experience with Azure. Therefore, we pursued Azure certification at the AZ-900 level. Our company organized a training session with a certified Azure expert, which was extremely beneficial for adopting best practices during the initial three months. This preparation helped us get accustomed to the new tool, as transitioning to a new system invariably requires time. Managing a pipeline of deliverables became significantly easier with this solution. We utilized it for stories and integrated change management with Azure DevOps. Eventually, everything related to the environment was organized there, enabling us to follow up and track progress with our technical engineers on an hourly, daily, or weekly basis. Reports were automatically generated and sent to management, offering them insights into our progress concerning the predefined roadmap.
Akhilesh B N - PeerSpot reviewer
Real-time monitoring and seamless integration enhance deployment efficiency
The main disadvantage I see is the limited awareness of Nolio Release Automation in other organizations. It is a very nice tool, but its market presence is limited. I heard from the organization that the licensing cost was somewhat expensive. Perhaps focusing on marketing efforts would be beneficial. It is a really nice tool, and I am unsure why many organizations are not using Nolio Release Automation. It is one of the greatest tools for continuous deployment, yet its popularity remains limited. Some organizations are not aware of its existence. This might be an area worth researching and potentially developing new marketing strategies.
report
Use our free recommendation engine to learn which Release Automation solutions are best for your needs.
865,164 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Manufacturing Company
13%
Computer Software Company
12%
Financial Services Firm
11%
Government
9%
Financial Services Firm
63%
Government
5%
Computer Software Company
4%
Manufacturing Company
4%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
 

Questions from the Community

Which is better - Jira or Microsoft Azure DevOps?
Jira is a great centralized tool for just about everything, from local team management to keeping track of products and work logs. It is easy to implement and navigate, and it is stable and scalabl...
Which is better - TFS or Azure DevOps?
TFS and Azure DevOps are different in many ways. TFS was designed for admins, and only offers incremental improvements. In addition, TFS seems complicated to use and I don’t think it has a very fri...
What do you like most about Microsoft Azure DevOps?
Valuable features for project management and tracking in Azure DevOps include a portal displaying test results, check-in/check-out activity, and developer/tester productivity.
What do you like most about Nolio Release Automation?
One standout aspect is its architecture. We can configure multiple instances on a single server using different system names or usernames.
What is your experience regarding pricing and costs for Nolio Release Automation?
Nolio is a pretty much good tool, though its pricing is relatively high in the market. It's more expensive than other tools. The pricing could be cheaper. In our organization, we've been using it f...
What needs improvement with Nolio Release Automation?
When I started using Nolio around eight months ago, a challenge was the lack of relevant information and related support for learning. There's also not many instructional materials and videos on pl...
 

Also Known As

Azure DevOps, VSTS, Visual Studio Team Services, MS Azure DevOps
CA Release Automation
 

Overview

 

Sample Customers

Alaska Airlines, Iberia Airlines, Columbia, Skype
CA Release Automation customers include Citrix, NIIT Technologies, ING Bank, Molina Healthcare, Swisscom, Bupa and Tesco. Read case studies from customers who are igniting and advancing their continuous delivery journey with CA Release Automation.
Find out what your peers are saying about Microsoft Azure DevOps vs. Nolio Release Automation and other solutions. Updated: July 2025.
865,164 professionals have used our research since 2012.