No more typing reviews! Try our Samantha, our new voice AI agent.

Azure OpenAI vs IBM Watson Machine Learning comparison

Why PeerSpot?
 

Comparison Buyer's Guide

Executive SummaryUpdated on Dec 4, 2024

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

Azure OpenAI
Ranking in AI Development Platforms
2nd
Average Rating
7.8
Reviews Sentiment
6.4
Number of Reviews
36
Ranking in other categories
No ranking in other categories
IBM Watson Machine Learning
Ranking in AI Development Platforms
16th
Average Rating
8.0
Reviews Sentiment
7.1
Number of Reviews
7
Ranking in other categories
No ranking in other categories
 

Mindshare comparison

As of September 2026, in the AI Development Platforms category, the mindshare of Azure OpenAI is 7.2%, down from 9.9% compared to the previous year. The mindshare of IBM Watson Machine Learning is 1.6%, down from 2.0% compared to the previous year. It is calculated based on PeerSpot user engagement data.
AI Development Platforms Mindshare Distribution
ProductMindshare (%)
Azure OpenAI7.2%
IBM Watson Machine Learning1.6%
Other91.2%
AI Development Platforms
 

Featured Reviews

MA
Consultant/Owner at Transc byte
Intelligent incident remediation has improved and medical summaries are generated automatically
The customization option in Azure OpenAI is quite challenging because any customization must be done through the knowledge base since Azure OpenAI models cannot be trained. I must build a knowledge base and feed it so that it will learn from that knowledge base. This differs from other local LLMs that I can train directly. For integration of Azure OpenAI with other Azure services, I would rate it five out of ten because it is an open Azure product and integrations work well with Azure services. However, when it comes to services outside of Azure, integration is quite difficult and requires more exploration. It is not as convenient. The point for improvement is integration with third-party services, which has a gap that needs addressing. Regarding other points for improvement for Azure OpenAI, Azure OpenAI is performing well overall, but I believe their models should offer local dedicated models for customers. All data sent to the current models goes to public models. Azure OpenAI should provide solutions to deliver local dedicated models for customers and should enable model training based on customer data. Customers are mostly concerned about their data, so this option is not feasible as currently structured. Even if it were dedicated for the customer and not used by others, it still does not align with compliance requirements because it remains an open model.
reviewer2319402 - PeerSpot reviewer
Director of Business Development at a educational organization with 1,001-5,000 employees
Good fit for medium-sized companies, and offers good AutoML feature
In future releases, I would like to see a more flexible environment. It's a good product for customization and developing products. But when we need the most control over the delivery, Watson isn't the best. We can't fix everything because we're working with a machine that's creating a product. And the ability to go in-depth and tweak our model easily would be really nice.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"The product saves a lot of time."
"Azure OpenAI has significantly reduced costs and increased efficiency in tasks such as aggressive testing of systems to avoid anomalies and trust issues."
"It is easy to integrate and develop a solution. Most customers are concerned about the security of their data and how cost-effective it is. We have developed some methodologies so that our customers will not be charged too much for these OpenAI services but will still get the same kind of performance and results. It's all developed on Azure, so customers also see its benefit."
"Two aspects I appreciate are the turnaround time and ease of use. As it's a managed service, the quick turnaround is beneficial, and the simple interface makes it easy to work with. Performance and scalability are also strong points since you can scale as needed."
"It's very powerful. It allows users to query our documents using natural language and receive answers in the same way. This makes our product information much more accessible than traditional keyword-based search."
"Azure OpenAI is useful for benchmarking products."
"The product is easy to integrate with our IT workflow."
"The high precision of information extraction is the most valuable feature."
"I was particularly interested in trying the AutoML feature to see how it handles data and proposes new models. The variety of models it provides is impressive."
"Scalability-wise, I rate the solution ten out of ten."
"I like the whole concept of using Watson; it has a lot of good features and we find the image classification very useful."
"The most valuable aspect of the solution's the cost and human labor savings."
"We can enable and change developer productivity with artificial intelligence-recommended code based on natural language input or exciting source code."
"We have seen an ROI, as it has improved self-service and customer satisfaction."
"The solution is very valuable to our organization due to the fact that we can work on it as a workflow."
 

Cons

"There are certain shortcomings with the product's scalability and support team where improvements are required."
"The product features themselves are fine. However, with Microsoft scaling the service so much, the support structure needs to keep pace. When solving complex issues, the process of interacting with Microsoft can be quite time-consuming."
"One major drawback of Azure OpenAI is its availability, as it's not consistently accessible for effective use."
"Azure could significantly benefit from including more LLM models apart from OpenAI, as I often need to switch clouds when a model doesn't meet my requirements."
"In the next release, they could enhance the product's features for even greater usability and efficiency."
"Azure OpenAI is not available in all regions, and its technical support should be improved."
"Since we don't train the model on our data, it's a struggle to ensure OpenAI answers questions exclusively from our data. During user testing, we found ways to make the system provide answers from outside sources."
"Deployment was slightly complex for me to understand."
"However, early on, they relied heavily on building out these massive reference tables. That was a ton of the work that had to be done."
"In future releases, I would like to see a more flexible environment."
"The supporting language is limited, and other languages could be added."
"Sometimes training the model is difficult."
"Honestly, I haven't seen any comparative report that has run the same data through two different artificial intelligence or machine learning capabilities to get something out of it. I would love to see that."
"They should add more GPU processing power to improve performance, especially when dealing with large amounts of data."
"If I consider how we want to use it in our organization, certain areas of improvement can be addressed. For instance, we want to use it with Generative AI, not like ChatGPT, but in a way intended for industrial use."
"Scaling is limited in some use cases. They need to make it easier to expand in all aspects."
 

Pricing and Cost Advice

"I'm uncertain about the licensing, specifically the pricing. This falls under the purview of other teams, particularly the sales teams. I am not informed about the pricing details."
"It's a token-based system, so you pay per token used by the model."
"The cost is pretty high. Even by US standards, you would find it high."
"The solution's pricing depends on the services you will deploy."
"I rate the product pricing six out of ten."
"The platform offers a flexible pricing model which depends on the features and capabilities we utilize."
"The cost is quite high and fixed."
"The cost structure depends on the volume of data processed and the computational resources required."
"I've only been using the free tier, but it's quite competitive on a service basis."
"The pricing model is good."
report
Use our free recommendation engine to learn which AI Development Platforms solutions are best for your needs.
914,109 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Computer Software Company
9%
Financial Services Firm
9%
Outsourcing Company
9%
Manufacturing Company
9%
Financial Services Firm
10%
Construction Company
9%
Comms Service Provider
9%
University
9%
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business17
Midsize Enterprise1
Large Enterprise19
No data available
 

Questions from the Community

What is your experience regarding pricing and costs for Azure OpenAI?
In terms of pricing for Azure OpenAI, I would rate it as average compared to Gemini. Currently, Gemini is becoming increasingly popular, which prompts leadership to consider a switch primarily due ...
What needs improvement with Azure OpenAI?
The customization option in Azure OpenAI is quite challenging because any customization must be done through the knowledge base since Azure OpenAI models cannot be trained. I must build a knowledge...
What is your primary use case for Azure OpenAI?
Azure OpenAI's main use case for me involves defining solutions for incident remediation where AI provides intelligence to solve problems, perform root cause analysis, or triage incidents or change...
Ask a question
Earn 20 points
 

Overview

Find out what your peers are saying about Azure OpenAI vs. IBM Watson Machine Learning and other solutions. Updated: September 2026.
914,109 professionals have used our research since 2012.