No more typing reviews! Try our Samantha, our new voice AI agent.

LLM Gateway vs Zscaler Software [Private Offer Only] comparison

Why PeerSpot?
 

Comparison Buyer's Guide

Executive Summary

Review summaries and opinions

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Categories and Ranking

LLM Gateway
Ranking in AWS Marketplace
17th
Average Rating
8.4
Number of Reviews
6
Ranking in other categories
No ranking in other categories
Zscaler Software [Private O...
Ranking in AWS Marketplace
458th
Average Rating
7.6
Number of Reviews
3
Ranking in other categories
No ranking in other categories
 

Featured Reviews

Akashkhurana Hirana - PeerSpot reviewer
Senior Software Engineer 2 at Porch
Centralized AI routing has strengthened data security and simplified multi-model workflows
The best features LLM Gateway offers include multi-provider AI access and the ability to access around 200 plus models available in the market. We just need to pass our key and set up this one, and it can access all the available models. Apart from this, it automatically routes the request based on context if we set it in LLM Gateway. Another feature is the automatic failover functionality where if something goes wrong, it redirects the request to another model. LLM Gateway also provides usage analytics with a dashboard where we can check the current usage of each model and see how many requests are going to each model. It persists data for around 30 days, so we can review usage over the last month. LLM Gateway can be self-hosted as well, which is beneficial for large companies with security concerns. I find multi-provider access and failover to be the most valuable features day-to-day. Multi-provider access integrates all available models, acting as a router between the application and LLM Gateway. If my application is using four different models, I only need to call LLM Gateway, which manages everything. We also do not need to share sensitive API keys, as the developer can directly call LLM Gateway, which handles everything seamlessly. The failover feature automatically redirects requests if something goes wrong in one model, and it is incredibly easy to configure. It does not take more than a minute to set up. One positive impact of LLM Gateway on my organization is reducing security risk. If we give API keys to everyone, they can misuse them outside the organization. However, we no longer share API keys, as users just need to call our LLM Gateway, and the API keys remain secret and contained within our on-premises setup. Security-wise, it has significantly reduced our organization's risk.
Carlos Snel - PeerSpot reviewer
Executive Director at Aquila ICT Solutions
Zero trust security has provided flexible protection and inspects real-time traffic effectively
From my perspective, I think about Zscaler Software [Private Offer Only], not much could be improved. It is working very well. The only thing is about the POP presence, where you hook into a continent or country. In some countries, South America has some coverage, but not as much as for instance North America or Europe. If you talk with large enterprises or multinationals that are everywhere in the world present, they might need something in Africa. Africa is also a continent where you have more and more enterprises having their subsidiaries there. Africa is not covered very thoroughly, in my opinion. It only has South Africa with points of presence and then Egypt. It is either very up north or very down south. If you are in the middle of Africa, which is an extremely large continent, then you have delays and latencies. That is not very nice. However, that is not only counting for Zscaler Software [Private Offer Only]; this is also for all competitors. I am working with Cato Networks now for more than a year and the same story applies to them. I also know other competitors of Zscaler Software [Private Offer Only] which have even less coverage. It is not something that I think everyone is keen on to expand in Africa because they do not see much traffic. However, if you have multinationals that are operating in Africa, then you cannot offer very good quality service because you have large latency if they are in the middle of Africa. Not even in the middle of Africa; if you talk about under Morocco, then you either connect to Cairo or you connect to Spain. Spain is closest, but if you always have redundancy, and if Spain falls out for whatever reason, even though that is not happening much because the data centers are very stable, then you have an enormous latency going to Cairo. Coming with this to more North Africa, if you talk about Angola and Mozambique in the middle of Africa, then you do not have much choice. You always have a lot of latency there. That is unfortunate. On the technical terms, that is where I stand. I mentioned this before, and it is still the same. I think I talked with you a few years back about this; I think three or four years ago. I mentioned exactly this topic then, and it is still the same. The other thing is, I think in terms of software, they are doing their best. They are buying in firms and buying in solutions, so they are expanding, and that is fine. I would rather say to Zscaler Software [Private Offer Only] to have better customer service because Zscaler Software [Private Offer Only], even with large enterprises and huge companies that I work for, they notice that Zscaler Software [Private Offer Only] service management is different. They are very big and they have less attention to client matters. If that would improve, it would be the best for Zscaler Software [Private Offer Only] to have better customer success managers, but more attention to clients and more direct interface to the deep core of the company for client matters if they have questions or specific things that they do not currently have. If I have something with the client, I have sometimes to escalate to the vice president that I know because I worked with him before, and that is unfortunate. That should not be necessary to go that route. You should have things arranged directly with an account manager or customer success manager of your client if you have problems, or at least have responses saying, this is impossible, we cannot do that because of this, this, this, whatever. At least you should have an answer. I think in the future, everyone in the branch is focusing on AI and quantum computing as a mix. I think on that end, everyone in the domain is working hard to find the best solutions against those two challenges. I think Zscaler Software [Private Offer Only] is doing their best as well there. That is the challenge for the upcoming years, to get the best answers to it. Eventually, they will compete with the same; fight it back with the same power. That means also with quantum computing or specially designed AI to attack back when attackers are attacking. I am not the genius saying that there will be a sort of war game coming up in the future in this domain. However, they are working on it, as all the others are doing, and I think that is absolutely the focus for the coming years because that is where everyone has concern about.

Quotes from Members

We asked business professionals to review the solutions they use. Here are some excerpts of what they said:
 

Pros

"What I appreciate most about LLM Gateway is that there is no need to maintain multiple keys."
"Together, we would estimate a twenty to twenty-five percent lift in engineering productivity on AI work, and from a business angle, new AI capabilities reach production about twenty-five to thirty percent faster because the plumbing is already in place."
"LLM Gateway is a very efficient solution for what it proposes and I believe it is a solid option if you want to use something that is self-hosted and you can customize extensively."
"We have seen a positive return on investment, reducing the time required to integrate new AI models by around 40 to 50 percent, cutting troubleshooting time by about 30 percent through centralized logging and monitoring, and improving service availability with automatic failover, which has reduced operational overhead and allowed the team to focus more on delivering new features rather than maintaining integrations, resulting in a clear ROI."
"The best features LLM Gateway offers include cost optimization, multi-modal support, and authentication and authorization all in one place."
"Since adopting LLM Gateway, the complexity of our projects has decreased, the security concerns have lessened, and I estimate it has saved us around 20-30% of our time."
"Zscaler Software [Private Offer Only] itself, I think it is pretty good and I only get compliments from clients that are using it after the implementation; they like it."
"I use Zscaler Software [Private Offer Only]'s real-time traffic inspection feature and find it helpful."
"Zscaler Software is very beneficial for my clients, reducing time by at least more than 50%, improving specific metrics through encrypted threat detection, increasing productivity, and reducing the workload of the analyst so they can respond faster."
 

Cons

"The single sign-on functionality being locked out for the enterprise plan is a significant downside, but it is something that can be worked around since LLM Gateway is an open-source project."
"If LLM Gateway could give us a facility or capability to create our own dashboards depending on our requirements, it would be helpful as an improvement."
"LLM Gateway is a strong platform, but there are a few areas where it could improve."
"A better interface and improved logs would enhance my experience with LLM Gateway."
"Regarding improvements, I think the pricing can be more competitive."
"I see a few areas where LLM Gateway can be improved, including clearer cost guardrails and budget alerts that are more proactive, smoother project and workspace organization as the number of services grows, and more first-class support for prompt versioning and experiment tracking so that product teams can self-serve comparisons more easily."
"I would rather say to Zscaler Software [Private Offer Only] to have better customer service because Zscaler Software [Private Offer Only], even with large enterprises and huge companies that I work for, they notice that Zscaler Software [Private Offer Only] service management is different."
"Regarding Zscaler Software [Private Offer Only], to be honest, we do not like it."
report
Use our free recommendation engine to learn which AWS Marketplace solutions are best for your needs.
921,523 professionals have used our research since 2012.
 

Top Industries

By visitors reading reviews
Construction Company
17%
Comms Service Provider
13%
Wholesaler/Distributor
7%
Financial Services Firm
7%
No data available
 

Company Size

By reviewers
Large Enterprise
Midsize Enterprise
Small Business
By reviewers
Company SizeCount
Small Business3
Midsize Enterprise3
Large Enterprise2
No data available
 

Questions from the Community

What is your experience regarding pricing and costs for LLM Gateway?
My experience with pricing, setup costs, and licensing for LLM Gateway is that it is reasonable and predictable for us. The setup was light, mostly involving integration and configuration rather th...
What needs improvement with LLM Gateway?
LLM Gateway is an open-source and self-hosted solution, while OpenRouter is a SaaS solution. I think they overlap each other in some ways. OpenRouter allows you to bring your own API key, and LLM G...
What is your primary use case for LLM Gateway?
I am currently evaluating the implementation of LLM Gateway on our agency environment. I have extensive experience with LLM Gateway and Guardrails, and it has become my primary focus at work. We ar...
What needs improvement with Zscaler Software [Private Offer Only]?
One area for improvement for Zscaler Software is that they should have their dependency on AI validated and verified. Because if they are a service provider, they are doing a good job, but they hav...
What is your primary use case for Zscaler Software [Private Offer Only]?
Zscaler Software provides cloud security as the use case for my clients.
 

Comparisons

No data available
 

Overview

Find out what your peers are saying about LLM Gateway vs. Zscaler Software [Private Offer Only] and other solutions. Updated: October 2026.
921,523 professionals have used our research since 2012.