No more typing reviews! Try our Samantha, our new voice AI agent.
LLM Gateway Logo

LLM Gateway pros and cons

Vendor: LiteLLM
4.2 out of 5
 

LLM Gateway Pros review quotes

Akashkhurana Hirana - PeerSpot reviewer
Senior Software Engineer 2 at Porch
Jun 13, 2026
Since adopting LLM Gateway, the complexity of our projects has decreased, the security concerns have lessened, and I estimate it has saved us around 20-30% of our time.
Dhanesan Sridhar - PeerSpot reviewer
Decision Scientist 3 at Mu Sigma Inc.
Jul 26, 2026
We have seen a positive return on investment, reducing the time required to integrate new AI models by around 40 to 50 percent, cutting troubleshooting time by about 30 percent through centralized logging and monitoring, and improving service availability with automatic failover, which has reduced operational overhead and allowed the team to focus more on delivering new features rather than maintaining integrations, resulting in a clear ROI.
Shravan Revanna - PeerSpot reviewer
Product Engineer And Founding Engineer at klydo.in
Jul 18, 2026
Together, we would estimate a twenty to twenty-five percent lift in engineering productivity on AI work, and from a business angle, new AI capabilities reach production about twenty-five to thirty percent faster because the plumbing is already in place.
Find out what your peers are saying about LiteLLM, ADEO Imaging OU, Protex AI and others in AWS Marketplace. Updated: July 2026.
908,745 professionals have used our research since 2012.
Guilherme Ferreira Mury - PeerSpot reviewer
Senior Penetration Tester at a wholesaler/distributor with 501-1,000 employees
Aug 3, 2026
LLM Gateway is a very efficient solution for what it proposes and I believe it is a solid option if you want to use something that is self-hosted and you can customize extensively.
reviewer2875980 - PeerSpot reviewer
Software Engineer at a consultancy with 11-50 employees
Jul 22, 2026
What I appreciate most about LLM Gateway is that there is no need to maintain multiple keys.
reviewer2870316 - PeerSpot reviewer
Senior Architect at a tech vendor with 10,001+ employees
Jul 9, 2026
The best features LLM Gateway offers include cost optimization, multi-modal support, and authentication and authorization all in one place.
 

LLM Gateway Cons review quotes

Akashkhurana Hirana - PeerSpot reviewer
Senior Software Engineer 2 at Porch
Jun 13, 2026
Regarding improvements, I think the pricing can be more competitive.
Dhanesan Sridhar - PeerSpot reviewer
Decision Scientist 3 at Mu Sigma Inc.
Jul 26, 2026
LLM Gateway is a strong platform, but there are a few areas where it could improve.
Shravan Revanna - PeerSpot reviewer
Product Engineer And Founding Engineer at klydo.in
Jul 18, 2026
I see a few areas where LLM Gateway can be improved, including clearer cost guardrails and budget alerts that are more proactive, smoother project and workspace organization as the number of services grows, and more first-class support for prompt versioning and experiment tracking so that product teams can self-serve comparisons more easily.
Find out what your peers are saying about LiteLLM, ADEO Imaging OU, Protex AI and others in AWS Marketplace. Updated: July 2026.
908,745 professionals have used our research since 2012.
Guilherme Ferreira Mury - PeerSpot reviewer
Senior Penetration Tester at a wholesaler/distributor with 501-1,000 employees
Aug 3, 2026
The single sign-on functionality being locked out for the enterprise plan is a significant downside, but it is something that can be worked around since LLM Gateway is an open-source project.
reviewer2875980 - PeerSpot reviewer
Software Engineer at a consultancy with 11-50 employees
Jul 22, 2026
A better interface and improved logs would enhance my experience with LLM Gateway.
reviewer2870316 - PeerSpot reviewer
Senior Architect at a tech vendor with 10,001+ employees
Jul 9, 2026
If LLM Gateway could give us a facility or capability to create our own dashboards depending on our requirements, it would be helpful as an improvement.

Product Categories

Product Categories

Product Categories

Product Categories