LLM Gateway
LLM Gateway is an open source API gateway that routes, manages, and tracks costs of requests to many large language model providers.
LLM Gateway
VerifiedLLM Gateway is an open source API gateway that routes, manages, and tracks costs of requests to many large language model providers.
Product Overview
LLM Gateway is an open source API gateway that routes, manages, and tracks costs of requests to many large language model providers.
About This Tool
Overview
As an LLM gateway and AI API tool, LLM Gateway stands apart by being fully open source under an MIT license.
LLM Gateway gives you one API in the OpenAI format that routes requests to a wide range of LLM providers, so moving an existing app over should take little rewriting.
It tracks cost and latency in real time and handles API key management.
You can self-host it or use the cloud version.
The free cloud plan takes a 5% fee on credit usage and keeps data for only 3 days.
The Pro plan has no gateway fee when you bring your own provider keys.
Enterprise add-ons include dedicated shards and custom SLAs.
Team Members on Pro is still marked as coming soon.
AI API
free
https://llmgateway.io/
published
3 views • 0/5 rating
Other, AI Developer Tools, AI Models...
Frequently Asked Questions
Integrations & Connections
Works with (on SoftwareVital)
No linked products yet
When this product officially integrates with other listings on SoftwareVital, they appear here. Add them from the product submit or edit form.
Media Gallery
Screenshots & Photos
Demo Videos
No Demo Video Available
Features & Capabilities
Key Features
Pros & Cons
Pros
- Fully open source under an MIT license
- Unified API compatible with OpenAI format for easy migration
- Supports a wide range of LLM providers
- Provides deep
- real-time cost and latency analytics
- Offers secure API key management
Cons
No notable drawbacks reported yet.
Pricing & Access
Pricing Information
Reviews & Ratings
User Ratings
Leave a Review
Share your experience with this tool
Key Features
Pricing
Free
User Reviews
Share your experience
Help others make better decisions by sharing your detailed thoughts on LLM Gateway.