LLM Gateway
LLM Gateway is an open source API gateway that routes, manages, and tracks costs of requests to many large language model providers.
LLM Gateway
LLM Gateway is an open source API gateway that routes, manages, and tracks costs of requests to many large language model providers.
Product Overview
LLM Gateway is an open source API gateway that routes, manages, and tracks costs of requests to many large language model providers.
About This Tool
Overview
As an LLM gateway and AI API tool, LLM Gateway stands apart by being fully open source under an MIT license.
LLM Gateway gives you one API in the OpenAI format that routes requests to a wide range of LLM providers, so moving an existing app over should take little rewriting.
It tracks cost and latency in real time and handles API key management.
You can self-host it or use the cloud version.
The free cloud plan takes a 5% fee on credit usage and keeps data for only 3 days.
The Pro plan has no gateway fee when you bring your own provider keys.
Enterprise add-ons include dedicated shards and custom SLAs.
Team Members on Pro is still marked as coming soon.
AI API
free
https://llmgateway.io/
published
14 views • 0/5 rating
Other, AI Developer Tools, AI Models...
Frequently Asked Questions
Integrations & Connections
Works with (on SoftwareVital)
No linked products yet
When this product officially integrates with other listings on SoftwareVital, they appear here. Add them from the product submit or edit form.
Features & Capabilities
Key Features
Pros & Cons
Pros
- Fully open source under an MIT license
- Unified API compatible with OpenAI format for easy migration
- Supports a wide range of LLM providers
- Provides deep
- real-time cost and latency analytics
- Offers secure API key management
Cons
No notable drawbacks reported yet.
Pricing & Access
Pricing Information
Reviews & Ratings
User Ratings
Leave a Review
Share your experience with this tool
No reviews yet. Be the first to share your experience!
Key Features
Pricing
Free
User Reviews
No reviews yet. Be the first to share your experience!
Share your experience
Help others make better decisions by sharing your detailed thoughts on LLM Gateway.
Alternatives to LLM Gateway
Alternative OptionsView all alternatives
Macbeth AI
Macbeth AI is an AI writing and content generator for text, ad copy, images, speech and code, with a chat assistant.
1
Value Your Time
Generate QR codes and shorten URLs with a simple interface, available via web, API, or Chrome extension.
OpenAI Thread Lister
View and manage all your OpenAI threads in one place with a centralized listing interface.
Remove.bg Chrome Extension
Chrome extension that removes image backgrounds directly in your browser using the remove.bg API.
WhatsApp Translator
Translate WhatsApp messages automatically using Google Translate, Microsoft Translator, Tencent Translate, DeepL, and OpenAI.
DomainSnap
Find available domain names across 1200+ TLDs using real-time search, bulk checking, and AI suggestions.