logo
G

Gateway

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

PlatformZeabur
Deployed46
Publishervrushankportkey
Deployed46 times
Publishervrushankportkey
Created2024-02-16
Services
service icon
Tags
API

Portkey's AI Gateway is the interface between your app and hosted LLMs. It streamlines API requests to OpenAI, Anthropic, Mistral, LLama2, Anyscale, Google Gemini and more with a unified API.

✅ Blazing fast (9.9x faster) with a tiny footprint (~45kb installed) ✅ Load balance across multiple models, providers, and keys ✅ Fallbacks make sure your app stays resilient ✅ Automatic Retries with exponential fallbacks come by default ✅ Plug-in middleware as needed ✅ Battle tested over 100B tokens