G

Gateway

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

PlataformaZeabur
Implementado53
Editorvrushankportkey
Implementado53 veces
Editorvrushankportkey
Creado2024-02-16
Servicios
service icon
Etiquetas
API

Portkey's AI Gateway is the interface between your app and hosted LLMs. It streamlines API requests to OpenAI, Anthropic, Mistral, LLama2, Anyscale, Google Gemini and more with a unified API.

✅ Blazing fast (9.9x faster) with a tiny footprint (~45kb installed) ✅ Load balance across multiple models, providers, and keys ✅ Fallbacks make sure your app stays resilient ✅ Automatic Retries with exponential fallbacks come by default ✅ Plug-in middleware as needed ✅ Battle tested over 100B tokens