G

Gateway

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

プラットフォームZeabur
展開済み56
発行者vrushankportkey
展開済み56
発行者vrushankportkey
作成日2024-02-16
サービス
service icon
タグ
API

Portkey's AI Gateway is the interface between your app and hosted LLMs. It streamlines API requests to OpenAI, Anthropic, Mistral, LLama2, Anyscale, Google Gemini and more with a unified API.

✅ Blazing fast (9.9x faster) with a tiny footprint (~45kb installed) ✅ Load balance across multiple models, providers, and keys ✅ Fallbacks make sure your app stays resilient ✅ Automatic Retries with exponential fallbacks come by default ✅ Plug-in middleware as needed ✅ Battle tested over 100B tokens