logo
G

Gateway

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

平台Zeabur
部署次數26
發布者vrushankportkey
部署次數26
發布者vrushankportkey
建立於2024-02-16
服務
service icon
標籤
API

模板描述

Portkey's AI Gateway is the interface between your app and hosted LLMs. It streamlines API requests to OpenAI, Anthropic, Mistral, LLama2, Anyscale, Google Gemini and more with a unified API.

✅ Blazing fast (9.9x faster) with a tiny footprint (~45kb installed) ✅ Load balance across multiple models, providers, and keys ✅ Fallbacks make sure your app stays resilient ✅ Automatic Retries with exponential fallbacks come by default ✅ Plug-in middleware as needed ✅ Battle tested over 100B tokens