logo
G

Gateway

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

平台Zeabur
部署次数26
发布者vrushankportkey
部署次数26
发布者vrushankportkey
创建于2024-02-16
服务
service icon
标签
API

模板描述

Portkey's AI Gateway is the interface between your app and hosted LLMs. It streamlines API requests to OpenAI, Anthropic, Mistral, LLama2, Anyscale, Google Gemini and more with a unified API.

✅ Blazing fast (9.9x faster) with a tiny footprint (~45kb installed) ✅ Load balance across multiple models, providers, and keys ✅ Fallbacks make sure your app stays resilient ✅ Automatic Retries with exponential fallbacks come by default ✅ Plug-in middleware as needed ✅ Battle tested over 100B tokens