llm-inference / api
Portkey
Capability: Portkey
Use it when
- AI gateway for logging caching and fallbacks
- observe and route LLM traffic in production
What it solves
Install
npm i portkey-ai
Invoke
# see https://github.com/Portkey-AI/gateway npm i portkey-ai
Alternatives
No reviewed alternatives recorded yet.