MerchantryTidbits

llm-inference / api

Portkey

Capability: Portkey

Use it when

  • AI gateway for logging caching and fallbacks
  • observe and route LLM traffic in production

What it solves

Install

npm i portkey-ai

Invoke

# see https://github.com/Portkey-AI/gateway
npm i portkey-ai

Alternatives

No reviewed alternatives recorded yet.