MerchantryTidbits

llm-inference / library

Tiktoken

Capability: Tiktoken

Use it when

  • count tokens for OpenAI-compatible models
  • budget context windows before calling the API

What it solves

context-window-overflow

Install

pip install tiktoken

Invoke

# see https://github.com/openai/tiktoken
pip install tiktoken

Alternatives

No reviewed alternatives recorded yet.