MerchantryTidbits

evals-testing / cli

promptfoo

Capability: promptfoo

Use it when

  • regression test LLM prompts and RAG outputs in CI
  • compare model outputs before shipping agent changes

What it solves

Install

npm i -g promptfoo

Invoke

promptfoo eval -c promptfooconfig.yaml

Alternatives

deepeval