MerchantryTidbits

evals-testing / library

deepeval

Capability: deepeval

Use it when

  • pytest style LLM evaluation metrics
  • trajectory tests for agents
  • regression tests for prompts

What it solves

Not the fit when

  • replaces human review

Install

pip install deepeval

Invoke

from deepeval import assert_test  # pytest-style LLM metrics / trajectory tests

Alternatives

promptfoo