πŸ“„ Answer CompletenessΒΆ

metrics.llm_as_judge.direct.criteria.answer_completeness

type: CriteriaWithOptions
name: answer_completeness
description: The response is complete: all the aspects of the reference answer are addressed in the response. The response might use different phrasing or wording from the reference answer.
options: 
  - type: CriteriaOption
    name: Excellent
    description: The response addresses all aspects of the reference answer.
  - type: CriteriaOption
    name: Good
    description: The response addresses most aspects of the reference answer, with minor omissions.
  - type: CriteriaOption
    name: mediocre
    description: The response covers the essential aspects of the reference answer but has notable omissions.
  - type: CriteriaOption
    name: Bad
    description: The response covers only a few aspects of the reference answer, with significant omissions.
  - type: CriteriaOption
    name: Very Bad
    description: The response fails to address the reference answer meaningfully, with most aspects omitted.
option_map: 
  Excellent: 1.0
  Good: 0.75
  mediocre: 0.5
  Bad: 0.25
  "Very Bad": 0
[source]

Read more about catalog usage here.