π Answer CompletenessΒΆ
metrics.llm_as_judge.direct.criteria.answer_completeness
type: CriteriaWithOptions
name: answer_completeness
description: The response is complete: all the aspects of the reference answer are addressed in the response. The response might use different phrasing or wording from the reference answer.
options:
- type: CriteriaOption
name: Excellent
description: The response addresses all aspects of the reference answer.
- type: CriteriaOption
name: Good
description: The response addresses most aspects of the reference answer, with minor omissions.
- type: CriteriaOption
name: mediocre
description: The response covers the essential aspects of the reference answer but has notable omissions.
- type: CriteriaOption
name: Bad
description: The response covers only a few aspects of the reference answer, with significant omissions.
- type: CriteriaOption
name: Very Bad
description: The response fails to address the reference answer meaningfully, with most aspects omitted.
option_map:
Excellent: 1.0
Good: 0.75
mediocre: 0.5
Bad: 0.25
"Very Bad": 0
[source]Read more about catalog usage here.