📄 Summarization Preference¶

metrics.llm_as_judge.direct.criteria.summarization_preference

type: CriteriaWithOptions
name: summarization_preference
description: Does the response capture the summary in the best possible way?
options: 
  - type: CriteriaOption
    name: Excellent
    description: The response includes details such as key figures, numbers, dates and details which are crucial for the entire understanding.
  - type: CriteriaOption
    name: Good
    description: The response includes statements expressing emotions and acclamations.
  - type: CriteriaOption
    name: Average
    description: The order of events in the response follows a suitable chronological order.
  - type: CriteriaOption
    name: Poor
    description: The response includes minor and irrelevant details which add no value in a summary.
option_map: 
  Excellent: 1.0
  Good: 0.75
  Average: 0.5
  Poor: 0.0
[source]