📄 Summarization Preference¶

metrics.llm_as_judge.pairwise.criteria.summarization_preference

Criteria(
    name="summarization_preference",
    description="The summary should be accurate and concise. It covers all the article and accurately summarizes it. Keeps the length of summary reasonable. Has no fake data generated outside of the reference article.",
    prediction_field="summary",
    context_fields=[
        "article",
    ],
)
[source]

Explanation about Criteria¶

Criteria used by PairwiseLLMJudge to run evaluations.