πŸ“„ Summarization PreferenceΒΆ

metrics.llm_as_judge.pairwise.criteria.summarization_preference

Criteria(
    name="summarization_preference",
    description="The summary should be accurate and concise. It covers all the article and accurately summarizes it. Keeps the length of summary reasonable. Has no fake data generated outside of the reference article.",
)
[source]

Read more about catalog usage here.