πŸ“„ Factually ConsistentΒΆ

metrics.llm_as_judge.pairwise.criteria.factually_consistent

Criteria(
    name="factually_consistent",
    description="A factually consistent response contains only statements that are entailed by the source document.",
    prediction_field="response",
    context_fields=[
        "source document",
    ],
)
[source]

Explanation about CriteriaΒΆ

Criteria used by PairwiseLLMJudge to run evaluations.

Read more about catalog usage here.