πŸ“„ Reference Document FaithfulnessΒΆ

metrics.llm_as_judge.pairwise.criteria.reference_document_faithfulness

Criteria(
    name="reference_document_faithfulness",
    description="The response is faithful according to the reference document.",
    prediction_field="response",
    context_fields=[
        "reference document",
    ],
)
[source]

Explanation about CriteriaΒΆ

Criteria used by PairwiseLLMJudge to run evaluations.

Read more about catalog usage here.