πŸ“„ Metric TemplateΒΆ

templates.rag_eval.context_relevance.metric_template

InputOutputTemplateWithCustomTarget(
    input_format="Question: {question}
Evidence: {contexts}",
    output_format="{is_context_relevant}",
    postprocessors=[
        "processors.to_string_stripped",
        "processors.cast_to_float_return_zero_if_failed",
    ],
    reference="{number_val}",
    target_prefix="Answer: ",
    instruction="",
)
[source]

References: processors.cast_to_float_return_zero_if_failed, processors.to_string_stripped

Read more about catalog usage here.