πŸ“„ Answer RewardΒΆ

metrics.rag.response_generation.answer_relevance.answer_reward

type: MetricPipeline
main_score: reward_score
preprocess_steps: 
  - type: Wrap
    field: task_data/question
    inside: list
    to_field: references
  - type: MultiTypeSerializer
    field: references
    process_every_value: True
metric: metrics.reward.deberta_v3_large_v2
score_prefix: answer_relevance_
[source]

References: metrics.reward.deberta_v3_large_v2

Read more about catalog usage here.