π Vectara Hhem 2 1ΒΆ
metrics.rag.end_to_end.faithfulness.vectara_hhem_2_1
type: MetricPipeline
main_score: hhem_score
preprocess_steps:
- type: Copy
field_to_field:
prediction/contexts: references
prediction/answer: prediction
metric: metrics.vectara_groundedness_hhem_2_1
score_prefix: faithfulness_vectara_hhem_2_1_
[source]Explanation about CopyΒΆ
Copies values from specified fields to specified fields.
- Args (of parent class):
field_to_field (Union[List[List], Dict[str, str]]): A list of lists, where each sublist contains the source field and the destination field, or a dictionary mapping source fields to destination fields.
- Examples:
An input instance {βaβ: 2, βbβ: 3}, when processed by
Copy(field_to_field={"a": "b"})would yield {βaβ: 2, βbβ: 2}, and when processed byCopy(field_to_field={"a": "c"})would yield {βaβ: 2, βbβ: 3, βcβ: 2}with field names containing / , we can also copy inside the field:
Copy(field="a/0",to_field="a")would process instance {βaβ: [1, 3]} into {βaβ: 1}
References: metrics.vectara_groundedness_hhem_2_1
Read more about catalog usage here.