π Sentence Bert Mini LmΒΆ
metrics.rag.end_to_end.context_relevance.sentence_bert_mini_lm
type: MetricPipeline
main_score: sbert_score
preprocess_steps:
- type: Copy
field: prediction/contexts
to_field: references
- type: Copy
field: task_data/question
to_field: prediction
- type: MultiTypeSerializer
field: prediction
metric: metrics.sentence_bert.minilm_l12_v2
score_prefix: context_relevance_sentence_bert_mini_lm_
[source]Explanation about CopyΒΆ
Copies values from specified fields to specified fields.
- Args (of parent class):
field_to_field (Union[List[List], Dict[str, str]]): A list of lists, where each sublist contains the source field and the destination field, or a dictionary mapping source fields to destination fields.
- Examples:
An input instance {βaβ: 2, βbβ: 3}, when processed by
Copy(field_to_field={"a": "b"})would yield {βaβ: 2, βbβ: 2}, and when processed byCopy(field_to_field={"a": "c"})would yield {βaβ: 2, βbβ: 3, βcβ: 2}with field names containing / , we can also copy inside the field:
Copy(field="a/0",to_field="a")would process instance {βaβ: [1, 3]} into {βaβ: 1}
References: metrics.sentence_bert.minilm_l12_v2
Read more about catalog usage here.