π Sentence Bert Mini Lm [deprecated]ΒΆ
Deprecation message: This metric should be replaced with metrics.rag.external_rag.context_relevance.sentence_bert_mini_lm
metrics.rag.context_relevance.sentence_bert_mini_lm
type: MetricPipeline
main_score: sbert_score
preprocess_steps:
- type: Copy
field_to_field:
task_data/contexts: references
question: prediction
not_exist_do_nothing: True
- type: Copy
field_to_field:
contexts: references
not_exist_do_nothing: True
metric: metrics.sentence_bert.minilm_l12_v2
[source]Explanation about CopyΒΆ
Copies values from specified fields to specified fields.
- Args (of parent class):
field_to_field (Union[List[List], Dict[str, str]]): A list of lists, where each sublist contains the source field and the destination field, or a dictionary mapping source fields to destination fields.
- Examples:
An input instance {βaβ: 2, βbβ: 3}, when processed by
Copy(field_to_field={"a": "b"})would yield {βaβ: 2, βbβ: 2}, and when processed byCopy(field_to_field={"a": "c"})would yield {βaβ: 2, βbβ: 3, βcβ: 2}with field names containing / , we can also copy inside the field:
Copy(field="a/0",to_field="a")would process instance {βaβ: [1, 3]} into {βaβ: 1}
References: metrics.sentence_bert.minilm_l12_v2
Read more about catalog usage here.