π MapΒΆ
metrics.rag.external_rag.context_correctness.map
type: MetricPipeline
main_score: map
preprocess_steps:
- type: Copy
field: context_ids
to_field: prediction
- type: Wrap
field: ground_truths_context_ids
inside: list
to_field: references
metric: metrics.map
score_prefix: context_correctness_
[source]Explanation about CopyΒΆ
Copies values from specified fields to specified fields.
- Args (of parent class):
field_to_field (Union[List[List], Dict[str, str]]): A list of lists, where each sublist contains the source field and the destination field, or a dictionary mapping source fields to destination fields.
- Examples:
An input instance {βaβ: 2, βbβ: 3}, when processed by
Copy(field_to_field={"a": "b"})would yield {βaβ: 2, βbβ: 2}, and when processed byCopy(field_to_field={"a": "c"})would yield {βaβ: 2, βbβ: 3, βcβ: 2}with field names containing / , we can also copy inside the field:
Copy(field="a/0",to_field="a")would process instance {βaβ: [1, 3]} into {βaβ: 1}
References: metrics.map
Read more about catalog usage here.