π MapΒΆ
metrics.rag.context_correctness.map
type: MetricPipeline
main_score: map
preprocess_steps:
- type: Copy
field: context_ids
to_field: prediction
- type: Wrap
field: ground_truths_context_ids
inside: list
to_field: references
metric: metrics.map
[source]Explanation about CopyΒΆ
Copies values from specified fields to specified fields.
- Args (of parent class):
field_to_field (Union[List[List], Dict[str, str]]): A list of lists, where each sublist contains the source field and the destination field, or a dictionary mapping source fields to destination fields.
- Examples:
An input instance {βaβ: 2, βbβ: 3}, when processed by Copy(field_to_field={βaβ: βbβ} would yield {βaβ: 2, βbβ: 2}, and when processed by Copy(field_to_field={βaβ: βcβ} would yield {βaβ: 2, βbβ: 3, βcβ: 2}
with field names containing / , we can also copy inside the field: Copy(field=βa/0β,to_field=βaβ) would process instance {βaβ: [1, 3]} into {βaβ: 1}
References: metrics.map
Read more about catalog usage here.