📄 Deberta Large Mnli¶

Note

ID: metrics.rag.response_generation.correctness.bert_score.deberta_large_mnli | Type: MetricPipeline

{
    "__type__": "metric_pipeline",
    "main_score": "recall",
    "metric": "metrics.bert_score.deberta_large_mnli",
    "postpreprocess_steps": [
        {
            "__type__": "copy",
            "field_to_field": {
                "score/global/f1": "score/global/correctness_f1_bert_score.deberta_large_mnli",
                "score/global/precision": "score/global/correctness_precision_bert_score.deberta_large_mnli",
                "score/global/recall": "score/global/correctness_recall_bert_score.deberta_large_mnli",
                "score/instance/f1": "score/instance/correctness_f1_bert_score.deberta_large_mnli",
                "score/instance/precision": "score/instance/correctness_precision_bert_score.deberta_large_mnli",
                "score/instance/recall": "score/instance/correctness_recall_bert_score.deberta_large_mnli"
            },
            "not_exist_ok": true
        }
    ],
    "prediction_type": "str",
    "preprocess_steps": []
}

Explanation about Copy¶

Copies values from specified fields to specified fields.

Args (of parent class):
field_to_field (Union[List[List], Dict[str, str]]): A list of lists, where each sublist contains the source field and the destination field, or a dictionary mapping source fields to destination fields.

Examples:
An input instance {“a”: 2, “b”: 3}, when processed by Copy(field_to_field={“a”: “b”} would yield {“a”: 2, “b”: 2}, and when processed by Copy(field_to_field={“a”: “c”} would yield {“a”: 2, “b”: 3, “c”: 2}

with field names containing / , we can also copy inside the field: Copy(field=”a/0”,to_field=”a”) would process instance {“a”: [1, 3]} into {“a”: 1}

References: metrics.bert_score.deberta_large_mnli