πŸ“„ Deberta Large MnliΒΆ

Note

ID: metrics.rag.response_generation.correctness.bert_score.deberta_large_mnli | Type: MetricPipeline

{
    "main_score": "recall",
    "metric": "metrics.bert_score.deberta_large_mnli",
    "postpreprocess_steps": [
        {
            "field_to_field": {
                "score/global/f1": "score/global/correctness_f1_bert_score.deberta_large_mnli",
                "score/global/precision": "score/global/correctness_precision_bert_score.deberta_large_mnli",
                "score/global/recall": "score/global/correctness_recall_bert_score.deberta_large_mnli",
                "score/instance/f1": "score/instance/correctness_f1_bert_score.deberta_large_mnli",
                "score/instance/precision": "score/instance/correctness_precision_bert_score.deberta_large_mnli",
                "score/instance/recall": "score/instance/correctness_recall_bert_score.deberta_large_mnli"
            },
            "not_exist_ok": true,
            "type": "copy_fields"
        }
    ],
    "prediction_type": "str",
    "preprocess_steps": [],
    "type": "metric_pipeline"
}

Explanation about CopyFieldsΒΆ

Copies values from specified fields to specified fields.

Args (of parent class):

field_to_field (Union[List[List], Dict[str, str]]): A list of lists, where each sublist contains the source field and the destination field, or a dictionary mapping source fields to destination fields.

Examples:

An input instance {β€œa”: 2, β€œb”: 3}, when processed by CopyField(field_to_field={β€œa”: β€œb”} would yield {β€œa”: 2, β€œb”: 2}, and when processed by CopyField(field_to_field={β€œa”: β€œc”} would yield {β€œa”: 2, β€œb”: 3, β€œc”: 2}

with field names containing / , we can also copy inside the field: CopyFields(field_to_field={β€œa/0”: β€œa”}) would process instance {β€œa”: [1, 3]} into {β€œa”: 1}

References: metrics.bert_score.deberta_large_mnli

Read more about catalog usage here.