📄 model_response_assessment¶

Note

ID: tasks.rag.model_response_assessment | Type: FormTask

{
    "inputs": [
        "question",
        "model_output"
    ],
    "metrics": [
        "metrics.spearman"
    ],
    "outputs": [
        "rating_label"
    ],
    "type": "form_task"
}

Explanation about FormTask¶

FormTask packs the different instance fields into dictionaries by their roles in the task.

The output instance contains three fields:
“inputs” whose value is a sub-dictionary of the input instance, consisting of all the fields listed in Arg ‘inputs’. “outputs” – for the fields listed in Arg “outputs”. “metrics” – to contain the value of Arg ‘metrics’

References: metrics.spearman