📄 multiple_choice¶

Note

ID: tasks.completion.multiple_choice | Type: FormTask

{
    "inputs": {
        "choices": "List[str]",
        "context": "str",
        "context_type": "str"
    },
    "metrics": [
        "metrics.accuracy"
    ],
    "outputs": {
        "answer": "int",
        "choices": "List[str]"
    },
    "prediction_type": "Any",
    "type": "form_task"
}

Explanation about FormTask¶

FormTask packs the different instance fields into dictionaries by their roles in the task.

Attributes:

inputs (Union[Dict[str, str], List[str]]):
Dictionary with string names of instance input fields and types of respective values. In case a list is passed, each type will be assumed to be Any.

outputs (Union[Dict[str, str], List[str]]):
Dictionary with string names of instance output fields and types of respective values. In case a list is passed, each type will be assumed to be Any.

metrics (List[str]): List of names of metrics to be used in the task. prediction_type (Optional[str]):

Need to be consistent with all used metrics. Defaults to None, which means that it will be set to Any.

The output instance contains three fields:
“inputs” whose value is a sub-dictionary of the input instance, consisting of all the fields listed in Arg ‘inputs’. “outputs” – for the fields listed in Arg “outputs”. “metrics” – to contain the value of Arg ‘metrics’

References: metrics.accuracy