π RelationΒΆ
Note
ID: tasks.classification.multi_class.relation | Type: Task
{
"__type__": "task",
"augmentable_inputs": [
"text_a",
"text_b"
],
"defaults": {
"text_a_type": "first text",
"text_b_type": "second text"
},
"input_fields": {
"classes": "List[str]",
"text_a": "str",
"text_a_type": "str",
"text_b": "str",
"text_b_type": "str",
"type_of_relation": "str"
},
"metrics": [
"metrics.f1_micro",
"metrics.accuracy",
"metrics.f1_macro"
],
"prediction_type": "str",
"reference_fields": {
"label": "str"
}
}
Explanation about TaskΒΆ
Task packs the different instance fields into dictionaries by their roles in the task.
- Attributes:
- input_fields (Union[Dict[str, str], List[str]]):
Dictionary with string names of instance input fields and types of respective values. In case a list is passed, each type will be assumed to be Any.
- reference_fields (Union[Dict[str, str], List[str]]):
Dictionary with string names of instance output fields and types of respective values. In case a list is passed, each type will be assumed to be Any.
metrics (List[str]): List of names of metrics to be used in the task. prediction_type (Optional[str]):
Need to be consistent with all used metrics. Defaults to None, which means that it will be set to Any.
- defaults (Optional[Dict[str, Any]]):
An optional dictionary with default values for chosen input/output keys. Needs to be consistent with names and types provided in βinput_fieldsβ and/or βoutput_fieldsβ arguments. Will not overwrite values if already provided in a given instance.
- The output instance contains three fields:
βinput_fieldsβ whose value is a sub-dictionary of the input instance, consisting of all the fields listed in Arg βinput_fieldsβ. βreference_fieldsβ β for the fields listed in Arg βreference_fieldsβ. βmetricsβ β to contain the value of Arg βmetricsβ
References: metrics.accuracy, metrics.f1_macro, metrics.f1_micro
Read more about catalog usage here.