π To List By Hyphen SpaceΒΆ
Note
ID: processors.to_list_by_hyphen_space | Type: SequentialOperator
{
"__type__": "sequential_operator",
"steps": [
{
"__type__": "regex_split",
"by": "(?:^|\n)- ",
"field": "prediction"
},
{
"__type__": "remove_values",
"field": "prediction",
"process_every_value": false,
"unallowed_values": [
"",
" "
]
},
{
"__type__": "regex_split",
"by": "(?:^|\n)- ",
"field": "references",
"process_every_value": true
},
{
"__type__": "remove_values",
"field": "references",
"process_every_value": true,
"unallowed_values": [
"",
" "
]
}
]
}
Explanation about SequentialOperatorΒΆ
A class representing a sequential operator in the streaming system.
A sequential operator is a type of MultiStreamOperator that applies a sequence of other operators to a MultiStream. It maintains a list of StreamingOperator`s and applies them in order to the `MultiStream.
Explanation about RemoveValuesΒΆ
Removes elements in a field, which must be a list, using a given list of unallowed.
- Args:
unallowed_values (list) - values to be removed.
Read more about catalog usage here.