📄 Token Overlap¶

Metric that evaluates key value pairs predictions (provided as dictionary) with reference key value pairs (also provided as dictionary). Calculates token overlap between values of corresponding value in reference and prediction. Reports f1 per key, micro f1 averages across all key/value pairs, and macro f1 averages across keys.

metrics.key_value_extraction.token_overlap

KeyValueExtraction(
    metric="metrics.token_overlap",
    score_prefix="token_overlap_",
)
[source]

References: metrics.token_overlap