📄 T5 Nli Mixture¶

metrics.perplexity_nli.t5_nli_mixture

Perplexity(
    model_name="google/t5_xxl_true_nli_mixture",
    source_template="premise: {reference} hypothesis: {prediction}",
    target_template="1",
    single_token_mode=True,
)
[source]

Explanation about Perplexity¶

Computes the likelihood of generating text Y after text X - P(Y|X).