πŸ“„ T5 Nli MixtureΒΆ

metrics.perplexity_nli.t5_nli_mixture

type: Perplexity
model_name: google/t5_xxl_true_nli_mixture
source_template: premise: {reference} hypothesis: {prediction}
target_template: 1
single_token_mode: True
[source]

Explanation about PerplexityΒΆ

Computes the likelihood of generating text Y after text X - P(Y|X).

Read more about catalog usage here.