πŸ“„ Flan T5 SmallΒΆ

metrics.perplexity_a.flan_t5_small

type: Perplexity
model_name: google/flan-t5-small
source_template: Generate an answer based on the given content: {reference}
target_template: {prediction}
[source]

Explanation about PerplexityΒΆ

Computes the likelihood of generating text Y after text X - P(Y|X).

Read more about catalog usage here.