📄 Flan T5 Small¶

metrics.perplexity_chat.flan_t5_small

Perplexity(
    model_name="google/flan-t5-small",
    source_template="Generate a conversation between a user and an agent based on the given content: {reference}",
    target_template="{prediction}",
)
[source]

Explanation about Perplexity¶

Computes the likelihood of generating text Y after text X - P(Y|X).