πŸ“„ flan_t5_smallΒΆ

Note

ID: metrics.perplexity_q.flan_t5_small | Type: Perplexity

{
    "model_name": "google/flan-t5-small",
    "source_template": "Generate a question based on the given content: {reference}",
    "target_template": "{prediction}",
    "type": "perplexity"
}

Explanation about PerplexityΒΆ

Computes the likelihood of generating text Y after text X - P(Y|X).

Read more about catalog usage here.