πŸ“„ Lmms EvalΒΆ

templates.qa.with_context.lmms_eval

type: MultiReferenceTemplate
input_format: "{context}\n{question}"
target_prefix: Answer the question using a single word or phrase.
references_field: answers
[source]

Read more about catalog usage here.