📄 Lmms Eval¶

templates.qa.multiple_choice.with_context.lmms_eval

type: MultipleChoiceTemplate
input_format: "{context}\n{question}\n{choices}"
target_prefix: Answer with the option's letter from the given choices directly.
choices_separator: "\n"
target_field: answer
enumerator: capitals
[source]

Explanation about MultipleChoiceTemplate¶

Formats the input (that specifies the question), the multiple choices to select the answer from, and specifies the field with the correct answer.