📄 fm_eval¶

Note

ID: templates.qa.multiple_choice.with_context.with_topic.fm_eval | Type: MultipleChoiceTemplate

{
    "choices_separator": "\n",
    "input_format": "The following are multiple choice questions (with answers) about {topic}.\n\nContext: {context}\nQuestion: {question}\nChoose from {numerals}\nAnswers:\n{choices}\nAnswer:",
    "postprocessors": [
        "processors.first_character"
    ],
    "target_field": "answer",
    "type": "multiple_choice_template"
}

Explanation about MultipleChoiceTemplate¶

Formats the input (that specifies the question), the multiple choices to select the answer from, and specifies the field with the correct answer.

References: processors.first_character