π MatchΒΆ
templates.qa.multiple_choice.with_topic.match
MultipleChoiceTemplate(
instruction="Answer the multiple choice Question about {topic} from one of the Choices (choose from {numerals}).",
input_format="Question:
{question}
Choices:
{choices}",
target_prefix="Answer:
",
target_field="answer",
choices_separator="
",
target_choice_format="{choice_numeral}. {choice_text}",
postprocessors=[
"processors.take_first_non_empty_line",
"processors.match_closest_option",
],
)
[source]Explanation about MultipleChoiceTemplateΒΆ
Formats the input that specifies a multiple-choice question, with a list of possible answers to choose from, and identifies the correct answer.
- Args:
- target_prefix (str): Optional prefix that can be added before the target label in
generated prompts or outputs.
- choices_field (str): The key under which the multiple choices are stored in the
input and reference dictionaries.
- target_field (str): The key under which the correct choice is stored in the
reference dictionary (can be integer index or textual label).
- choices_separator (str): A string used to join formatted
choices (e.g. β, β).
- source_choice_format (str): A Python format string used for displaying each choice
in the input fields (e.g. β{choice_numeral}. {choice_text}β).
- target_choice_format (str): A Python format string used for displaying each choice
in the target or final output (e.g. β{choice_numeral}β).
- enumerator (str): Determines how choice numerals are enumerated. Possible values
include βcapitalsβ, βlowercaseβ, βnumbersβ, or βromanβ.
- shuffle_choices (bool): If True, shuffle the choices. The shuffling seed can be
set with shuffle_choices_seed.
- shuffle_choices_seed (int, optional): If provided, the choices are shuffled with
this fixed integer seed for reproducibility.
- sort_choices_by_length (bool): If True, sorts choices
by their length (ascending).
- sort_choices_alphabetically (bool): If True, sorts choices
in alphabetical order.
- reverse_choices (bool): If True, reverses the order of the choices after any
sorting has been applied. Defaults to False to preserve backward compatibility.
References: processors.take_first_non_empty_line, processors.match_closest_option
Read more about catalog usage here.