πŸ“„ MatchΒΆ

templates.qa.multiple_choice.with_topic.match

MultipleChoiceTemplate(
    instruction="Answer the multiple choice Question about {topic} from one of the Choices (choose from {numerals}).",
    input_format="Question:
{question}
Choices:
{choices}",
    target_prefix="Answer:
",
    target_field="answer",
    choices_separator="
",
    target_choice_format="{choice_numeral}. {choice_text}",
    postprocessors=[
        "processors.take_first_non_empty_line",
        "processors.match_closest_option",
    ],
)
[source]

Explanation about MultipleChoiceTemplateΒΆ

Formats the input that specifies a multiple-choice question, with a list of possible answers to choose from, and identifies the correct answer.

Args:
target_prefix (str): Optional prefix that can be added before the target label in

generated prompts or outputs.

choices_field (str): The key under which the multiple choices are stored in the

input and reference dictionaries.

target_field (str): The key under which the correct choice is stored in the

reference dictionary (can be integer index or textual label).

choices_separator (str): A string used to join formatted

choices (e.g. β€œ, β€œ).

source_choice_format (str): A Python format string used for displaying each choice

in the input fields (e.g. β€œ{choice_numeral}. {choice_text}”).

target_choice_format (str): A Python format string used for displaying each choice

in the target or final output (e.g. β€œ{choice_numeral}”).

enumerator (str): Determines how choice numerals are enumerated. Possible values

include β€œcapitals”, β€œlowercase”, β€œnumbers”, or β€œroman”.

shuffle_choices (bool): If True, shuffle the choices. The shuffling seed can be

set with shuffle_choices_seed.

shuffle_choices_seed (int, optional): If provided, the choices are shuffled with

this fixed integer seed for reproducibility.

sort_choices_by_length (bool): If True, sorts choices

by their length (ascending).

sort_choices_alphabetically (bool): If True, sorts choices

in alphabetical order.

reverse_choices (bool): If True, reverses the order of the choices after any

sorting has been applied. Defaults to False to preserve backward compatibility.

References: processors.take_first_non_empty_line, processors.match_closest_option

Read more about catalog usage here.