πŸ“„ BluebenchΒΆ

Note

ID: templates.qa.multiple_choice.with_context.bluebench | Type: TemplatesList

{
    "__type__": "templates_list",
    "items": [
        "templates.qa.multiple_choice.with_context.lm_eval_harness",
        "templates.qa.multiple_choice.with_context.no_intro.helm",
        "templates.qa.multiple_choice.with_context.no_intro.mmlu"
    ]
}

References: templates.qa.multiple_choice.with_context.no_intro.mmlu, templates.qa.multiple_choice.with_context.no_intro.helm, templates.qa.multiple_choice.with_context.lm_eval_harness

Read more about catalog usage here.