π BluebenchΒΆ
Note
ID: templates.qa.multiple_choice.with_context.bluebench | Type: TemplatesList
{
"__type__": "templates_list",
"items": [
"templates.qa.multiple_choice.with_context.lm_eval_harness",
"templates.qa.multiple_choice.with_context.no_intro.helm",
"templates.qa.multiple_choice.with_context.no_intro.mmlu"
]
}
References: templates.qa.multiple_choice.with_context.no_intro.mmlu, templates.qa.multiple_choice.with_context.no_intro.helm, templates.qa.multiple_choice.with_context.lm_eval_harness
Read more about catalog usage here.