Read our 2024 Summary blog post!

[[ visible ? '▲ HIDE' : '▼ SHOW BANNER' ]]

|||

Quick search

  • Introduction
  • Explore Unitxt
  • Installation
  • Loading Datasets
  • Evaluating Datasets
  • Tutorials ✨
  • Examples
  • Blog πŸ“£
  • Code Documentation
  • πŸ“ Catalog
    • πŸ“ Augmentors
    • πŸ“ Benchmarks
    • πŸ“ Cards
    • πŸ“ Engines
    • πŸ“ Formats
    • πŸ“ Metrics
    • πŸ“ Operators
    • πŸ“ Processors
    • πŸ“ Recipes
    • πŸ“ Serializers
    • πŸ“ Splitters
    • πŸ“ System Prompts
    • πŸ“ Tasks
    • πŸ“ Templates
      • πŸ“ Classification
      • πŸ“ Completion
      • πŸ“ Evaluation
      • πŸ“ Generation
      • πŸ“ Grammatical Error Correction
      • πŸ“ Grammatical Error Detection
      • πŸ“ Language Identification
      • πŸ“ Qa
      • πŸ“ Rag
      • πŸ“ Rag Eval
      • πŸ“ Regression
      • πŸ“ Response Assessment
      • πŸ“ Rewriting
      • πŸ“ Safety
      • πŸ“ Selection
      • πŸ“ Span Labeling
      • πŸ“ Summarization
      • πŸ“ Targeted Sentiment Extraction
      • πŸ“ Text2Sql
      • πŸ“ Translation
      • πŸ“„ Empty
      • πŸ“„ Key Val
      • πŸ“„ Key Val With New Lines

πŸ“„ AllΒΆ

templates.qa.multiple_choice.with_topic.all

type: TemplatesList
items: 
  - templates.qa.multiple_choice.with_topic.fm_eval
  - templates.qa.multiple_choice.with_topic.mmlu
  - templates.qa.multiple_choice.with_topic.helm
  - templates.qa.multiple_choice.with_topic.lm_eval_harness
  - templates.qa.multiple_choice.with_topic.title
  - templates.qa.multiple_choice.with_topic.match
[source]

References: templates.qa.multiple_choice.with_topic.lm_eval_harness, templates.qa.multiple_choice.with_topic.fm_eval, templates.qa.multiple_choice.with_topic.match, templates.qa.multiple_choice.with_topic.title, templates.qa.multiple_choice.with_topic.mmlu, templates.qa.multiple_choice.with_topic.helm

Read more about catalog usage here.



<πŸ“„ Mmlu
πŸ“„ Bluebench>
© Copyright 2023, IBM Research.