Contents:

  • Introduction
  • Loading Datasets
  • Installation
  • Adding Datasets
  • Adding Stream Operators and Metrics
  • Components
  • Backend
  • Operators
  • Contributors Guide
  • unitxt
  • Catalog
    • Augmentors
    • Benchmarks
    • Cards
      • CFPB
      • Ai2_arc
      • AlmostEvilML_qa_by_lang
      • Amazon_mass
      • Belebele
      • Clinc_oos
      • Head_qa
      • Mlsum
      • Mmlu
        • abstract_algebra
        • anatomy
        • astronomy
        • business_ethics
        • clinical_knowledge
        • college_biology
        • college_chemistry
        • college_computer_science
        • college_mathematics
        • college_medicine
        • college_physics
        • computer_security
        • conceptual_physics
        • econometrics
        • electrical_engineering
        • elementary_mathematics
        • formal_logic
        • global_facts
        • high_school_biology
        • high_school_chemistry
        • high_school_computer_science
        • high_school_european_history
        • high_school_geography
        • high_school_government_and_politics
        • high_school_macroeconomics
        • high_school_mathematics
        • high_school_microeconomics
        • high_school_physics
        • high_school_psychology
        • high_school_statistics
        • high_school_us_history
        • high_school_world_history
        • human_aging
        • human_sexuality
        • international_law
        • jurisprudence
        • logical_fallacies
        • machine_learning
        • management
        • marketing
        • medical_genetics
        • miscellaneous
        • moral_disputes
        • moral_scenarios
        • nutrition
        • philosophy
        • prehistory
        • professional_accounting
        • professional_law
        • professional_medicine
        • professional_psychology
        • public_relations
        • security_studies
        • sociology
        • us_foreign_policy
        • virology
        • world_religions
      • Multidoc2dial
      • Reuters21578
      • Winogrande
      • Wmt
      • Xlsum
      • Xnli
      • Xwinogrande
      • 20_newsgroups
      • ag_news
      • almostEvilML_qa
      • argument_topic
      • atta_q
      • banking77
      • bold
      • boolq
      • claim_stance_topic
      • cnn_dailymail
      • cola
      • copa
      • dbpedia_14
      • ethos_binary
      • financial_tweets
      • hellaswag
      • law_stack_exchange
      • ledgar
      • mbpp
      • medical_abstracts
      • mnli
      • mrpc
      • openbookQA
      • openbook_qa
      • piqa
      • piqa_all
      • piqa_high
      • piqa_middle
      • pop_qa
      • qnli
      • qqp
      • race_all
      • race_high
      • race_middle
      • rte
      • sciq
      • squad
      • sst2
      • stsb
      • toxigen
      • unfair_tos
      • wmt_en_de
      • wmt_en_fr
      • wmt_en_ro
      • wnli
      • wsc
      • xsum
      • yahoo_answers_topics
    • Formats
    • Instructions
    • Metrics
    • Operators
    • Processors
    • Recipes
    • Splitters
    • Tasks
    • Templates
Unitxt
  • Catalog
  • Cards
  • Mmlu
  • Edit on GitHub


Mmlu

  • abstract_algebra
  • anatomy
  • astronomy
  • business_ethics
  • clinical_knowledge
  • college_biology
  • college_chemistry
  • college_computer_science
  • college_mathematics
  • college_medicine
  • college_physics
  • computer_security
  • conceptual_physics
  • econometrics
  • electrical_engineering
  • elementary_mathematics
  • formal_logic
  • global_facts
  • high_school_biology
  • high_school_chemistry
  • high_school_computer_science
  • high_school_european_history
  • high_school_geography
  • high_school_government_and_politics
  • high_school_macroeconomics
  • high_school_mathematics
  • high_school_microeconomics
  • high_school_physics
  • high_school_psychology
  • high_school_statistics
  • high_school_us_history
  • high_school_world_history
  • human_aging
  • human_sexuality
  • international_law
  • jurisprudence
  • logical_fallacies
  • machine_learning
  • management
  • marketing
  • medical_genetics
  • miscellaneous
  • moral_disputes
  • moral_scenarios
  • nutrition
  • philosophy
  • prehistory
  • professional_accounting
  • professional_law
  • professional_medicine
  • professional_psychology
  • public_relations
  • security_studies
  • sociology
  • us_foreign_policy
  • virology
  • world_religions
Previous Next

© Copyright 2023, IBM Research. Revision e3fb5ed7.

Built with Sphinx using a theme provided by Read the Docs.