|||

Quick search

Contents:

  • Introduction
  • Explore Unitxt
  • Loading Datasets
  • Installation
  • Basics
  • Adding Datasets ✨
  • Adding Tasks ✨
  • Adding Templates ✨
  • Adding Formats ✨
  • Adding Operators ✨
  • Adding Metrics ✨
  • Backend
  • Operators List
  • Contributors Guide
  • Saving and Loading from the Catalog
  • Using in production
  • Running Unitxt with HELM
  • unitxt
  • πŸ“ Catalog
    • πŸ“ Augmentors
    • πŸ“ Cards
    • πŸ“ Formats
    • πŸ“ Metrics
      • πŸ“ Bert_score
      • πŸ“ Perplexity
      • πŸ“ Perplexity_a
      • πŸ“ Perplexity_chat
      • πŸ“ Perplexity_nli
      • πŸ“ Perplexity_q
      • πŸ“ Rag
      • πŸ“ Reward
      • πŸ“ Robustness
      • πŸ“ Sentence_bert
      • πŸ“„ accuracy
      • πŸ“„ accuracy_binary
      • πŸ“„ bleu
      • πŸ“„ char_edit_dist_accuracy
      • πŸ“„ char_edit_distance
      • πŸ“„ f1_binary
      • πŸ“„ f1_macro
      • πŸ“„ f1_macro_multi_label
      • πŸ“„ f1_micro
      • πŸ“„ f1_micro_multi_label
      • πŸ“„ f1_weighted
      • πŸ“„ kendalltau_b
      • πŸ“„ kpa
      • πŸ“„ map
      • πŸ“„ matthews_correlation
      • πŸ“„ max_accuracy_binary
      • πŸ“„ max_f1_binary
      • πŸ“„ mrr
      • πŸ“„ ndcg
      • πŸ“„ ner
      • πŸ“„ normalized_sacrebleu
      • πŸ“„ precision_binary
      • πŸ“„ precision_macro_multi_label
      • πŸ“„ precision_micro_multi_label
      • πŸ“„ recall_binary
      • πŸ“„ recall_macro_multi_label
      • πŸ“„ recall_micro_multi_label
      • πŸ“„ regard
      • πŸ“„ rerank_recall
      • πŸ“„ retrieval_at_k
      • πŸ“„ roc_auc
      • πŸ“„ rouge
      • πŸ“„ rouge_with_confidence_intervals
      • πŸ“„ sacrebleu
      • πŸ“„ safety
      • πŸ“„ spearman
      • πŸ“„ squad
      • πŸ“„ string_containment
      • πŸ“„ token_overlap
      • πŸ“„ token_overlap_with_context
      • πŸ“„ unsorted_list_exact_match
      • πŸ“„ wer
    • πŸ“ Operators
    • πŸ“ Processors
    • πŸ“ Splitters
    • πŸ“ System_prompt
    • πŸ“ System_prompts
    • πŸ“ Tasks
    • πŸ“ Templates

πŸ“ RagΒΆ

  • πŸ“ Correctness
  • πŸ“ Model_response_assessment
  • πŸ“„ answer_correctness
  • πŸ“„ answer_inference
  • πŸ“„ answer_reward
  • πŸ“„ bert_k_precision
  • πŸ“„ bert_k_precision_ml
  • πŸ“„ bert_recall
  • πŸ“„ bert_recall_ml
  • πŸ“„ context_correctness
  • πŸ“„ context_perplexity
  • πŸ“„ context_relevance
  • πŸ“„ faithfulness
  • πŸ“„ k_precision
  • πŸ“„ map
  • πŸ“„ mrr
  • πŸ“„ recall

Read more about catalog usage here.

<πŸ“„ flan_t5_small
πŸ“ Correctness>
© Copyright 2023, IBM Research.