Read our
2024 Summary
blog post!
[[ visible ? '▲ HIDE' : '▼ SHOW BANNER' ]]
|||
Quick search
Introduction
Installation
Loading Datasets
Evaluating Datasets
Use Cases
Guides ✨
Examples
Blog 📣
Code Documentation
📁 Catalog
📁 Augmentors
📁 Benchmarks
📁 Cards
📁 Engines
📁 Formats
📁 Metrics
📁 Bert Score
📁 Granite Guardian
📁 Key Value Extraction
📁 Llm As Judge
📁 Multi Turn
📁 Perplexity
📁 Perplexity A
📁 Perplexity Chat
📁 Perplexity Nli
📁 Perplexity Q
📁 Qa
📁 Rag
📁 Reward
📁 Robustness
📁 Sentence Bert
📁 Text2Sql
📁 Tool Calling
📄 Accuracy
📄 Accuracy Binary
📄 Anls
📄 Bleu
📄 Char Edit Dist Accuracy
📄 Char Edit Distance
📄 Exact Match Mm
📄 F1 Binary
📄 F1 Macro
📄 F1 Macro Multi Label
📄 F1 Micro
📄 F1 Micro Multi Label
📄 F1 Strings
📄 F1 Weighted
📄 Fin Qa Metric
📄 Fuzzyner
📄 Is Code Mixed
📄 Jaccard Index
📄 Jaccard Index Words
📄 Kendalltau B
📄 Kpa
📄 Map
📄 Matthews Correlation
📄 Max Accuracy Binary
📄 Max F1 Binary
📄 Mean Squared Error
📄 Meteor
📄 Meteor Hf
📄 Mrr
📄 Ndcg
📄 Ner
📄 Normalized Sacrebleu
📄 Precision Binary
📄 Precision Macro Multi Label
📄 Precision Micro Multi Label
📄 Prediction Length
📄 Recall Binary
📄 Recall Macro Multi Label
📄 Recall Micro Multi Label
📄 Regard Metric
📄 Relaxed Correctness
📄 Rerank Recall
📄 Retrieval At K
📄 Roc Auc
📄 Root Mean Squared Error
📄 Rouge
📄 Rouge With Confidence Intervals
[deprecated]
📄 Sacrebleu
📄 Safety Metric
📄 Spearman
📄 Squad
📄 String Containment
📄 String Containment Ratio
📄 Token Overlap
📄 Token Overlap With Context
📄 Tool Calling
📄 Unsorted List Exact Match
📄 Vectara Groundedness Hhem 2 1
📄 Websrc Squad F1
📄 Weighted Win Rate Correlation
📄 Wer
📁 Operators
📁 Processors
📁 Recipes
📁 Serializers
📁 Splitters
📁 System Prompts
📁 Tasks
📁 Templates
📄 Wer
¶
metrics.wer
Wer
()
[source]
Read more about catalog usage
here
.
<
📄 Weighted Win Rate Correlation
📁 Operators
>