π FluencyΒΆ
metrics.llm_as_judge.direct.criteria.fluency
type: CriteriaWithOptions
name: fluency
description: Is the response fluent? The response contains sentences that are well-written and grammatically correct. Consider the quality of the individual sentences and measure the extent to which they are fluent.
options:
- type: CriteriaOption
name: 1
description: The response is not fluent at all.
- type: CriteriaOption
name: 2
description: The response is somewhat fluent.
- type: CriteriaOption
name: 3
description: The response is fluent.
- type: CriteriaOption
name: 4
description: The response is very fluent, grammatically correct and well-written.
- type: CriteriaOption
name: 5
description: The response is exceptionally fluent, grammatically correct, and well-written.
option_map:
1: 0.0
2: 0.25
3: 0.5
4: 0.75
5: 1.0
[source]Read more about catalog usage here.