πŸ“„ FluencyΒΆ

metrics.llm_as_judge.direct.criteria.fluency

type: CriteriaWithOptions
name: fluency
description: Is the response fluent? The response contains sentences that are well-written and grammatically correct. Consider the quality of the individual sentences and measure the extent to which they are fluent.
options: 
  - type: CriteriaOption
    name: 1
    description: The response is not fluent at all.
  - type: CriteriaOption
    name: 2
    description: The response is somewhat fluent.
  - type: CriteriaOption
    name: 3
    description: The response is fluent.
  - type: CriteriaOption
    name: 4
    description: The response is very fluent, grammatically correct and well-written.
  - type: CriteriaOption
    name: 5
    description: The response is exceptionally fluent, grammatically correct, and well-written.
option_map: 
  1: 0.0
  2: 0.25
  3: 0.5
  4: 0.75
  5: 1.0
[source]

Read more about catalog usage here.