π ConcisenessΒΆ
metrics.llm_as_judge.direct.criteria.conciseness
CriteriaWithOptions(
name="conciseness",
description="Is the response concise and to the point?",
prediction_field="response",
context_fields=[
"question",
],
options=[
CriteriaOption(
name="Yes",
description="The response is short, succinct and directly addresses the point at hand.",
),
CriteriaOption(
name="No",
description="The response lacks brevity and clarity, failing to directly address the point at hand.",
),
],
option_map={
"Yes": 1.0,
"No": 0.0,
},
)
[source]from unitxt.llm_as_judge_constants import CriteriaOption
Explanation about CriteriaWithOptionsΒΆ
Criteria used by DirectLLMJudge to run evaluations.
Explanation about CriteriaOptionΒΆ
A criteria option.
Read more about catalog usage here.