📄 Temperature In Celsius And Fahrenheit¶

metrics.llm_as_judge.direct.criteria.temperature_in_celsius_and_fahrenheit

CriteriaWithOptions(
    name="temperature_in_celsius_and_fahrenheit",
    description="In the response, if there is a numerical temperature present, is it denominated in both Fahrenheit and Celsius?",
    prediction_field="response",
    context_fields=[],
    options=[
        CriteriaOption(
            name="Yes",
            description="The temperature reading is provided in both Fahrenheit and Celsius.",
        ),
        CriteriaOption(
            name="No",
            description="The temperature reading is provided either in Fahrenheit or Celsius, but not both.",
        ),
        CriteriaOption(
            name="Pass",
            description="There is no numerical temperature reading in the response.",
        ),
    ],
    option_map={
        "Yes": 1.0,
        "No": 0.5,
        "Pass": 0.0,
    },
)

[source]

from unitxt.llm_as_judge_constants import CriteriaOption

Explanation about CriteriaWithOptions¶

Criteria used by DirectLLMJudge to run evaluations.

Explanation about CriteriaOption¶

A criteria option.