π O1 MiniΒΆ
metrics.llm_as_judge.direct.azure_openai.o1_mini
type: LLMJudgeDirect
inference_engine:
type: LiteLLMInferenceEngine
model: o1-mini-2024-09-12
max_tokens: 1024
seed: 42
evaluator_name: O1_MINI
generate_summaries: False
[source]Read more about catalog usage here.