π O1 MiniΒΆ
metrics.llm_as_judge.pairwise.openai.o1_mini
type: LLMJudgePairwise
inference_engine:
type: LiteLLMInferenceEngine
model: openai/o1-mini-2024-09-12
max_tokens: 1024
seed: 42
evaluator_name: O1_MINI
generate_summaries: False
[source]Read more about catalog usage here.