πŸ“„ O1 MiniΒΆ

metrics.llm_as_judge.direct.azure_openai.o1_mini

type: LLMJudgeDirect
inference_engine: 
  type: LiteLLMInferenceEngine
  max_tokens: 1024
  seed: 42
  credentials: 
    api_base: https://eteopenai.azure-api.net/openai/deployments/o1-mini-2024-09-12/chat/completions?api-version=2024-08-01-preview
  model: azure/o1-mini-2024-09-12
evaluator_name: O1_MINI
generate_summaries: False
[source]

Read more about catalog usage here.