πŸ“„ Llama 3 1 405B Instruct Fp8 Ibm GenaiΒΆ

Note

ID: engines.classification.llama_3_1_405b_instruct_fp8_ibm_genai | Type: IbmGenAiInferenceEngine

{
    "__type__": "ibm_gen_ai_inference_engine",
    "decoding_method": "greedy",
    "max_new_tokens": 5,
    "model_name": "meta-llama/llama-3-1-405b-instruct-fp8",
    "random_seed": 42
}

Read more about catalog usage here.