πŸ“„ Llama 3 1 405B Instruct Fp8 Ibm GenaiΒΆ

engines.classification.llama_3_1_405b_instruct_fp8_ibm_genai

type: IbmGenAiInferenceEngine
model_name: meta-llama/llama-3-1-405b-instruct-fp8
max_new_tokens: 5
random_seed: 42
decoding_method: greedy
[source]

Read more about catalog usage here.