π Llama 3 1 405B Instruct Fp8 Ibm GenaiΒΆ
Note
ID: engines.classification.llama_3_1_405b_instruct_fp8_ibm_genai | Type: IbmGenAiInferenceEngine
{
"__type__": "ibm_gen_ai_inference_engine",
"decoding_method": "greedy",
"max_new_tokens": 5,
"model_name": "meta-llama/llama-3-1-405b-instruct-fp8",
"random_seed": 42
}
Read more about catalog usage here.