📄 Mistral Small 3 1 24B Instruct 2503 Wml¶

engines.classification.mistral_small_3_1_24b_instruct_2503_wml

WMLInferenceEngineGeneration(
    model_name="mistralai/mistral-small-3-1-24b-instruct-2503",
    max_new_tokens=5,
    random_seed=42,
    decoding_method="greedy",
)
[source]

Explanation about WMLInferenceEngineGeneration¶

Generates text for textual inputs.

If you want to include images in your input, please use ‘WMLInferenceEngineChat’ instead.

Examples:

from .api import load_dataset

wml_credentials = {
    "url": "some_url", "project_id": "some_id", "api_key": "some_key"
}
model_name = "google/flan-t5-xxl"
wml_inference = WMLInferenceEngineGeneration(
    credentials=wml_credentials,
    model_name=model_name,
    data_classification_policy=["public"],
    top_p=0.5,
    random_seed=123,
)

dataset = load_dataset(
    dataset_query="card=cards.argument_topic,template_card_index=0,loader_limit=5"
)
results = wml_inference.infer(dataset["test"])