unitxt.inference module

class unitxt.inference.HFPipelineBasedInferenceEngine(__tags__: ~typing.Dict[str, str] = {}, model_name: str, max_new_tokens: int)

Bases: Artifact

Abstract base class for inference.

class unitxt.inference.InferenceEngine(__tags__: Dict[str, str] = {})

Bases: ABC, Artifact

Abstract base class for inference.