unitxt.fusion module

class unitxt.fusion.BaseFusion(*argv, **kwargs)

Bases: SourceOperator

BaseFusion operator that combines multiple streams into one.

Parameters:

include_splits – List of splits to include. If None, all splits are included.

class unitxt.fusion.FixedFusion(*argv, **kwargs)

Bases: BaseFusion

FixedFusion operator that combines multiple streams into one based on a fixed number of examples per task.

Parameters:

• orgins – List of StreamSource objects.

• examples_per_task – Number of examples per task. If None, all examples are returned.

• splits – List of splits to include. If None, all splits are included.

class unitxt.fusion.WeightedFusion(*argv, **kwargs)

Bases: BaseFusion

Fusion operator that combines multiple streams based.

Parameters:

• orgins – List of StreamSource objects.

• weights – List of weights for each origin.

• max_total_examples – Total number of examples to return. If None, all examples are returned.