unitxt.eval_utils module

unitxt.eval_utils.as_remote_metric(metric)

Wrap a metric with a RemoteMetric.

Currently supported is wrapping the inner metric within a MetricPipeline.

unitxt.eval_utils.evaluate(dataset, metric_names: List[str], compute_conf_intervals: bool | None = False)

unitxt.eval_utils.evaluate(dataset: list, metric_names: List[str], compute_conf_intervals: bool | None = False)

unitxt.eval_utils.evaluate(dataset: DataFrame, metric_names: List[str], compute_conf_intervals: bool | None = False)

Placeholder for overloading the function, supporting both dataframe input and list input.