unitxt.file_utils module

unitxt.file_utils.get_all_files_in_dir(dir_path: str, recursive: bool = False, file_extension: str | None = None)

Get all files in a directory. Optionally recursively.

Optionally filter by file extension.

Parameters:

• dir_path – The directory path to search for files.

• recursive – Whether to search recursively in subdirectories.

• file_extension – The file extension to filter by (e.g., ‘.txt’).

Returns:

A list of file paths.