es_sfgtools.data_mgmt.ingestion.datadiscovery module

es_sfgtools.data_mgmt.ingestion.datadiscovery.get_file_type_local(file_path: Path) → tuple[AssetType | None, int | None]

Get the file type of a file.

Parameters:

file_path (Path) – The file path.

Returns:

The file type and size.

Return type:

tuple[Union[AssetType, None], Union[int, None]]

es_sfgtools.data_mgmt.ingestion.datadiscovery.get_file_type_remote(file_path: str) → AssetType | None

Get the file type of a file.

Parameters:

file_path (str) – The file path.

Returns:

The file type.

Return type:

AssetType

es_sfgtools.data_mgmt.ingestion.datadiscovery.scrape_directory_local(directory: Path) → List[Path] | None

Scrape a directory for files.

Parameters:

directory (str) – The directory to scrape files from.

Returns:

The list of files in the directory.

Return type:

List[Path]