I’m not familiar with the real implementation of this dataset, but based on the function names I would assume this:


raw_file_names: returns the file names as a list of “raw” input data, which is not yet processed in any way

processed_file_names: returns the file names of already processed names. Based on the file extension I assume these processed files are stored as PyTorch tensors (or at least via PyTorch).

download: downloads the raw files to the self.raw_dir most likely from a remote server.

process: iterates all raw files, loads and processes them. Afterwards it’s storing the processes data tensors to the selfprocessed_dir.

len: returns the number of processed files

get: loads a processed file from the self.processed_dir using the passed idx and returns it.