That’s fine - you can still load images without a CSV file by iterating over the available files in the directory using os.listdirs. I’m not familiar with the COIL 20 dataset but if the filenames contain the labels/targets you could extract them using regex.
Have a look at the source for ImageFolder and DataFolder here 10.