Solved by tymokvo in post #2 
              
              
                Check the numpy docs: 
im_array = np.array(image_data) # image_data is the memmap

im_tensor = torch.from_numpy(im_array)

Something like this should work. 
EDIT: 
Looks like you can just call: 
torch.from_numpy(image_data)