Yes, here is the detail of an image (which is a sample image from the FER2013 dataset 4):

I have constructed my model from scratch, now trying to improve its accuracy. Yes, the accuracy was way better when I loaded the images as 3-channels as the accuracy has dropped to about 25% from 50%.