I didnt do any specific initialization just use the resnet18() and I think it handles the weigh initialization itself.
I didn’t do normalizations since my inputs are not actual images, they are matrices which are very very sparse with the size 784x162. Almost all the values are zero except a few of them which have real values, could that be a reason?
I have 2400 samples for training, it is probably very small for such networks, but the results are quite far away from what I have expected.
I have shuffled the data for training.