I have checked the values with model.fc.weightand model.conv1.weight and they are initialized to non-zero values.
I am asking for more data but the process of data generation is a bit expensive I think. The other problem is the sparseness of the matrices, do you think resnet works fine with sparse data?
Thank you