i am a beginner in DL and pytorch and doing research with custom activation function and weight clip and stop training with loss value.
My input is a handwriting number with 32x32 and has 1934 samples number. and my target data is 1934 samples with 8 bit so i need output with 1934 and 8 bit so i can compare and count loss with my target data.
this is the first time to i am using batch size to 1k+ and i dont know whether is it right or no.
do you have suggestion the good example which i can learn. I am googling all and make my model just like now