Hi! I ran the code on Google colab with GPU enabled. I’m not exactly sure what GPU is being used.
As for the hyperparameters, I have updated the post with it. Here’s a summary: I used cross entropy loss, and SGD with learning rate 0.001 and momentum 0.9, and I trained for 20 epoch. The dataloader used a batch size of 16. I also initialized the hidden layer weights with xavier initialization.
Thanks!