Thanks for catching that! I removed the softmax before my loss function and rerun the training. However, I still don’t think the network is learning, see the loss and accuracies I printed out:
TRAIN EPOCH 0 LOSS 1.6104545269982289 ACC 5.745762711864407 TIME 2.13284482161204
TRAIN EPOCH 1 LOSS 1.6099774817288932 ACC 5.745762711864407 TIME 2.1346530238787333
TRAIN EPOCH 2 LOSS 1.6099520632102664 ACC 5.740112994350283 TIME 2.134521810213725
TRAIN EPOCH 3 LOSS 1.6099088434445656 ACC 5.745762711864407 TIME 2.1318265636761984
TRAIN EPOCH 4 LOSS 1.609805136750647 ACC 5.745762711864407 TIME 2.1283810138702393
VALIDATING EPOCH 4 ACC 0.20394736842105263
UPDATING ACC
TRAIN EPOCH 5 LOSS 1.609727140873839 ACC 5.745762711864407 TIME 2.1273571451505027
TRAIN EPOCH 6 LOSS 1.6096392135835638 ACC 5.745762711864407 TIME 2.12272922595342
VALIDATING EPOCH 6 ACC 0.20394736842105263
TRAIN EPOCH 7 LOSS 1.6095740916365284 ACC 5.740112994350283 TIME 2.134061749776204
TRAIN EPOCH 8 LOSS 1.609515246698412 ACC 5.745762711864407 TIME 2.1415396173795065
VALIDATING EPOCH 8 ACC 0.20394736842105263
TRAIN EPOCH 9 LOSS 1.60947663837907 ACC 5.745762711864407 TIME 2.154924046993256
TRAIN EPOCH 10 LOSS 1.6094451630856357 ACC 6.016949152542373 TIME 2.134658928712209
VALIDATING EPOCH 10 ACC 0.19394736842105262
TRAIN EPOCH 11 LOSS 1.6094372844965446 ACC 6.598870056497175 TIME 2.1410026868184406
TRAIN EPOCH 12 LOSS 1.6094372851700434 ACC 6.598870056497175 TIME 2.1313098430633546
VALIDATING EPOCH 12 ACC 0.19394736842105262
TRAIN EPOCH 13 LOSS 1.609437289211036 ACC 6.598870056497175 TIME 2.12858776251475
TRAIN EPOCH 14 LOSS 1.6094372919050313 ACC 6.593220338983051 TIME 2.1309844811757404
VALIDATING EPOCH 14 ACC 0.19394736842105262
TRAIN EPOCH 15 LOSS 1.609437289211036 ACC 6.604519774011299 TIME 2.13219229777654
TRAIN EPOCH 16 LOSS 1.6094361907344754 ACC 6.333333333333333 TIME 2.131902329126994
VALIDATING EPOCH 16 ACC 0.2113157894736842
UPDATING ACC
TRAIN EPOCH 17 LOSS 1.609422934257378 ACC 6.220338983050848 TIME 2.130883463223775
TRAIN EPOCH 18 LOSS 1.6094214175380557 ACC 6.220338983050848 TIME 2.1380335450172425
VALIDATING EPOCH 18 ACC 0.2113157894736842
TRAIN EPOCH 19 LOSS 1.6094259192041085 ACC 6.220338983050848 TIME 2.1383378585179647