I think that was (at least) the main issue! Accuracy is finally changing, not the numbers I was hoping for, but it’s a start. Now onto figuring out why it’s overfitting. Thank you!
Iteration: 200. Loss: 0.6329779624938965. Accuracy: 16.87818181818182
Iteration: 400. Loss: 0.6490057110786438. Accuracy: 17.78060606060606
Iteration: 600. Loss: 0.4974486827850342. Accuracy: 18.683030303030304
Iteration: 800. Loss: 0.48051244020462036. Accuracy: 22.292727272727273
Iteration: 1000. Loss: 0.44062167406082153. Accuracy: 18.683030303030304
Iteration: 1200. Loss: 0.5293588638305664. Accuracy: 20.48787878787879
Iteration: 1400. Loss: 0.4660516381263733. Accuracy: 20.48787878787879
Iteration: 1600. Loss: 0.3942776024341583. Accuracy: 23.195151515151515
Iteration: 1800. Loss: 0.49306976795196533. Accuracy: 30.414545454545454
Iteration: 2000. Loss: 0.4473477602005005. Accuracy: 24.097575757575758
Iteration: 2200. Loss: 0.4367488920688629. Accuracy: 19.585454545454546
Iteration: 2400. Loss: 0.4424794316291809. Accuracy: 28.60969696969697
Iteration: 2600. Loss: 0.49501246213912964. Accuracy: 24.097575757575758