@eqy, I read more about my error and still lost to where to point it, my issue is related to the loss function. Loss not changing when training · Issue #2711 · keras-team/keras · GitHub
This person had somewhat the same issue as me (they’re using Keras) but their issue that the loss was increasing after they changed the learning rate to 0.1, I did that and nothing has changed for me. Still 0, and also whenever I run it again the first loss is 0 that, if I don’t run the model first again.
Also, I am running into another issue now when training the model,
AttributeError                            Traceback (most recent call last)
<ipython-input-149-00156a3f4784> in <module>
     14 for epoch in range(1, epochs + 1):
     15         train_loss = train(model, device, train_loader, optimizer, epoch)
---> 16         test_loss = test(model, device, test_loader)
     17         epoch_nums.append(epoch)
     18         training_loss.append(train_loss)

<ipython-input-147-0b55539a29e4> in test(model, device, test_loader)
     17 
     18             # Calculate the accuracy for this batch
---> 19             _, predicted = torch.max(output.data, 1)
     20             correct += torch.sum(target==predicted).item()
     21             print(predicted)

AttributeError: 'tuple' object has no attribute 'data'

EDIT: I tried running the code again without changing anything, only change I did now is changed back to the old dataset and num_classes=18620, I am still getting 0 for losses but when I left it to run for a while I get this these values
Training batch 212 Loss: 0.000000
	Training batch 213 Loss: 0.000000
	Training batch 214 Loss: 0.000000
	Training batch 215 Loss: 0.000000
	Training batch 216 Loss: 0.000000
	Training batch 217 Loss: 0.000000
	Training batch 218 Loss: 0.000000
	Training batch 219 Loss: 0.000000
	Training batch 220 Loss: 0.000000
	Training batch 221 Loss: 0.000000
	Training batch 222 Loss: 0.000000
	Training batch 223 Loss: 0.000000
	Training batch 224 Loss: 255631682738539731091456.000000
	Training batch 225 Loss: 198830284639908483039232.000000
	Training batch 226 Loss: 30875532879146954784768.000000
	Training batch 227 Loss: 66122300089016359321600.000000
	Training batch 228 Loss: 57328341773031732936704.000000
	Training batch 229 Loss: 17179621415651750445056.000000
	Training batch 230 Loss: 19574190967024177381376.000000
	Training batch 231 Loss: 30508435466320730914816.000000
	Training batch 232 Loss: 105737439592045019660288.000000
	Training batch 233 Loss: 17526280367469060161536.000000
	Training batch 234 Loss: 78442401272846616625152.000000