saywwhaaaat:

But, if I modify the predicted label, what would be the consequence to autograd?


I’m citing @KFrank here:

The number-one rule is that your output means whatever you train it to mean…

I’m not sure what kind of classes and categories you are using and how similar they are.
E.g. if you remap “husky” and “bulldog” to a “dog” class, your model might still work fine.
Depending how the remapping is done, you might need to retrain the model.