Note that nn.BCELoss would usually require the usage of sigmoid not softmax as it could be used for a binary or a multi-label classification.
In any case, you could disable autocast using the context manager for this operation.