I have a model that does multilabel classification. After calculating the outputs in training mode, I iterate over thresholds and choose the one that gives me best fbeta_score.
What I want to ask is do I calculate loss based on those final predictions or do I calculate loss based on the original predictions?
So, is the manual threshold a post-processing step to use only when the model is in eval mode?
Thank you for your help