I’m trying to train a self-supervised model to detect human interactions. After creating the positive and negative pairs, when I run my training module I get a strange training loss.
For the first half of the batches in each epoch I get a loss between 0.5-1 however in the middle it suddenly jumps to values like 39.8 which is very weird. I am using a contrastive loss function. Is there any reason as to why this could be happening?