Hi, I have a normal Network, nothing special, and I want to do something depends on the loss.
So I determined a threshold, and the main Idea is (pseudo):
if loss < threshold:
     do {}
else:
     do {}

Now I thought why shouldn’t I try to learn this threshold, depend on some loss, maybe the same as the network.
What do you think? It’s not connected to the network graph, so I can’t backpropagate with the rest of the network, should I declare this parameter as an entire model? because when I’m just declaring a tensor it’s not enough…(“AttributeError: ‘Tensor’ object has no attribute ‘train’”)
I’ll be happy to hear your thoughts,
Thanks.