Fixed it:
You can’t just normalize the log_prob, you have to exponentiate it first:
loss = -(distrib.log_prob(x).exp() / distrib.log_prob(y).exp()).log()

Works fine now !
Leaving the thread in case it can be of use to anyone.