@razvanc92
I just found the solution using distribution package too.
As I mentioned in the previous post, the target should be log_probs, so based on, we must have these:
preds_torch = torch.distributions.Categorical(probs=torch.from_numpy(preds))
labels_torch = torch.distributions.Categorical(logits=torch.from_numpy(np.log(labels)))
torch_res = kl_divergence(preds_torch, labels_torch)

Note that for target(labels_torch) we use logits not probs and also provide log(labels) rather than labels itself.
Good luck
Nik