The KL function for full-rank MVN is rather involved, so it is perhaps a numerical issue. Try  using distributions.Independent to wrap univariate gaussians. Maybe avoiding tiny std values will also work.