You should be able to sample construct a co-variance matrix, and sample using numpy,
https://docs.scipy.org/doc/numpy/reference/generated/numpy.random.multivariate_normal.html 245
then just use, torch.from_numpy(samples)