For those with an inclination towards gpflow and pytorch, I did some work on a port at https://github.com/t-vi/candlegp 96 . Of course, it is much more modest in ambition than pyro.
Best regards
Thomas