I just recently started to work on this in my spare time.
My plan is to:

implement a selected number of variants of inference algorithms such as variational and MCMC inference (both traditional and scalable versions) separately from anything neural-network related
make such framework easily applicable to the existing nn module
implement basic functionalities for common statistical distributions
I will post an update when I have something to show.