The fix is in, and should be in tfp-nightly tomorrow: Fix bug in windowed_mcmc related to constrained distributions having … · tensorflow/probability@956d09f · GitHub 1
After that, the code I snipped above should work. Please let us know if you have any more issues!