tjoseph:

# Only a single CUDA kernel call


That’s funny, as there are like 5-10 cuda calls, because all log_prob implementations are in Python (so one math op is done at a time). Well, unless JIT is used, but it is cumbersome to use on Distribution objects.
More ontopic, I think distributions.Independent exists for this usecase.