Theorem 4. Alg. 3 converges monotonically to a stationary point of LLent(θ;D, τ ) (Eq. (2)).
Proof. The high-level idea of the proof is to show that the parameter update phase (lines 6-10) opti-
mizes a concave surrogate objective of LLent(θ;D, τ ), which is determined by the entropies computed
Tractable Regularization of Probabilistic Circuits