Artificial Intelligence, Technology, Conference, Iclr 2020, Neural Networks.
taking the division of p(x, y) and p(x), the normalizing constant Z(θ) will cancel out and leave the original definition of a categorical distribution defined in (2). The paper also notes that, unlike the original parametrization, the order of the logits has an impact on p_θ(x) in this case. Thus,