Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
neural network θ and a uniform random variable u. The logit is key to computing a sample for our probability distribution. In particular, a “hard sample” can be computed by applying the Heaviside function to the logit. A “soft sample” (the continuous relaxation) can be computed by applying the