Machine Learning, Optimization, Gradient Descent, Reinforcement Learning.
sample z as the 1-hot vector described by the argmax of y. For back propagation, we simply assume the derivative of z is equal tot he derivative of y. Straight through approximation forward pass. Straight through approximation backward pass. In other words, we act in the world with the argmax of y