This is understandable but it does not explicitly answer my question: does actions.reinforce(rewards) correspond to the average or sum of errors (over the batch)?
As a side note: I really like how the code simplifies with reinforce but even after reading all available information about it I still feel uncomfortable using it.