Thanks @apaszke !!! That’s helpful.
My confusions, actually conceptual/the way I setup the problem - I haven’t  figured out what the reward should be in this context!
It’s nothing to do with PyTorch, I just haven’t thought carefully enough about what I’m actually trying to do here - I was carrying over an idea from continuous action reinforcement learning, and it doesn’t seem to make sense in the context of regression?