So I finally removed all the long deprecated Variable bits. 
My notebook makes no assumption about whether you pass in weights which require grads or not - if you do, it will happily backpropagate into them.
I did use a similar approach for audio (1d).
Best regards
Thomas