Solved by SimonW in post #2 
              
              
                Yes, it will work just fine. 

Not really. The operations can even be non-differentiable if you don’t want gradients. You should always return some variable through.