Are there any ideas for a workaround?
Maybe something more to the background of this problem: I’m trying to implement the weight update functionality of the “Trained Ternary Quantization”-Paper (https://arxiv.org/abs/1612.01064 20). So I thought a module which contains the continuous weights as well as the quantized weights as parameters as the “wrapper” module would fit my needs and could then call a convolution-function with this custom backward behaviour.
Thanks again for anyone who’s going to take a look and shares some thoughts!