How do I pass a tensor output which is with respect to one tokenizer(BART) to another tokenizer(XLNet) without converting it to string because this is where the model is turning out to be non-differentiable?
I have output from the BART model which has to be passed to the XL-Net model. But to do so I have to change the output from BART to the format needed by XL-Net, so I have to convert it to string and pass it through an XL-Net tokenizer. However, when using autograd w.r.t BART model it is becoming a non-differentiable unit.
A way around will be helpful.