Hi,
I was wondering if there was a way to speed up zero shot classification as outlined here 28 if I was to use pytorch directly.
For example I’m guessing this default method tokenises and pads to length 512 whereas most of my text is < 50 words. I’ve had some experience in using BertWordPieceTokenizer. So I’m guessing it would also be faster to tokenize everything in one go and send it to a pytorch model directly, rather than one by one which is what I’m guessing is happening here?
Would really appreciate even a starting point if such a thing is possible.