Oh, I also realized I should add here for any readers that if you want to use pipelines with GPU, you can just pass device=0 where 0 is the device number, to the pipeline factory:
classifier = pipeline("zero-shot-classification", device=0)

We should be updating this to automatically use GPU soon.