You can make your own transform that accomplishes it for you:
transform_rgb = transforms.Lambda(lambda image: image.convert('RGB'))
I’m not sure how performant this is, though, given the lambda operation and how it’s on the PIL Image and not the tensor.