Hey @patrickvonplaten, this means that for loading the model, like for example:
model_name = "facebook/wav2vec2-large-xlsr-53-german"
device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
feature_extractor = Wav2Vec2Processor.from_pretrained(model_name)
model = Wav2Vec2Model.from_pretrained(model_name)
model.to(device)

one would need more than 12GB of GPU? I am unable to load the model in an RTX 3080 Ti as it returns “CUDA out of memory error” just after I run the code above. Am I getting something wrong?