What I would do in that case, is to sync a portion or directory of your bucket locally (assuming different models are in ≠ “subfolders”) and then just load your model from disk with AutoModel.from_pretrained(path)