Hugging Face's logo
LiuChao's picture
1 1

LiuChao

achilou
·

AI & ML interests

None yet

Recent Activity

reacted to beomi's post with 🔥 2 months ago
# PyTorch == 2.5.0 Breaks Transformers' SDPAttention! When you encounter "RuntimeError: cuDNN Frontend error: [cudnn_frontend] Error: No execution plans support the graph." We can use workaround like this: ```python torch.backends.cuda.enable_cudnn_sdp(False) ``` but this slow downs the performance gain from PyTorch 2.5. Although it is fixed(not "fixed" but default option is turn-off the cuDNN SDPA) at here -- https://github.com/pytorch/pytorch/pull/138587 , but not released yet. (you need to install directly from source) Fastest way for now : pip install "torch<2.5" Ref: https://github.com/huggingface/diffusers/issues/9704#issuecomment-2422585273
View all activity

Organizations

None yet

models

None public yet

datasets

None public yet