sayakpaul

/

flux.1-dev-nf4-with-bnb-integration

like 11

pip install git+https://github.com/huggingface/diffusers@c1d5b9669144f08e10d2abbc39cd8d198c6a64b9
this work，but 15g Vram is OutOfMemoryError: CUDA out of memory. Tried to allocate 80.00 MiB. GPU 0 has a total capacity of 14.75 GiB of which 53.06 MiB is free. Process 9501 has 14.69 GiB memory in use.

I request that you not post issues in multiple places. You have posted the same issue on GitHub, here, and also on my Twitter post. Let's try not to do that :)

but 15g Vram is OutOfMemoryError: CUDA out of memory. Tried to allocate 80.00 MiB. GPU 0 has a total capacity of 14.75 GiB of which 53.06 MiB is free. Process 9501 has 14.69 GiB memory in use.

For this, you should be able to load this checkpoint on a free-tier Google Colab:
https://colab.research.google.com/gist/sayakpaul/dbda0da4ec30fbab40cee3fc4ac35329/scratchpad.ipynb

But full inferencing requires additional tricks, which I will post later.

I request that you not post issues in multiple places. You have posted the same issue on GitHub, here, and also on my Twitter post. Let's try not to do that :)

but 15g Vram is OutOfMemoryError: CUDA out of memory. Tried to allocate 80.00 MiB. GPU 0 has a total capacity of 14.75 GiB of which 53.06 MiB is free. Process 9501 has 14.69 GiB memory in use.

For this, you should be able to load this checkpoint on a free-tier Google Colab:
https://colab.research.google.com/gist/sayakpaul/dbda0da4ec30fbab40cee3fc4ac35329/scratchpad.ipynb

But full inferencing requires additional tricks, which I will post later.

Tks，Look forward to

try explicit use of Accelerate offloading