Model exits in Windows Booga
I have a 4090 and 64gb of CPU ram. Upon loading this model in the
text-generation-webui, the webui exits with
Loading model ...
Done!
Press any key to continue . . .
Has anyone found a solution to this on windows.
Same
So turns out on windows you need alot of Pagefile... like 90GB of page file. After setting this the model loads -_-.
Ahh yeah you're running out of RAM and it can't load it onto the GPU. It's annoying it doesn't print a better error message.
Thanks for posting the solution! Lots of people are having this issue and I couldn't figure out what was wrong.
So turns out on windows you need alot of Pagefile... like 90GB of page file. After setting this the model loads -_-.
Do you mean increasing pagefile on the system disk C? And which drive is your model located?
I have a second NVM SSD which I used because 90GB is alot. Win + R "sysdm.cpl" -> Advanced -> Performance Settings -> Advanced -> Virtual Memory. Then set a fast SSD to have a min and max pagefile of 94000 save and reboot and try to load the model again.
I have a second NVM SSD which I used because 90GB is alot. Win + R "sysdm.cpl" -> Advanced -> Performance Settings -> Advanced -> Virtual Memory. Then set a fast SSD to have a min and max pagefile of 94000 save and reboot and try to load the model again.
Yep, it works, thank you
Can confirm. Was puzzled for several days why the model was not loading. Changing the page file as suggested resolved the issue. Thank you so much!
Interesting, this worked for me the first time. 4090 / 64GB of CPU memory, Virtual Memory size at default setting of 36GB. Windows 11. Perhaps just the combined CPU + VM needs to exceed 90GB?