will this fit on 12gb card?
#1
by
ramzeez88
- opened
like in title
Probably not, the model's file sizes together is almost 12 GB. You might be restrict the context enough to load the model, but may not have meaningful context to use the model. You can always try it, Windows drivers may offload GPU VRAM into regular RAM on Windows and may run, but slower.
Yeah, i downloaded it and it doesn't work unfortunately. Thanks for replying.