any hope for running on 256gb ram and 12gb vram ?
#3
by
gopi87
- opened
hi guys do you think i can run anythink with 256gb ram and 12gb vram ?
100% .theoretically even possible with gpu only and ssd's direct connect
100% .theoretically even possible with gpu only and ssd's direct connect
is it ? can you help me ?
ktransformers creators to answer
recommendation is to try and test yourself
recommendation is to try and test yourself
got it prev i did with small model. very good with ik_llama where i am getting 7.5t/sec with deep seek q2
What exactly do you mean by “direct connect” with the ssd?
pcie