If there's a 4-bit quantized version available - this is PERFECT for my 2x32GB setup.Can someone quantize it? My GPUs doesn't have enough VRAM to quantize it.
Β· Sign up or log in to comment