Hi,Great to see this, well done.Is it based on any of the quantization aware trained (QAT) releases?Thx !
hellounsloth 4bitthank you
okay, thanks
· Sign up or log in to comment