Any chance for -base model?
#1
by
SerySmith
- opened
I'm enjoying Air, wondering if you would be able to quant the base model or if it's too much a hassle?
Just wanted to compare since Air is pretty fun.
It's in progress now! should be done in a few hours, ran into a small issue with a late tensor on small sizes so had to re-run a few quants :)