Base model please!
#2
by
deltanym
- opened
Hi! I've been hoping to get the base model working but can't quite run it at 8 bit, but could at 4. Could you please also do that one?
Thanks!
ok, we’ll give it a try. The estimated time of completion is 4-6 days.
sorry, due to overflow issues on CUDA, we currently do not plan to quantize this model,