Quantized model

#9
by nishcn91 - opened

Hi, can i use the bitsandbytes package to run the model with int8

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment