Any plan for 8 bit?

by jm4n21 - opened Feb 15

Discussion

jm4n21

Feb 15

Thank you for sharing! Is there any plan for releasing an 8-bit version?

bnjmnmarie

The Kaitchup org Feb 16

Sorry, no plan for an 8-bit model. The 4-bit version already performs (almost) as well as the original model and all my GPUs dedicated to quantization are already working on something else.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

Your need to confirm your account before you can post a new comment.

· Sign up or log in to comment