Unsloth BnB 4bit Models
#1
by
kjh7207
- opened
Hello! I'm a Korean user who has been using Unsloth regularly and finding it incredibly helpful.
Would it be possible for you to upload an unsloth-bnb-4bit version of this model? The fp16 version takes nearly 1.5 hours just to load 118 checkpoints on my H100 * 4 GPU cloud setup, which makes the rental costs prohibitive and experimentation practically impossible.
Also, since I've been getting so much value from Unsloth, I'd love to make a small donation to support the project if there's a way to do so.
Thank you for all your amazing work!