Upload fp16, or LoRA?

#2
by TheBloke - opened

Hey FPHam

I've had a couple of requests to do GGML and other GPTQ variants of this model.

I know you're limited by upload speed, but would it be possible to upload a LoRA at least? Then I could merge that and upload more quants for people.

Thanks

It's not that I don't want, but I have about 300 LORAS and I have no idea which one I used for this model :(
Maybe I'll try to match it by date...
Also I had to delete the original HF model from my comp as I'm badly running out of SSD space.

Sign up or log in to comment