very mild update to the irixxed magcap slerp, will be doing some other stuff to it over the next few days.
only around 750 entries in rank/alpha 32 4bit-qlora at 2e-6 for 2 epochs. bs 4 grad accum 4, for ebs 16 with cosine.
dataset here: https://huggingface.co/datasets/Nitral-AI/antirep_sharegpt
- Downloads last month
- 12
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support