|
--- |
|
library_name: transformers |
|
tags: |
|
- unsloth |
|
- trl |
|
- sft |
|
--- |
|
|
|
## Interim-MN-fp16 |
|
|
|
 |
|
|
|
This one was a doozy. Three restarted runs of which one failed at the last possible moment... Anyway, the result is decent enough and passes my own Nala-testing so it's not too bad. Not gonna benchmark this myself but if anyone feels the need to then I'd be happy to include numbers here. |
|
|
|
Probably best if using normal Nemo settings, no weird stuff. (Or just use the recommended ones in the [Recommended Settings repo](https://huggingface.co/Quant-Cartel/Recommended-Settings/tree/main/Interim-MN)) |
|
|
|
[iMat GGUFs courtesy of your local Cartel frens](https://huggingface.co/Quant-Cartel/Interim-MN-iMat-GGUF) |
