Interim-MN-fp16

This one was a doozy. Three restarted runs of which one failed at the last possible moment... Anyway, the result is decent enough and passes my own Nala-testing so it's not too bad. Not gonna benchmark this myself but if anyone feels the need to then I'd be happy to include numbers here.

Probably best if using normal Nemo settings, no weird stuff. (Or just use the recommended ones in the Recommended Settings repo)

iMat GGUFs courtesy of your local Cartel frens

Downloads last month: 6

Safetensors

Model size

12.2B params

Tensor type

BF16

Inference Providers NEW

Text Generation

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for rAIfle/Interim-MN-fp16

Quantizations

2 models

Collection including rAIfle/Interim-MN-fp16

Home baked

Collection

Home-baked merges and tunes. • 13 items • Updated Sep 21, 2024