A repository of imatrix files I've created using bartowski's data set and virt-io's extended RP dataset.
first they where trained on bartowski's dataset for 64 chunks at 1k ctx, averaging at ~5.5 ppl.
Next they were trained on the extended RP dataset on two sperate chunks that total to 64 at 4k ctx.
the first chunk averages ~3.8-4.0 ppl, and the second chunk averages ~2.2-2.4 ppl.
I've uploaded these because my internet is too slow to upload the models themselves
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
๐
Ask for provider support