GGUF
llama.cpp
polaris
ollama
dzur658 commited on
Commit
4410f3e
·
verified ·
1 Parent(s): 667718d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md CHANGED
@@ -18,6 +18,10 @@ This repository contains GGUF (GPT-Generated Unified Format) model files for the
18
  These files were quantized using an importance matrix generated from the Polaris dataset for optimal performance. The imatrix file can be viewed on the Github for this repository (coming soon).
19
  The importance matrix was generated using 10k semi-randomly chosen examples from the [Polaris Dataset](https://huggingface.co/datasets/POLARIS-Project/Polaris-Dataset-53K)
20
 
 
 
 
 
21
  # Accreditation
22
 
23
  All credit for the original Polaris model belongs to their team and their affiliated organizations. Thank you for all of your hard work, and open publishing of the models
 
18
  These files were quantized using an importance matrix generated from the Polaris dataset for optimal performance. The imatrix file can be viewed on the Github for this repository (coming soon).
19
  The importance matrix was generated using 10k semi-randomly chosen examples from the [Polaris Dataset](https://huggingface.co/datasets/POLARIS-Project/Polaris-Dataset-53K)
20
 
21
+ # Associated Github
22
+ The [Github](https://github.com/dzur658/Polaris-4B-Preview-IQ-GGUF/tree/main) for this project contains the required modelfile settings necessary to run this model with Ollama along with some of the scripts I used to create these
23
+ imatrix quantizations.
24
+
25
  # Accreditation
26
 
27
  All credit for the original Polaris model belongs to their team and their affiliated organizations. Thank you for all of your hard work, and open publishing of the models