Pomni commited on
Commit
a15e960
·
verified ·
1 Parent(s): 6b474d6

Finalize quant list with file sizes

Browse files
Files changed (1) hide show
  1. README.md +13 -13
README.md CHANGED
@@ -19,21 +19,21 @@ This is a repository of **GGML quants for [whisper-medium.en](https://huggingfac
19
 
20
  If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and will automate a lot of the hard stuff for you.
21
  ## List of Quants
22
- Check the *Files and versions* tab for file sizes. Clicking on a link will download the corresponding quant instantly.
23
  | Link | Quant | Size | Notes
24
  |:-----|:-----|--------:|:------|
25
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-f32.bin) | F32 | ? MB | Likely overkill. |
26
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-f16.bin) | F16 | ? MB | Performs better than Q8_0 for noisy audio and music. |
27
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q8_0.bin) | Q8_0 | ? MB | Sweet spot; superficial quality loss at nearly double the speed. |
28
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q6_k.bin) | Q6_K | ? MB | |
29
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q5_k.bin) | Q5_K | ? MB | |
30
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q5_1.bin) | Q5_1 | ? MB | |
31
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q5_0.bin) | Q5_0 | ? MB | Last "good" quant; anything below loses quality rapidly. |
32
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q4_k.bin) | Q4_K | ? MB | *Might* not have lost too much quality, but I'm not sure. |
33
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q4_1.bin) | Q4_1 | ? MB | |
34
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q4_0.bin) | Q4_0 | ? MB | |
35
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q3_k.bin) | Q3_K | ? MB | |
36
- | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q2_k.bin) | Q2_K | ? MB | Completely non-sensical outputs. |
37
 
38
  The F16 quant was taken from [ggerganov/whisper.cpp/ggml-medium.en.bin](https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-medium.en.bin).
39
  ## Questions you may have
 
19
 
20
  If you are looking for a program to run this model with, then I would recommend [EasyWhisper UI](https://github.com/mehtabmahir/easy-whisper-ui), as it is user-friendly, has a GUI, and will automate a lot of the hard stuff for you.
21
  ## List of Quants
22
+ Clicking on a link will download the corresponding quant instantly.
23
  | Link | Quant | Size | Notes
24
  |:-----|:-----|--------:|:------|
25
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-f32.bin) | F32 | 3.06 GB | Likely overkill. |
26
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-f16.bin) | F16 | 1.53 GB | Performs better than Q8_0 for noisy audio and music. |
27
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q8_0.bin) | Q8_0 | 823 MB | Sweet spot; superficial quality loss at nearly double the speed. |
28
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q6_k.bin) | Q6_K | 640 MB | |
29
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q5_k.bin) | Q5_K | 539 MB | |
30
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q5_1.bin) | Q5_1 | 587 MB | |
31
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q5_0.bin) | Q5_0 | 539 MB | Last "good" quant; anything below loses quality rapidly. |
32
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q4_k.bin) | Q4_K | 445 MB | *Might* not have lost too much quality, but I'm not sure. |
33
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q4_1.bin) | Q4_1 | 492 MB | |
34
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q4_0.bin) | Q4_0 | 445 MB | |
35
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q3_k.bin) | Q3_K | 344 MB | |
36
+ | [GGML](https://huggingface.co/Pomni/whisper-medium.en-ggml-allquants/resolve/main/ggml-medium.en-q2_k.bin) | Q2_K | 267 MB | Completely non-sensical outputs. |
37
 
38
  The F16 quant was taken from [ggerganov/whisper.cpp/ggml-medium.en.bin](https://huggingface.co/ggerganov/whisper.cpp/blob/main/ggml-medium.en.bin).
39
  ## Questions you may have