Sci-fi-vy
/

Qwen2.5-Omni-7B-GGUF

Model card Files Files and versions

Qwen2.5-Omni-7B-GGUF

Ctrl+K

Ctrl+K

1 contributor

History: 31 commits

Sci-fi-vy's picture

Upload Qwen2.5-Omni-7B-UD-Q8_K_XL.gguf

9387141 verified 3 months ago

.gitattributes

3.36 kB

Upload Qwen2.5-Omni-7B-UD-Q8_K_XL.gguf 3 months ago
Qwen2.5-Omni-7B-BF16.gguf

15.2 GB
xet

Upload Qwen2.5-Omni-7B-BF16.gguf 3 months ago
Qwen2.5-Omni-7B-IQ4_NL.gguf

4.44 GB
xet

Upload Qwen2.5-Omni-7B-IQ4_NL.gguf 3 months ago
Qwen2.5-Omni-7B-IQ4_XS.gguf

4.24 GB
xet

Upload Qwen2.5-Omni-7B-IQ4_XS.gguf 3 months ago
Qwen2.5-Omni-7B-Q2_K.gguf

3.02 GB
xet

Upload Qwen2.5-Omni-7B-Q2_K.gguf 3 months ago
Qwen2.5-Omni-7B-Q2_K_L.gguf

3.14 GB
xet

Upload Qwen2.5-Omni-7B-Q2_K_L.gguf 3 months ago
Qwen2.5-Omni-7B-Q3_K_M.gguf

3.81 GB
xet

Upload Qwen2.5-Omni-7B-Q3_K_M.gguf 3 months ago
Qwen2.5-Omni-7B-Q3_K_S.gguf

3.49 GB
xet

Upload Qwen2.5-Omni-7B-Q3_K_S.gguf 3 months ago
Qwen2.5-Omni-7B-Q4_1.gguf

4.87 GB
xet

Upload Qwen2.5-Omni-7B-Q4_1.gguf 3 months ago
Qwen2.5-Omni-7B-Q4_K_M.gguf

4.68 GB
xet

Upload Qwen2.5-Omni-7B-Q4_K_M.gguf 3 months ago
Qwen2.5-Omni-7B-Q4_K_S.gguf

4.46 GB
xet

Upload Qwen2.5-Omni-7B-Q4_K_S.gguf 3 months ago
Qwen2.5-Omni-7B-Q5_K_M.gguf

5.44 GB
xet

Upload Qwen2.5-Omni-7B-Q5_K_M.gguf 3 months ago
Qwen2.5-Omni-7B-Q5_K_S.gguf

5.32 GB
xet

Upload Qwen2.5-Omni-7B-Q5_K_S.gguf 3 months ago
Qwen2.5-Omni-7B-Q6_K.gguf

6.25 GB
xet

Upload Qwen2.5-Omni-7B-Q6_K.gguf 3 months ago
Qwen2.5-Omni-7B-Q8_0.gguf

8.1 GB
xet

Upload Qwen2.5-Omni-7B-Q8_0.gguf 3 months ago
Qwen2.5-Omni-7B-UD-IQ1_M.gguf

2.2 GB
xet

Upload Qwen2.5-Omni-7B-UD-IQ1_M.gguf 3 months ago
Qwen2.5-Omni-7B-UD-IQ1_S.gguf

2.07 GB
xet

Upload Qwen2.5-Omni-7B-UD-IQ1_S.gguf 3 months ago
Qwen2.5-Omni-7B-UD-IQ2_M.gguf

2.86 GB
xet

Upload Qwen2.5-Omni-7B-UD-IQ2_M.gguf 3 months ago
Qwen2.5-Omni-7B-UD-IQ2_XXS.gguf

2.4 GB
xet

Upload Qwen2.5-Omni-7B-UD-IQ2_XXS.gguf 3 months ago
Qwen2.5-Omni-7B-UD-IQ3_XXS.gguf

3.17 GB
xet

Upload Qwen2.5-Omni-7B-UD-IQ3_XXS.gguf 3 months ago
Qwen2.5-Omni-7B-UD-Q2_K_XL.gguf

3.24 GB
xet

Upload Qwen2.5-Omni-7B-UD-Q2_K_XL.gguf 3 months ago
Qwen2.5-Omni-7B-UD-Q3_K_XL.gguf

4 GB
xet

Upload Qwen2.5-Omni-7B-UD-Q3_K_XL.gguf 3 months ago
Qwen2.5-Omni-7B-UD-Q4_K_XL.gguf

4.79 GB
xet

Upload Qwen2.5-Omni-7B-UD-Q4_K_XL.gguf 3 months ago
Qwen2.5-Omni-7B-UD-Q5_K_XL.gguf

5.46 GB
xet

Upload Qwen2.5-Omni-7B-UD-Q5_K_XL.gguf 3 months ago
Qwen2.5-Omni-7B-UD-Q6_K_XL.gguf

6.96 GB
xet

Upload Qwen2.5-Omni-7B-UD-Q6_K_XL.gguf 3 months ago
Qwen2.5-Omni-7B-UD-Q8_K_XL.gguf

10.2 GB
xet

Upload Qwen2.5-Omni-7B-UD-Q8_K_XL.gguf 3 months ago
README.md

36.9 kB

Update README.md 3 months ago
config.json

15.1 kB

Upload 2 files 3 months ago
imatrix_unsloth.dat

4.54 MB
xet

Upload 2 files 3 months ago
mmproj-BF16.gguf

2.64 GB
xet

Upload mmproj-BF16.gguf 3 months ago
mmproj-F16.gguf

2.64 GB
xet

Upload mmproj-F16.gguf 3 months ago
mmproj-F32.gguf

5.26 GB
xet

Upload mmproj-F32.gguf 3 months ago