Hugging Face's logo

larenspear
/
NuminaMath-7B-TIR-GGUF

GGUF
Inference Endpoints
conversational
Model card Files Community
larenspear commited on
Commit
cf4683d
·
1 Parent(s): e0e9a26

GGUF Quantization

Browse files
Files changed (11) hide show
  1. numinamath-7b-tir-f16.gguf +3 -0
  2. numinamath-7b-tir-q2_k.gguf +3 -0
  3. numinamath-7b-tir-q3_k_l.gguf +3 -0
  4. numinamath-7b-tir-q3_k_m.gguf +3 -0
  5. numinamath-7b-tir-q3_k_s.gguf +3 -0
  6. numinamath-7b-tir-q4_k_m.gguf +3 -0
  7. numinamath-7b-tir-q4_k_s.gguf +3 -0
  8. numinamath-7b-tir-q5_k_m.gguf +3 -0
  9. numinamath-7b-tir-q5_k_s.gguf +3 -0
  10. numinamath-7b-tir-q6_k.gguf +3 -0
  11. numinamath-7b-tir-q8_0.gguf +3 -0
numinamath-7b-tir-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c142be5dc85750d2f617d177ad11b99eb0ca592d832abcbefb178d8a54e85f96
3
+ size 13825218048
numinamath-7b-tir-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8b94bca93385addf43038d7a0234b171b70645cab895f9d980f3cf7bcea6d1b9
3
+ size 2718422528
numinamath-7b-tir-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d30418287cf6d0802e45620b93a847625d9a41fd8feea201f600045bb582ef7
3
+ size 3746272768
numinamath-7b-tir-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:89c7b599b9c24b4aaefab3fc20074dbc89ebdd3e0a27e9c64290985d122959e6
3
+ size 3461191168
numinamath-7b-tir-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:adf9c4225399dfc8300495b4aa852a1996d5e33f2c87f364a00296a899339034
3
+ size 3138016768
numinamath-7b-tir-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c14fbebe373809666f603dff1bf215cf292e59acf524c248bf159dbaee829ecc
3
+ size 4223358464
numinamath-7b-tir-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9605bec80bf435ca0b714029b972fc30f799b050fe0434a7bd9729712cf15db0
3
+ size 4025357824
numinamath-7b-tir-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d5aa8fff207d349b20030e5d1ceb3c51e4fd869d901e77c33defc0f3de9d4f37
3
+ size 4926428672
numinamath-7b-tir-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:103224b798c2470fbb3e612549f71c21b57629cfebe1dec215650ffc9ef1006d
3
+ size 4811396608
numinamath-7b-tir-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3441fbaff49bda83d9678b8018af22877c0147c923454c2ba74fd231c93e3dbe
3
+ size 5673440800
numinamath-7b-tir-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b87761460641f7fa0b78b5aeafa9b12ee37d2ff43410d1426bba1db6685d40a8
3
+ size 7346984480