Hugging Face's logo

second-state
/
Llama-3.2-3B-Instruct-GGUF

Text Generation
Transformers
GGUF
llama
chat
llama-3
Inference Endpoints
conversational
Model card Files Community
apepkuss79 commited on
Commit
bf944b3
·
verified ·
1 Parent(s): eea10cb

Update models

Browse files
Files changed (12) hide show
  1. Llama-3.2-3B-Instruct-Q2_K.gguf +1 -1
  2. Llama-3.2-3B-Instruct-Q3_K_L.gguf +1 -1
  3. Llama-3.2-3B-Instruct-Q3_K_M.gguf +1 -1
  4. Llama-3.2-3B-Instruct-Q3_K_S.gguf +1 -1
  5. Llama-3.2-3B-Instruct-Q4_0.gguf +1 -1
  6. Llama-3.2-3B-Instruct-Q4_K_M.gguf +1 -1
  7. Llama-3.2-3B-Instruct-Q4_K_S.gguf +1 -1
  8. Llama-3.2-3B-Instruct-Q5_0.gguf +1 -1
  9. Llama-3.2-3B-Instruct-Q5_K_M.gguf +1 -1
  10. Llama-3.2-3B-Instruct-Q5_K_S.gguf +1 -1
  11. Llama-3.2-3B-Instruct-Q6_K.gguf +1 -1
  12. Llama-3.2-3B-Instruct-Q8_0.gguf +1 -1
Llama-3.2-3B-Instruct-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f355e9b1a6c69ee7ea297f8b3bb38c44ab00ad7bc9f699babe0a02eae61cf276
3
  size 1363935520
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2dabdba85d46f31b464a0fded5631c5bddec151caefb45dd8f4894e477c41897
3
  size 1363935520
Llama-3.2-3B-Instruct-Q3_K_L.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f778dda3fa1dd1c34747038221113b7940b3b26645e50775bbc8b4a8997040c6
3
  size 1815347488
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57d59b635b58cc4ce331a86aa197624837af97b40d26c22c284358cd8de1cd9f
3
  size 1815347488
Llama-3.2-3B-Instruct-Q3_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:21c7b1e2c11ce80e0de67c3b6aeace40edf6cd0c6606d3c0085117b9c8951669
3
  size 1687159072
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84a27af779dabc1480470b8950e5d6d060957f4fe8df165863981d5fe77be4da
3
  size 1687159072
Llama-3.2-3B-Instruct-Q3_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:24f06a24cf262e93c9c25dea3f207593e23293df4732a49cdc887bbf3d145e14
3
  size 1542848800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8434d06c50ff5c8113fefbd0e275d8879ac15ec29c5330d3fee61b295a3490f4
3
  size 1542848800
Llama-3.2-3B-Instruct-Q4_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:aec4181a9debbcd9213f4c8e6b4b33bd24181feb373332d904839492a8b4169b
3
  size 1917190432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8cc8df7386113cadf7f592fcf4a25cf9ac46083ee44b521132b4448261031d99
3
  size 1917190432
Llama-3.2-3B-Instruct-Q4_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4f1a04d927b09ec18eb2f233d85ecd760fc2d35cec97e37f8604d3632210d9a
3
  size 2019377440
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5e6cf2c071a429e2380d2d1182c06a20b8c999d0c059636530e4a84beb8e8d4
3
  size 2019377440
Llama-3.2-3B-Instruct-Q4_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5f3e5cc3cb1d83b9b9b2876250db8703d93eb23803598eafd3aafe5b5da99d1f
3
  size 1928200480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9054a2b99ae8e37d70b484dccde32b2eedc5d9510330d1d05a3ff90147a24ec7
3
  size 1928200480
Llama-3.2-3B-Instruct-Q5_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c112217953cbe9e97e03ac9e459d1629cf939ccaf669bde8250901cf2277ef4c
3
  size 2269511968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ae5f5bfd45f7516e8253d78f300c3e4be328291ca3e0eb3b5bf7b8d867ab740
3
  size 2269511968
Llama-3.2-3B-Instruct-Q5_K_M.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5fcbaeaa8e8cd835fd38f2d1daccd58816ba79af262d2335b7454cf0bd21d7cf
3
  size 2322153760
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e02e674781b7e2fe80318de645397f957f7b768e86edb42bd9fa0a120578855b
3
  size 2322153760
Llama-3.2-3B-Instruct-Q5_K_S.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a47518afcfee91bf0b4a6da63ad87774b9dc403a643f3450fb1761fd5a03b59d
3
  size 2269511968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:19b73a5b64fda6f297cc6e031a0b5055b8ef4ed9e09a90d9599150a247cf4b1e
3
  size 2269511968
Llama-3.2-3B-Instruct-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2ccc943ca31e72526a309b319b15d1ec453cd1c01e27aea4731ccc6a3bfab264
3
  size 2643853600
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51c797166082bed6c67fcc8d5d745eb9b4f23455dd35f0d4b0fbb88b04b33e7b
3
  size 2643853600
Llama-3.2-3B-Instruct-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:94f22b7231df5cd1907ff48dba54497b2d7912a4ce60d914f3dcfc0347fa8f21
3
  size 3421899040
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45b690c2640b7c36e2ccb9305a858f8a95d804711e3f90743d646e1808949e1f
3
  size 3421899040