Hugging Face's logo

SparseLLM
/
prosparse-llama-2-7b-predictor

Feature Extraction
Transformers
English
sparsellama
custom_code
Model card Files Community
1
Raincleared commited on
Commit
ce4c4b9
·
verified ·
0 Parent(s):

Duplicate from PowerInfer/prosparse-llama-2-7b-predictor

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. .gitattributes +35 -0
  2. README.md +25 -0
  3. model_0.pt +3 -0
  4. model_1.pt +3 -0
  5. model_10.pt +3 -0
  6. model_11.pt +3 -0
  7. model_12.pt +3 -0
  8. model_13.pt +3 -0
  9. model_14.pt +3 -0
  10. model_15.pt +3 -0
  11. model_16.pt +3 -0
  12. model_17.pt +3 -0
  13. model_18.pt +3 -0
  14. model_19.pt +3 -0
  15. model_2.pt +3 -0
  16. model_20.pt +3 -0
  17. model_21.pt +3 -0
  18. model_22.pt +3 -0
  19. model_23.pt +3 -0
  20. model_24.pt +3 -0
  21. model_25.pt +3 -0
  22. model_26.pt +3 -0
  23. model_27.pt +3 -0
  24. model_28.pt +3 -0
  25. model_29.pt +3 -0
  26. model_3.pt +3 -0
  27. model_30.pt +3 -0
  28. model_31.pt +3 -0
  29. model_4.pt +3 -0
  30. model_5.pt +3 -0
  31. model_6.pt +3 -0
  32. model_7.pt +3 -0
  33. model_8.pt +3 -0
  34. model_9.pt +3 -0
  35. predictors_clip15/model_0.pt +3 -0
  36. predictors_clip15/model_1.pt +3 -0
  37. predictors_clip15/model_10.pt +3 -0
  38. predictors_clip15/model_11.pt +3 -0
  39. predictors_clip15/model_12.pt +3 -0
  40. predictors_clip15/model_13.pt +3 -0
  41. predictors_clip15/model_14.pt +3 -0
  42. predictors_clip15/model_15.pt +3 -0
  43. predictors_clip15/model_16.pt +3 -0
  44. predictors_clip15/model_17.pt +3 -0
  45. predictors_clip15/model_18.pt +3 -0
  46. predictors_clip15/model_19.pt +3 -0
  47. predictors_clip15/model_2.pt +3 -0
  48. predictors_clip15/model_20.pt +3 -0
  49. predictors_clip15/model_21.pt +3 -0
  50. predictors_clip15/model_22.pt +3 -0
.gitattributes ADDED
@@ -0,0 +1,35 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ language:
4
+ - en
5
+ ---
6
+
7
+ # ProSparse-LLaMA-2-7B-Predictor
8
+
9
+ - Model Creator: [THUNLP](https://nlp.csai.tsinghua.edu.cn/), [ModelBest](modelbest.cn), and [PowerInfer](https://huggingface.co/PowerInfer)
10
+
11
+ This repository provides a group of sparsity predictors serving for [SparseLLM/ProSparse-LLaMA-2-7B](https://huggingface.co/SparseLLM/prosparse-llama-2-7b).
12
+
13
+ Note: The folder `predictors_clip15` contains the activation predictors trained with data only reserving top 15% activation values.
14
+
15
+ ### Citation
16
+
17
+ Please kindly cite using the following BibTeX:
18
+
19
+ ```bibtex
20
+ @article{song2024prosparse,
21
+ title={{ProSparse}: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models},
22
+ author={Song, Chenyang and Han, Xu and Zhang, Zhengyan and Hu, Shengding and Shi, Xiyu and Li, Kuai and Chen, Chen and Liu, Zhiyuan and Li, Guangli and Yang, Tao and Sun, Maosong},
23
+ year={2024},
24
+ }
25
+ ```
model_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa2646edd7db26aa0f67a73ce98f9185c0c6e715fa0105d390037e582e599836
3
+ size 61867091
model_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac4282bdabc447b87f951e74074972c62ce5cfef244b542cc78e50dda7f61a68
3
+ size 61867091
model_10.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:639a1dd328f2c24a63afbdcad292add7fd39149d6f07efc6f7cb3727dec65eed
3
+ size 61867095
model_11.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0196ac6ee6d9e34d3125a0ac219c6abb18450cc845c1d0fcd3a8d9097d28a0e
3
+ size 61867095
model_12.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:762f855d13d3a20ae1057fa74c1ee042e3cd6dfd74238f986bb424063f5922cf
3
+ size 61867095
model_13.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44137e220261549bb415280ddbcd04fec71554d8d44c82948ab8fc38af0d0657
3
+ size 61867095
model_14.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d478ddd733fdaddfd4253e22a7bbfd52ac7e99331d1482978c25d2a3433ca839
3
+ size 61867095
model_15.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b11e02ae26835597e95c2d0a1158272d77a87c81e49ad9b2065a486d4a63229
3
+ size 61867095
model_16.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dbf6f39a1b99227ccb728e28424d2c1a422ff1cacfb2a5ac15c7abcf0d254521
3
+ size 61867095
model_17.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b38a9fafc96093cb832859167dc5d7052b09a9823793c17097082164371bf39e
3
+ size 61867095
model_18.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cdab5eebc95ae0de1d6920d9fc6378e174ed455c2eebab721b383e6a4777dd3c
3
+ size 61867095
model_19.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:faf94727def91eb7fed8f2d520d4fe965e25a31986f88e1ea5f14dd08db6595d
3
+ size 61867095
model_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b5bb5f326e93b2ba642a868e3738a4fccee392a5dca47f1251d666d666f25a1
3
+ size 61867091
model_20.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ad92fc5c23a6a27fce1a487b33ebb8076ad146fcae4e12d13ab9cd3d466b212
3
+ size 61867095
model_21.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9aa9e92fc957a701606855b2c43e487fca0c14bc448cafe14f19b9848a465b04
3
+ size 61867095
model_22.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:253cbdf34485490d2de1acbb7b791e4a8e8589826ed3bca250558e9d3c87152d
3
+ size 61867095
model_23.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e0c3201f7c588abd7de45b1cb47ca5f7f444f2491c189d87081db8dffd8b5f41
3
+ size 61867095
model_24.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0d48888f53745eb1fb759142cac2b9e90b3174706c975e0e54c4fe8480e5c10d
3
+ size 61867095
model_25.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b73256e7c4398235cf7e178b3e2d733aa85293b9dbae5edb2ba8ef71a0ddf380
3
+ size 61867095
model_26.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfcc693cdc93c9caa408ade919c8347ffb7c137d11b1289e21d49c6ca00a3ee5
3
+ size 61867095
model_27.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c620de5795fe17d3839387a7555fcc394797fa210d413869ffdfdc315457d8d0
3
+ size 61867095
model_28.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e8c1c5670028e272a49c696274ea00e5901f3752c18d7827a5224a5e6ee27be6
3
+ size 61867095
model_29.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0e57496e996aa6eff5a071ef98ae4faf036fac0f46e530dc1212fd483d8ff302
3
+ size 61867095
model_3.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4fef4b5cafc1afceec6bd18adb06424a315890eeaf4f57b8c70bcbec42c1ad02
3
+ size 61867091
model_30.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a7c323ed736f142e8f25f48c7bfc87acddbf3ff597d1c7d1132171347f188601
3
+ size 61867095
model_31.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f1c080bdc659a960f672ab83b04725a3cfcfc8d92569d14e7b6f6fd1106845aa
3
+ size 61867095
model_4.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1a71955055469ee18d5da09f9f806a34fe88990a7d48f2da0a5bcc0eae81a9e2
3
+ size 61867091
model_5.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e52cf6bf1ded66fe23e58ece3c06045b88bc0215032f61515ca24f100bdc32c8
3
+ size 61867091
model_6.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eabb129f651caf7f1533b238902f7a721266135fcff6f06489b8d6b2f3fd8c10
3
+ size 61867091
model_7.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:51c4be5c7042e34806b76ebbc0264988d5a4641329e72b21bec18f18484afcd6
3
+ size 61867091
model_8.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:352eca67402f958e7f9d90a03c591c0ff5e55177bb520dcceda3d23693ca9f30
3
+ size 61867091
model_9.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:56ff1e3333aaccd3c9ad4c5c6fdcebfc7281f10ca08c8c57b58a9877e9030e87
3
+ size 61867091
predictors_clip15/model_0.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31a64f2d884206e2d681ca4acff47f7fd2d4d16c0fdc231889e8ffa989f14558
3
+ size 61867091
predictors_clip15/model_1.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:20b4796d684383fa1b5d86a6093648f85d42bd2dfb6c18c655c4cdd419087344
3
+ size 61867091
predictors_clip15/model_10.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f472fff6848df4c84fce175b79d7c76c99d67ccc99c4f72f0825624a70b8acd
3
+ size 61867095
predictors_clip15/model_11.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b89d0e30713d2edf7ba1f36b5f9b74996c2c1c5bd70b85dec3d2b6274ad1edc7
3
+ size 61867095
predictors_clip15/model_12.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5afb0c46f0e7b780199e13fd773517acf7a94bb0739c2fdd36d113744fe13748
3
+ size 61867095
predictors_clip15/model_13.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7520b5e9317a82802c05a4c0eb31bad3268cf573b822985af1be6ac695c4f039
3
+ size 61867095
predictors_clip15/model_14.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3d712f51655b68eb0103235744d3f3570f3ed95d20625558a46a56581a6e3348
3
+ size 61867095
predictors_clip15/model_15.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afb3dacb3a29798b6c14a76bc25a3c1c51e6a2ccc6b2482629d082ae0b3291bb
3
+ size 61867095
predictors_clip15/model_16.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0526521ce6d16e8862f831a6da23f9727430f9261347d3592c21f1cda64ff424
3
+ size 61867095
predictors_clip15/model_17.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:84cd99447622c35be3699e2e5327b1f9312989886c965d42f3807bc8b14dd9f6
3
+ size 61867095
predictors_clip15/model_18.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c35290ec7288500911e9a0c8442c1c4f5e4347909beaad1aa4f4701c34452186
3
+ size 61867095
predictors_clip15/model_19.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a18a19f90281a4eb7ac9cb3627f762b0f3af32795a9f694dffce515564a8d7d
3
+ size 61867095
predictors_clip15/model_2.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3623a5d141aa65bf5363a4a643614d7d0d5b6ae133e4180387829c0b89e6cf6b
3
+ size 61867091
predictors_clip15/model_20.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e6e78a390bc8c9efbe7c85127b35925ddb9a575c6084f5b9fc5cc5bc24ca0337
3
+ size 61867095
predictors_clip15/model_21.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f5f031ff6195715c9901feae5be5cffb6f2e237bff8cdaaca7652e4e92618a9
3
+ size 61867095
predictors_clip15/model_22.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e2e94bebd3722418403af8b5f419dbe0ce09deaefe55d195e49e789739b80ea8
3
+ size 61867095