Vui Seng Chua
commited on
Commit
·
a555ead
1
Parent(s):
9e57370
update readme
Browse files
README.md
CHANGED
@@ -2,6 +2,7 @@ This repo contains sparsity report for each of the pruned model in the table bel
|
|
2 |
|
3 |
The report (csv) shows layer-wise sparsity, sparsity by tile of 128x16, sparsity by col and row global to its layers.
|
4 |
|
|
|
5 |
|
6 |
Pruning ```meta-llama/Meta-Llama-3.1-8B``` with Wanda
|
7 |
| Weight Target Sparsity | Perplexity (lower is better) |
|
@@ -15,10 +16,7 @@ Pruning ```meta-llama/Meta-Llama-3.1-8B``` with Wanda
|
|
15 |
| 60 | 20.2265 |
|
16 |
| 70 | 103.5209 |
|
17 |
|
18 |
-
|
19 |
-
|
20 |
-
|
21 |
-
> For a more granular sparsity report within a given tile, pls continue below
|
22 |
|
23 |
# Install
|
24 |
```pip install torch ipython pandas```
|
|
|
2 |
|
3 |
The report (csv) shows layer-wise sparsity, sparsity by tile of 128x16, sparsity by col and row global to its layers.
|
4 |
|
5 |
+

|
6 |
|
7 |
Pruning ```meta-llama/Meta-Llama-3.1-8B``` with Wanda
|
8 |
| Weight Target Sparsity | Perplexity (lower is better) |
|
|
|
16 |
| 60 | 20.2265 |
|
17 |
| 70 | 103.5209 |
|
18 |
|
19 |
+
> For a more granular sparsity report within a given tile, pls continue below.
|
|
|
|
|
|
|
20 |
|
21 |
# Install
|
22 |
```pip install torch ipython pandas```
|