Vui Seng Chua commited on
Commit
a555ead
·
1 Parent(s): 9e57370

update readme

Browse files
Files changed (1) hide show
  1. README.md +2 -4
README.md CHANGED
@@ -2,6 +2,7 @@ This repo contains sparsity report for each of the pruned model in the table bel
2
 
3
  The report (csv) shows layer-wise sparsity, sparsity by tile of 128x16, sparsity by col and row global to its layers.
4
 
 
5
 
6
  Pruning ```meta-llama/Meta-Llama-3.1-8B``` with Wanda
7
  | Weight Target Sparsity | Perplexity (lower is better) |
@@ -15,10 +16,7 @@ Pruning ```meta-llama/Meta-Llama-3.1-8B``` with Wanda
15
  | 60 | 20.2265 |
16
  | 70 | 103.5209 |
17
 
18
- ![Perplexity over Sparsity](./perplexity_vs_sparsity.png)
19
-
20
-
21
- > For a more granular sparsity report within a given tile, pls continue below
22
 
23
  # Install
24
  ```pip install torch ipython pandas```
 
2
 
3
  The report (csv) shows layer-wise sparsity, sparsity by tile of 128x16, sparsity by col and row global to its layers.
4
 
5
+ ![Perplexity over Sparsity](./perplexity_vs_sparsity.png)
6
 
7
  Pruning ```meta-llama/Meta-Llama-3.1-8B``` with Wanda
8
  | Weight Target Sparsity | Perplexity (lower is better) |
 
16
  | 60 | 20.2265 |
17
  | 70 | 103.5209 |
18
 
19
+ > For a more granular sparsity report within a given tile, pls continue below.
 
 
 
20
 
21
  # Install
22
  ```pip install torch ipython pandas```