Vui Seng Chua
commited on
Commit
·
c1cd4c9
1
Parent(s):
37aba61
update readme
Browse files
README.md
CHANGED
@@ -21,7 +21,10 @@ The report (csv) shows layer-wise sparsity, sparsity by tile of 128x16, sparsity
|
|
21 |
|
22 |
# Interative look up a specific tile of a layer
|
23 |
```bash
|
24 |
-
|
|
|
|
|
|
|
25 |
```
|
26 |
Expected outcome in as follows, it will be in ipython console with the needed functionality loaded.
|
27 |
```
|
@@ -153,3 +156,6 @@ In [5]: h.get_sparsity_of_tile(10, (30, 245))
|
|
153 |
0.6250 : row_max
|
154 |
```
|
155 |
|
|
|
|
|
|
|
|
21 |
|
22 |
# Interative look up a specific tile of a layer
|
23 |
```bash
|
24 |
+
# pls make sure git lfs is installed at your end
|
25 |
+
git clone https://huggingface.co/vuiseng9/24-0830-wanda-llama3.1-8B
|
26 |
+
cd 24-0830-wanda-llama3.1-8B
|
27 |
+
./interactive_sparsity.sh
|
28 |
```
|
29 |
Expected outcome in as follows, it will be in ipython console with the needed functionality loaded.
|
30 |
```
|
|
|
156 |
0.6250 : row_max
|
157 |
```
|
158 |
|
159 |
+
### Internal notes
|
160 |
+
see patch wanda branch [here](https://github.com/vuiseng9/wanda/tree/240823-sparse-weight-analysis). see the raw!
|
161 |
+
|