Update README.md
Browse files
README.md
CHANGED
|
@@ -33,8 +33,10 @@ This repo contains GPTQ model files for [Llama-3-Taiwan-70B-Instruct](https://hu
|
|
| 33 |
- Bits : 4
|
| 34 |
- Group Size : 128
|
| 35 |
- Act Order : Yes
|
| 36 |
-
- Damp % : 0.
|
| 37 |
- Seq Len : 2048
|
| 38 |
- Size : 37.07 GB
|
| 39 |
|
|
|
|
|
|
|
| 40 |
|
|
|
|
| 33 |
- Bits : 4
|
| 34 |
- Group Size : 128
|
| 35 |
- Act Order : Yes
|
| 36 |
+
- Damp % : 0.1
|
| 37 |
- Seq Len : 2048
|
| 38 |
- Size : 37.07 GB
|
| 39 |
|
| 40 |
+
It tooks about 6.5 hrs to quantize on H100.
|
| 41 |
+
|
| 42 |
|