Update README.md
Browse files
README.md
CHANGED
@@ -10,6 +10,18 @@ extra_gated_button_content: Acknowledge license
|
|
10 |
base_model: google/gemma-3-4b-pt
|
11 |
---
|
12 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
13 |
# Gemma 3 model card
|
14 |
|
15 |
**Model Page**: [Gemma](https://ai.google.dev/gemma/docs/core)
|
|
|
10 |
base_model: google/gemma-3-4b-pt
|
11 |
---
|
12 |
|
13 |
+
# BNB Quantization Config
|
14 |
+
|
15 |
+
```py
|
16 |
+
BitsAndBytesConfig(
|
17 |
+
load_in_4bit=True,
|
18 |
+
bnb_4bit_quant_type="nf4",
|
19 |
+
bnb_4bit_use_double_quant=True,
|
20 |
+
bnb_4bit_compute_dtype=torch.bfloat16,
|
21 |
+
bnb_4bit_quant_storage=torch.bfloat16,
|
22 |
+
)
|
23 |
+
```
|
24 |
+
|
25 |
# Gemma 3 model card
|
26 |
|
27 |
**Model Page**: [Gemma](https://ai.google.dev/gemma/docs/core)
|