xzuyn commited on
Commit
c2317e8
·
verified ·
1 Parent(s): db00664

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +12 -0
README.md CHANGED
@@ -10,6 +10,18 @@ extra_gated_button_content: Acknowledge license
10
  base_model: google/gemma-3-4b-pt
11
  ---
12
 
 
 
 
 
 
 
 
 
 
 
 
 
13
  # Gemma 3 model card
14
 
15
  **Model Page**: [Gemma](https://ai.google.dev/gemma/docs/core)
 
10
  base_model: google/gemma-3-4b-pt
11
  ---
12
 
13
+ # BNB Quantization Config
14
+
15
+ ```py
16
+ BitsAndBytesConfig(
17
+ load_in_4bit=True,
18
+ bnb_4bit_quant_type="nf4",
19
+ bnb_4bit_use_double_quant=True,
20
+ bnb_4bit_compute_dtype=torch.bfloat16,
21
+ bnb_4bit_quant_storage=torch.bfloat16,
22
+ )
23
+ ```
24
+
25
  # Gemma 3 model card
26
 
27
  **Model Page**: [Gemma](https://ai.google.dev/gemma/docs/core)