Spaces:

Dovakiins
/

qwerrwe

Build error

Nanobit commited on May 30, 2023

Commit

594e72b

1 Parent(s): 25eeeeb

Fix incorrect rebase

Files changed (1) hide show

src/axolotl/utils/models.py CHANGED Viewed

@@ -129,7 +129,6 @@ def load_model(
             llm_int8_threshold=6.0,
             llm_int8_has_fp16_weight=False,
             bnb_4bit_compute_dtype=torch_dtype,
-            bnb_4bit_compute_dtype=torch_dtype,
             bnb_4bit_use_double_quant=True,
             bnb_4bit_quant_type="nf4",
         )

             llm_int8_threshold=6.0,
             llm_int8_has_fp16_weight=False,
             bnb_4bit_compute_dtype=torch_dtype,
             bnb_4bit_use_double_quant=True,
             bnb_4bit_quant_type="nf4",
         )