Hugging Face's logo

Spaces:
suayptalha
/
Chat-with-Bitnet-b1.58-2B-4T
Running on Zero

App Files Community
suayptalha commited on
Commit
c3684ef
·
verified ·
1 Parent(s): 1eae2f3

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -19,7 +19,7 @@ tokenizer = AutoTokenizer.from_pretrained(model_id)
19
  model = AutoModelForCausalLM.from_pretrained(
20
  model_id,
21
  torch_dtype=torch.bfloat16,
22
- device_map="cuda"
23
  )
24
 
25
  @spaces.GPU
 
19
  model = AutoModelForCausalLM.from_pretrained(
20
  model_id,
21
  torch_dtype=torch.bfloat16,
22
+ device_map="auto"
23
  )
24
 
25
  @spaces.GPU