Spaces:

nengrenjie83
/

ELYZA-japanese-Llama-2-7b

Runtime error

nengrenjie83 commited on Nov 3, 2023

Commit

3e89706

1 Parent(s): fa30f7e

Upload model.py

Files changed (1) hide show

model.py CHANGED Viewed

@@ -13,7 +13,7 @@ if torch.cuda.is_available():
         device_map='auto',
         use_auth_token=True,
         use_cache=True,
-    )
 else:
     model = None
 tokenizer = AutoTokenizer.from_pretrained(model_id)

         device_map='auto',
         use_auth_token=True,
         use_cache=True,
+    ).float()
 else:
     model = None
 tokenizer = AutoTokenizer.from_pretrained(model_id)