LLM-SocialMedia
/

Qwen3-8B-Korean-Sentiment

Model card Files Files and versions

suil0109 commited on Jun 1

Commit

acd1f1d

·

verified ·

1 Parent(s): 3bd6528

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -25,8 +25,9 @@ import torch
 # Load the model and tokenizer
 model = AutoPeftModelForCausalLM.from_pretrained(
     "LLM-SocialMedia/Qwen3-8B-Korean-Sentiment",
     device_map="auto",
-    offload_folder="/offload",
     offload_state_dict=True,
     torch_dtype=torch.bfloat16
 )

 # Load the model and tokenizer
 model = AutoPeftModelForCausalLM.from_pretrained(
     "LLM-SocialMedia/Qwen3-8B-Korean-Sentiment",
+    # if GPU memory is insufficient
     device_map="auto",
+    offload_folder="/offload",
     offload_state_dict=True,
     torch_dtype=torch.bfloat16
 )