Safetensors
qwen2
yixinsong commited on
Commit
80d629c
·
1 Parent(s): 5efe432
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -54,8 +54,8 @@ You should replace original modeling_qwen FFN implementation code to dReLU first
54
  ```python
55
  from transformers import AutoModelForCausalLM, AutoTokenizer
56
 
57
- model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2-7B-ReLU")
58
- tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2-7B-ReLU")
59
 
60
  prompt = "Hello"
61
  inputs = tokenizer(prompt, return_tensors="pt")
 
54
  ```python
55
  from transformers import AutoModelForCausalLM, AutoTokenizer
56
 
57
+ model = AutoModelForCausalLM.from_pretrained("PowerInfer/SparseQwen2-7B")
58
+ tokenizer = AutoTokenizer.from_pretrained("PowerInfer/SparseQwen2-7B")
59
 
60
  prompt = "Hello"
61
  inputs = tokenizer(prompt, return_tensors="pt")