avocardio commited on
Commit
eaac2a7
·
1 Parent(s): 9f2869f

Changes in the usage

Browse files
Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -11,11 +11,11 @@ tags:
11
  - transformers
12
  ---
13
 
14
- # Zicklein: german
15
 
16
- ## Usage
17
 
18
- Check the Github repo with code: https://github.com/22-hours/cabrita
19
 
20
  ```python
21
  from peft import PeftModel
@@ -24,8 +24,9 @@ from transformers import LLaMATokenizer, LLaMAForCausalLM, GenerationConfig
24
  tokenizer = LLaMATokenizer.from_pretrained("decapoda-research/llama-7b-hf")
25
  model = LLaMAForCausalLM.from_pretrained(
26
  "decapoda-research/llama-7b-hf",
27
- load_in_8bit=True,
 
28
  device_map="auto",
29
  )
30
- model = PeftModel.from_pretrained(model, "22h/cabrita-lora-v0-1")
31
  ```
 
11
  - transformers
12
  ---
13
 
14
+ # Zicklein: german 🇩🇪 finetuned instruction LLaMA
15
 
16
+ Visit the Github for more information: https://github.com/avocardio/zicklein
17
 
18
+ ## Usage
19
 
20
  ```python
21
  from peft import PeftModel
 
24
  tokenizer = LLaMATokenizer.from_pretrained("decapoda-research/llama-7b-hf")
25
  model = LLaMAForCausalLM.from_pretrained(
26
  "decapoda-research/llama-7b-hf",
27
+ load_in_8bit=False,
28
+ torch_dtype=torch.float16,
29
  device_map="auto",
30
  )
31
+ model = PeftModel.from_pretrained(model, "avocardio/alpaca-lora-7b-german-base-51k")
32
  ```