avocardio commited on
Commit
756bd16
·
1 Parent(s): 182733e

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md CHANGED
@@ -1,5 +1,33 @@
1
  ---
2
  license: cc-by-nc-4.0
 
 
 
 
 
 
 
 
 
3
  ---
4
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  LLaMA link: https://docs.google.com/forms/d/e/1FAIpQLSfqNECQnMkycAp2jP4Z9TFX0cGR4uf7b_fBxjY_OjhJILlKGA/viewform
 
1
  ---
2
  license: cc-by-nc-4.0
3
+ language:
4
+ - de
5
+ tags:
6
+ - llama
7
+ - alpaca
8
+ - llm
9
+ - finetune
10
+ - german
11
+ - transformers
12
  ---
13
 
14
+ # Zicklein: german
15
+
16
+ ## Usage
17
+
18
+ Check the Github repo with code: https://github.com/22-hours/cabrita
19
+
20
+ ```python
21
+ from peft import PeftModel
22
+ from transformers import LLaMATokenizer, LLaMAForCausalLM, GenerationConfig
23
+
24
+ tokenizer = LLaMATokenizer.from_pretrained("decapoda-research/llama-7b-hf")
25
+ model = LLaMAForCausalLM.from_pretrained(
26
+ "decapoda-research/llama-7b-hf",
27
+ load_in_8bit=True,
28
+ device_map="auto",
29
+ )
30
+ model = PeftModel.from_pretrained(model, "22h/cabrita-lora-v0-1")
31
+ ```
32
+
33
  LLaMA link: https://docs.google.com/forms/d/e/1FAIpQLSfqNECQnMkycAp2jP4Z9TFX0cGR4uf7b_fBxjY_OjhJILlKGA/viewform