Ppoyaa commited on
Commit
420e534
1 Parent(s): f8797ee

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -0
README.md CHANGED
@@ -1,2 +1,54 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ license: apache-2.0
3
+ ---
4
+ # LuminRP-7B-128k-v0.5
5
+ LuminRP-13B-128k-v0.5 is the 13B parameter version of the v0.5, LuminRP-7B model. Which specializes in roleplaying by merging a couple models that excels in it.
6
+ ***
7
+ ## SillyTavern
8
+ **Template**: Alpaca, ChatML, and Mistral should be okay.
9
+
10
+ **Instruct Mode**: On
11
+ ***
12
+ ## 💻 Usage
13
+
14
+ ```python
15
+ !pip install -qU transformers accelerate
16
+
17
+ from transformers import AutoTokenizer
18
+ import transformers
19
+ import torch
20
+
21
+ model = "Ppoyaa/LuminRP-13B-128k-v0.5"
22
+ messages = [{"role": "user", "content": "What is a large language model?"}]
23
+
24
+ tokenizer = AutoTokenizer.from_pretrained(model)
25
+ prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
26
+ pipeline = transformers.pipeline(
27
+ "text-generation",
28
+ model=model,
29
+ torch_dtype=torch.float16,
30
+ device_map="auto",
31
+ )
32
+
33
+ outputs = pipeline(prompt, max_new_tokens=256, do_sample=True, temperature=0.7, top_k=50, top_p=0.95)
34
+ print(outputs[0]["generated_text"])
35
+ ```
36
+ ***
37
+ Merge Details Below:
38
 
39
+ <details><summary>See Merge Config</summary>
40
+
41
+ ```
42
+ ChaoticNeutrals/BuRP_7B
43
+ Endevor/InfinityRP-v1-7B
44
+ Nitral-AI/Kunocchini-7b-128k-test
45
+ core-3/kuno-royale-v2-7b
46
+ KatyTheCutie/LemonadeRP-4.5.3
47
+ grimjim/kukulemon-7B
48
+ MaziyarPanahi/Calme-7B-Instruct-v0.9
49
+ icefog72/WestIceLemonTeaRP-32k-7b
50
+ crestf411/daybreak-kunoichi-2dpo-7b
51
+ Undi95/Mistral-RP-0.1-7B
52
+ ```
53
+ </details><br>
54
+ ---