Gryphe commited on
Commit
0098160
1 Parent(s): 27b830f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -5,7 +5,7 @@ language:
5
  ---
6
  An experiment with gradient merges using [the following script](https://github.com/TehVenomm/LM_Transformers_BlockMerge), with [Chronos](https://huggingface.co/elinas/chronos-13b) as its primary model, augmented by [Hermes](https://huggingface.co/NousResearch/Nous-Hermes-13b) and [Wizard-Vicuna Uncensored](https://huggingface.co/TheBloke/Wizard-Vicuna-13B-Uncensored-HF).
7
 
8
- Chronos is a wonderful model, though doesn't feel very smart. Hermes and WizardLM have been merged gradually, primarily in the higher layers (10+) in an attempt to rectify some of this behaviour.
9
  I'd say the end product is about 60% Chronos, with 20% Hermes and 20% Wizard added in gradually increasing amounts. The result feels surprisingly robust, though I'll let you be the final judge of that!
10
 
11
  This model primarily uses Alpaca formatting, so for optimal model performance, use:
@@ -15,7 +15,7 @@ Your instruction or question here.
15
  ### Response:
16
  ```
17
 
18
- For chat conversations, I suggest the following template instead:
19
  ```
20
  You are <AI NAME>, a friendly and supportive AI language model. We discuss all subjects freely and without bias or restrictions.
21
  I am <YOUR NAME>, the user interacting with you through a chat conversation. Start with greeting me.
 
5
  ---
6
  An experiment with gradient merges using [the following script](https://github.com/TehVenomm/LM_Transformers_BlockMerge), with [Chronos](https://huggingface.co/elinas/chronos-13b) as its primary model, augmented by [Hermes](https://huggingface.co/NousResearch/Nous-Hermes-13b) and [Wizard-Vicuna Uncensored](https://huggingface.co/TheBloke/Wizard-Vicuna-13B-Uncensored-HF).
7
 
8
+ Chronos is a wonderfully verbose model, though it definitely lacks in the logic department. Hermes and WizardLM have been merged gradually, primarily in the higher layers (10+) in an attempt to rectify some of this behaviour.
9
  I'd say the end product is about 60% Chronos, with 20% Hermes and 20% Wizard added in gradually increasing amounts. The result feels surprisingly robust, though I'll let you be the final judge of that!
10
 
11
  This model primarily uses Alpaca formatting, so for optimal model performance, use:
 
15
  ### Response:
16
  ```
17
 
18
+ For chat/roleplay conversations, I suggest the following template instead:
19
  ```
20
  You are <AI NAME>, a friendly and supportive AI language model. We discuss all subjects freely and without bias or restrictions.
21
  I am <YOUR NAME>, the user interacting with you through a chat conversation. Start with greeting me.