jspr commited on
Commit
d74f9d1
1 Parent(s): 3b8bdcf

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -18,9 +18,9 @@ datasets:
18
 
19
  # Llama3 8B Wordcel
20
 
21
- Wordcel is a Llama3 fine-tune intended to be used as a mid-training checkpoint for more specific chat/RP/storywriting applications.
22
 
23
- It has been trained from Llama3 8B Base on a composite dataset that highlights reasoning, (uncensored) stories, classic literature, and assorted interpersonal intelligence tasks.
24
 
25
  Components of the composite dataset include [OpenHermes-2.5](https://huggingface.co/datasets/teknium/OpenHermes-2.5), and [Grimulkan](https://huggingface.co/grimulkan)'s [Theory of Mind](https://huggingface.co/datasets/grimulkan/theory-of-mind) and [Physical Reasoning](https://huggingface.co/datasets/grimulkan/physical-reasoning) datasets.
26
 
 
18
 
19
  # Llama3 8B Wordcel
20
 
21
+ Wordcel is a Llama3 fine-tune intended to be used as a mid-training checkpoint for more specific RP/storywriting/creative applications.
22
 
23
+ It has been trained from Llama3 8B Base on a composite dataset of ~100M tokens that highlights reasoning, (uncensored) stories, classic literature, and assorted interpersonal intelligence tasks.
24
 
25
  Components of the composite dataset include [OpenHermes-2.5](https://huggingface.co/datasets/teknium/OpenHermes-2.5), and [Grimulkan](https://huggingface.co/grimulkan)'s [Theory of Mind](https://huggingface.co/datasets/grimulkan/theory-of-mind) and [Physical Reasoning](https://huggingface.co/datasets/grimulkan/physical-reasoning) datasets.
26