Pinkstack commited on
Commit
cea2a73
·
verified ·
1 Parent(s): dcd846a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -25,7 +25,7 @@ Advanced, high-quality and **lite** reasoning for a tiny size that you can run o
25
 
26
  At original quality, it runs at ~400 tokens/second on a single H100 Nvidia GPU from Friendli.
27
 
28
- Trained similarly to Deepseek R1, we used Smollm2 as a base model, then we've SFT fine tuned on reasoning using our own private superthoughts instruct dataset & modified the tokenizer slightly, after the SFT fine tuning we used GRPO to further amplify it's mathematics & problem solving abilities.
29
 
30
  # Format
31
  ```
 
25
 
26
  At original quality, it runs at ~400 tokens/second on a single H100 Nvidia GPU from Friendli.
27
 
28
+ Trained similarly to Deepseek R1, we used Smollm2 as a base model, then we've SFT fine tuned on reasoning using our own private superthoughts instruct dataset, which includes a mix of code, website generation, day-to-day questions and answers, math. And then we modified the tokenizer slightly, after the SFT fine tuning we used GRPO to further amplify it's mathematics & problem solving abilities.
29
 
30
  # Format
31
  ```