Memphis: Advancing language model reasoning without relying on proprietary model outputs
text
Memphis: Advancing language model reasoning without relying on proprietary model outputs
new_line
new_line
Memphis is a series of models which advance human-data models, offering good performance without relying on proprietary model outputs (e.g. GPT-generated datasets). I've developed a new iterative finetuning procedure to improve the reasoning ability of these models beyond what is possible using only SFT on the same data.
text
Memphis is a series of models which advance human-data models, offering good performance without relying on proprietary model outputs (e.g. GPT-generated datasets). I've developed a new iterative finetuning procedure to improve the reasoning ability of these models beyond what is possible using only SFT on the same data.
new_line
new_line
Currently, I've released two models: Memphis-CoT-3B, and Memphis-scribe-3B.
text
Currently, I've released two models: Memphis-CoT-3B, and Memphis-scribe-3B.
new_line
new_line
To create these models, I've created new datasets:
text
To create these models, I've created new datasets:
new_line
- 
text
- 
https://huggingface.co/datasets/euclaise/reddit-instruct
euclaise/reddit-instruct
dataset
resource
https://huggingface.co/datasets/euclaise/reddit-instruct
 : A dataset of instruction/QA-like data scraped from Reddit. A curated version, filtered using Lilac and neural embedding models, is available at 
text
 : A dataset of instruction/QA-like data scraped from Reddit. A curated version, filtered using Lilac and neural embedding models, is available at 
https://huggingface.co/datasets/euclaise/reddit-instruct-curated
euclaise/reddit-instruct-curated
dataset
resource
https://huggingface.co/datasets/euclaise/reddit-instruct-curated
new_line
- 
text
- 
https://huggingface.co/datasets/euclaise/TinyCoT
euclaise/TinyCoT
dataset
resource
https://huggingface.co/datasets/euclaise/TinyCoT
 : TinyCoT is a mtea-dataset that aggregates a variety of different human-sourced reasoning data. It is a curated version of my previous MegaCoT dataset 
text
 : TinyCoT is a mtea-dataset that aggregates a variety of different human-sourced reasoning data. It is a curated version of my previous MegaCoT dataset 
https://huggingface.co/datasets/euclaise/MegaCoT
euclaise/MegaCoT
dataset
resource
https://huggingface.co/datasets/euclaise/MegaCoT
, which contains 629k responses which get cut down to 28k for TinyCoT.  There's also an intermediate version 
text
, which contains 629k responses which get cut down to 28k for TinyCoT.  There's also an intermediate version 
https://huggingface.co/datasets/euclaise/MiniCoT
euclaise/MiniCoT
dataset
resource
https://huggingface.co/datasets/euclaise/MiniCoT
, which has 129k responses.
text
, which has 129k responses.
new_line
new_line
Memphis-CoT is trained on reddit-instruct, a filtered version of oasst2 
text
Memphis-CoT is trained on reddit-instruct, a filtered version of oasst2 
https://huggingface.co/datasets/sablo/oasst2_curated
sablo/oasst2_curated
dataset
resource
https://huggingface.co/datasets/sablo/oasst2_curated
, and TinyCoT. Multiple iterations were performed on TinyCoT, while reddit-instruct and oasst2 were only used for the initial model.
text
, and TinyCoT. Multiple iterations were performed on TinyCoT, while reddit-instruct and oasst2 were only used for the initial model.
new_line
new_line
Memphis-scribe further finetunes Memphis-CoT on more creative tasks. It was finetuned from Memphis-CoT on 18 different datasets, including datasets like 
text
Memphis-scribe further finetunes Memphis-CoT on more creative tasks. It was finetuned from Memphis-CoT on 18 different datasets, including datasets like 
https://huggingface.co/datasets/euclaise/WritingPrompts_curated
euclaise/WritingPrompts_curated
dataset
resource
https://huggingface.co/datasets/euclaise/WritingPrompts_curated
, 
text
, 
https://huggingface.co/datasets/lemonilia/LimaRP
lemonilia/LimaRP
dataset
resource
https://huggingface.co/datasets/lemonilia/LimaRP
, and more.
text
, and more.
new_line
new_line
To prevent catastrophic forgetting, I used weight averaging between iterations.
text
To prevent catastrophic forgetting, I used weight averaging between iterations.
new_line
new_line
- 
text
- 
https://huggingface.co/euclaise/Memphis-CoT-3B
euclaise/Memphis-CoT-3B
model
resource
https://huggingface.co/euclaise/Memphis-CoT-3B
new_line
- 
text
- 
https://huggingface.co/euclaise/Memphis-scribe-3B
euclaise/Memphis-scribe-3B
model
resource
https://huggingface.co/euclaise/Memphis-scribe-3B
Memphis: Advancing language model reasoning without relying on proprietary model outputs

Memphis is a series of models which advance human-data models, offering good performance without relying on proprietary model outputs (e.g. GPT-generated datasets). I've developed a new iterative finetuning procedure to improve the reasoning ability of these models beyond what is possible using only SFT on the same data.

Currently, I've released two models: Memphis-CoT-3B, and Memphis-scribe-3B.

To create these models, I've created new datasets:
- https://huggingface.co/datasets/euclaise/reddit-instruct : A dataset of instruction/QA-like data scraped from Reddit. A curated version, filtered using Lilac and neural embedding models, is available at https://huggingface.co/datasets/euclaise/reddit-instruct-curated
- https://huggingface.co/datasets/euclaise/TinyCoT : TinyCoT is a mtea-dataset that aggregates a variety of different human-sourced reasoning data. It is a curated version of my previous MegaCoT dataset https://huggingface.co/datasets/euclaise/MegaCoT, which contains 629k responses which get cut down to 28k for TinyCoT.  There's also an intermediate version https://huggingface.co/datasets/euclaise/MiniCoT, which has 129k responses.

Memphis-CoT is trained on reddit-instruct, a filtered version of oasst2 https://huggingface.co/datasets/sablo/oasst2_curated, and TinyCoT. Multiple iterations were performed on TinyCoT, while reddit-instruct and oasst2 were only used for the initial model.

Memphis-scribe further finetunes Memphis-CoT on more creative tasks. It was finetuned from Memphis-CoT on 18 different datasets, including datasets like https://huggingface.co/datasets/euclaise/WritingPrompts_curated, https://huggingface.co/datasets/lemonilia/LimaRP, and more.

To prevent catastrophic forgetting, I used weight averaging between iterations.

- https://huggingface.co/euclaise/Memphis-CoT-3B
- https://huggingface.co/euclaise/Memphis-scribe-3B
❤️
osanseviero lbourdois victor samusenps xsa-dev merve ABIN1012 d0rj alielfilali01 reciprocate HailJebus qqqzzzyyy
626237d9bbcbd1c34f1bb231
https://cdn-avatars.huggingface.co/v1/production/uploads/626237d9bbcbd1c34f1bb231/EJrOjvAL-68qMCYdnvOrq.png
Ali El Filali
alielfilali01
user
64137e2150358a805203cbac
https://cdn-avatars.huggingface.co/v1/production/uploads/64137e2150358a805203cbac/w9RQx8Q07UvgFyIZ3ce_k.jpeg
Jade
euclaise
user