content.raw: Memphis: Advancing language model reasoning without relying on proprietary model outputs
content.type: text
content.value: Memphis: Advancing language model reasoning without relying on proprietary model outputs
content.type: new_line
content.type: new_line
content.raw: Memphis is a series of models which advance human-data models, offering good performance without relying on proprietary model outputs (e.g. GPT-generated datasets). I've developed a new iterative finetuning procedure to improve the reasoning ability of these models beyond what is possible using only SFT on the same data.
content.type: text
content.value: Memphis is a series of models which advance human-data models, offering good performance without relying on proprietary model outputs (e.g. GPT-generated datasets). I've developed a new iterative finetuning procedure to improve the reasoning ability of these models beyond what is possible using only SFT on the same data.
content.type: new_line
content.type: new_line
content.raw: Currently, I've released two models: Memphis-CoT-3B, and Memphis-scribe-3B.
content.type: text
content.value: Currently, I've released two models: Memphis-CoT-3B, and Memphis-scribe-3B.
content.type: new_line
content.type: new_line
content.raw: To create these models, I've created new datasets:
content.type: text
content.value: To create these models, I've created new datasets:
content.type: new_line
content.raw: - 
content.type: text
content.value: - 
content.raw: https://huggingface.co/datasets/euclaise/reddit-instruct
content.id: euclaise/reddit-instruct
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/euclaise/reddit-instruct
content.raw:  : A dataset of instruction/QA-like data scraped from Reddit. A curated version, filtered using Lilac and neural embedding models, is available at 
content.type: text
content.value:  : A dataset of instruction/QA-like data scraped from Reddit. A curated version, filtered using Lilac and neural embedding models, is available at 
content.raw: https://huggingface.co/datasets/euclaise/reddit-instruct-curated
content.id: euclaise/reddit-instruct-curated
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/euclaise/reddit-instruct-curated
content.type: new_line
content.raw: - 
content.type: text
content.value: - 
content.raw: https://huggingface.co/datasets/euclaise/TinyCoT
content.id: euclaise/TinyCoT
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/euclaise/TinyCoT
content.raw:  : TinyCoT is a mtea-dataset that aggregates a variety of different human-sourced reasoning data. It is a curated version of my previous MegaCoT dataset 
content.type: text
content.value:  : TinyCoT is a mtea-dataset that aggregates a variety of different human-sourced reasoning data. It is a curated version of my previous MegaCoT dataset 
content.raw: https://huggingface.co/datasets/euclaise/MegaCoT
content.id: euclaise/MegaCoT
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/euclaise/MegaCoT
content.raw: , which contains 629k responses which get cut down to 28k for TinyCoT.  There's also an intermediate version 
content.type: text
content.value: , which contains 629k responses which get cut down to 28k for TinyCoT.  There's also an intermediate version 
content.raw: https://huggingface.co/datasets/euclaise/MiniCoT
content.id: euclaise/MiniCoT
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/euclaise/MiniCoT
content.raw: , which has 129k responses.
content.type: text
content.value: , which has 129k responses.
content.type: new_line
content.type: new_line
content.raw: Memphis-CoT is trained on reddit-instruct, a filtered version of oasst2 
content.type: text
content.value: Memphis-CoT is trained on reddit-instruct, a filtered version of oasst2 
content.raw: https://huggingface.co/datasets/sablo/oasst2_curated
content.id: sablo/oasst2_curated
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/sablo/oasst2_curated
content.raw: , and TinyCoT. Multiple iterations were performed on TinyCoT, while reddit-instruct and oasst2 were only used for the initial model.
content.type: text
content.value: , and TinyCoT. Multiple iterations were performed on TinyCoT, while reddit-instruct and oasst2 were only used for the initial model.
content.type: new_line
content.type: new_line
content.raw: Memphis-scribe further finetunes Memphis-CoT on more creative tasks. It was finetuned from Memphis-CoT on 18 different datasets, including datasets like 
content.type: text
content.value: Memphis-scribe further finetunes Memphis-CoT on more creative tasks. It was finetuned from Memphis-CoT on 18 different datasets, including datasets like 
content.raw: https://huggingface.co/datasets/euclaise/WritingPrompts_curated
content.id: euclaise/WritingPrompts_curated
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/euclaise/WritingPrompts_curated
content.raw: , 
content.type: text
content.value: , 
content.raw: https://huggingface.co/datasets/lemonilia/LimaRP
content.id: lemonilia/LimaRP
content.type: dataset
content.type: resource
content.url: https://huggingface.co/datasets/lemonilia/LimaRP
content.raw: , and more.
content.type: text
content.value: , and more.
content.type: new_line
content.type: new_line
content.raw: To prevent catastrophic forgetting, I used weight averaging between iterations.
content.type: text
content.value: To prevent catastrophic forgetting, I used weight averaging between iterations.
content.type: new_line
content.type: new_line
content.raw: - 
content.type: text
content.value: - 
content.raw: https://huggingface.co/euclaise/Memphis-CoT-3B
content.id: euclaise/Memphis-CoT-3B
content.type: model
content.type: resource
content.url: https://huggingface.co/euclaise/Memphis-CoT-3B
content.type: new_line
content.raw: - 
content.type: text
content.value: - 
content.raw: https://huggingface.co/euclaise/Memphis-scribe-3B
content.id: euclaise/Memphis-scribe-3B
content.type: model
content.type: resource
content.url: https://huggingface.co/euclaise/Memphis-scribe-3B
rawContent: Memphis: Advancing language model reasoning without relying on proprietary model outputs
  
  Memphis is a series of models which advance human-data models, offering good performance without relying on proprietary model outputs (e.g. GPT-generated datasets). I've developed a new iterative finetuning procedure to improve the reasoning ability of these models beyond what is possible using only SFT on the same data.
  
  Currently, I've released two models: Memphis-CoT-3B, and Memphis-scribe-3B.
  
  To create these models, I've created new datasets:
  - https://huggingface.co/datasets/euclaise/reddit-instruct : A dataset of instruction/QA-like data scraped from Reddit. A curated version, filtered using Lilac and neural embedding models, is available at https://huggingface.co/datasets/euclaise/reddit-instruct-curated
  - https://huggingface.co/datasets/euclaise/TinyCoT : TinyCoT is a mtea-dataset that aggregates a variety of different human-sourced reasoning data. It is a curated version of my previous MegaCoT dataset https://huggingface.co/datasets/euclaise/MegaCoT, which contains 629k responses which get cut down to 28k for TinyCoT.  There's also an intermediate version https://huggingface.co/datasets/euclaise/MiniCoT, which has 129k responses.
  
  Memphis-CoT is trained on reddit-instruct, a filtered version of oasst2 https://huggingface.co/datasets/sablo/oasst2_curated, and TinyCoT. Multiple iterations were performed on TinyCoT, while reddit-instruct and oasst2 were only used for the initial model.
  
  Memphis-scribe further finetunes Memphis-CoT on more creative tasks. It was finetuned from Memphis-CoT on 18 different datasets, including datasets like https://huggingface.co/datasets/euclaise/WritingPrompts_curated, https://huggingface.co/datasets/lemonilia/LimaRP, and more.
  
  To prevent catastrophic forgetting, I used weight averaging between iterations.
  
  - https://huggingface.co/euclaise/Memphis-CoT-3B
  - https://huggingface.co/euclaise/Memphis-scribe-3B
reactions.reaction: ❤️
reactions.users: osanseviero lbourdois victor samusenps xsa-dev merve ABIN1012 d0rj alielfilali01 reciprocate HailJebus qqqzzzyyy
commentators._id: 64137e2150358a805203cbac
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/64137e2150358a805203cbac/w9RQx8Q07UvgFyIZ3ce_k.jpeg
commentators.fullname: Jade
commentators.name: euclaise
commentators.type: user
commentators._id: 626237d9bbcbd1c34f1bb231
commentators.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/626237d9bbcbd1c34f1bb231/EJrOjvAL-68qMCYdnvOrq.png
commentators.fullname: Ali El Filali
commentators.name: alielfilali01
commentators.type: user