SmallDoge/SmallTalks
Viewer
•
Updated
•
4.48M
•
4.67k
•
9
AlbertS
LoserCheems
·
AI & ML interests
None yet
Recent Activity
liked
a dataset
30 days ago
SmallDoge/SmallTalks
upvoted
a
collection
about 2 months ago
🐕Small-Doges
Organizations
None yet
LoserCheems's activity
liked
a
dataset
30 days ago
reacted to
JingzeShi's
post with 🚀
30 days ago
Post
2601
@SmallDoge
SmallTalks(
SmallDoge/SmallTalks) is a synthetic dataset designed for supervised fine-tuning of language models. The dataset covers a variety of conversational content, including daily conversations, tool usage, Python programming, encyclopedia Q&A, exam problem-solving, logical reasoning, and more. Each task is provided in both English and Chinese versions.
upvoted
a
collection
about 2 months ago
liked
3
models
about 2 months ago
liked
a
dataset
3 months ago
reacted to
JingzeShi's
post with 🚀
3 months ago
Post
4784
We distill a more accurate and concise dataset from DeepSeek R1, and also provide a distillation pipeline code repository.🤗
Dataset: SmallDoge/SmallThoughts
Code: https://github.com/SmallDoges/small-thoughts
Dataset: SmallDoge/SmallThoughts
Code: https://github.com/SmallDoges/small-thoughts
liked
a
model
3 months ago
upvoted
a
collection
4 months ago
liked
2
models
4 months ago
reacted to
JingzeShi's
post with 👍🤯👀
4 months ago
Post
2081
Only a single RTX 4090 running model pre-training is really slow, even for small language models!!! (https://huggingface.co/collections/JingzeShi/doge-slm-677fd879f8c4fd0f43e05458)
- 2 replies
reacted to
JingzeShi's
post with 🔥
4 months ago
Post
1726
🤩warmup -> stable -> decay leanring rate scheduler:
😎use the Stable Phase CheckPoints to Continue Training the model on Any New Dataset without spikes of the training!!!
SmallDoge/Doge-20M-checkpoint
SmallDoge/Doge-60M-checkpoint
😎use the Stable Phase CheckPoints to Continue Training the model on Any New Dataset without spikes of the training!!!
SmallDoge/Doge-20M-checkpoint
SmallDoge/Doge-60M-checkpoint
-
-
- 4 replies
liked
4
models
4 months ago