AI & ML interests

Making funny and goofy LM's and AI's

Recent Activity

FlameF0Xย  updated a model about 5 hours ago
GoofyLM/N2.1-Eye-1.3B
FlameF0Xย  updated a model about 5 hours ago
GoofyLM/N2.2-Eye-1.3B
FlameF0Xย  updated a model about 5 hours ago
GoofyLM/N2.3-Eye-1.3B-DEV
View all activity

FlameF0Xย 
posted an update 2 days ago
view post
Post
191
the training for SnowflakeCore-G1-1B and 7B would be retaken because now I implemented DeepSpeed and management to use two gpus.
FlameF0Xย 
posted an update 9 days ago
view post
Post
250
The development of SnowflakeCore-G1-7B-MoE it getting delay. In the mean time I am working on SnowflakeCore-G1-1B-MoE witch would be a pre-train chatbot.
  • 1 reply
ยท
FlameF0Xย 
posted an update 13 days ago
view post
Post
2938
The development of SnowflakeCore-G1-7B-MoE. I can't say when it would be publish yet because it's big and it requires a lot of computational power.
  • 1 reply
ยท
FlameF0Xย 
posted an update 18 days ago
FlameF0Xย 
posted an update 20 days ago
view post
Post
308
Hello! Important announcement, I will rename SnowflakeCore-G1-Medium to SnowflakeCore-G1-Tiny2 because it's going to have the same parameters as the Tiny version, but this one is trained on more data.
  • 1 reply
ยท
FlameF0Xย 
posted an update 22 days ago
view post
Post
744
Currently working on SnowflakeCore-G1-Medium. [Updated loss cruve]
  • 3 replies
ยท
FlameF0Xย 
posted an update 25 days ago
view post
Post
154
Hello there world! I am happy to announce that you now can fine-tune FlameF0X/SnowflakeCore-G1-Tiny , the code for that is in the model card.

I aslo lost the training log ๐Ÿ˜
FlameF0Xย 
posted an update 29 days ago
view post
Post
1203
Hello! I am sad to say but fine-tuning FlameF0X/SnowflakeCore-G1-Tiny is complicated and the instruct version would need to wait some time.
  • 2 replies
ยท