Hugging Face's logo
Jaward Sesay's picture
1 31 32

Jaward Sesay

Jaward
jackyai2024's profile picture lunarflu's profile picture viluan1997's profile picture
·
https://github.com/Jaykef

AI & ML interests

I like to train large deep neural nets too 🧠🤖💥 | First Paper (AutoAgents: A Framework for Automatic Agent Generation) Accepted @ IJCAI 2024 | Role Model Karpathy

Recent Activity

posted an update 1 day ago
Implements from first-principle recently proposed dynamic tanh as alternative to layernorm. Specifically, we trained a nanoGPT (0.8 M params) on tiny shakespeare with conventional layernorm, RMSNorm and dynamic tanh, then compared performances. Observed performance seems to match or is stable for α = 0.5~ 1.5, might outperform if trained longer. Code: https://github.com/Jaykef/ai-algorithms/blob/main/Dynamic_Tanh.ipynb Background music by 周子珺
reacted to clem's post with 🚀 3 days ago
Before 2020, most of the AI field was open and collaborative. For me, that was the key factor that accelerated scientific progress and made the impossible possible—just look at the “T” in ChatGPT, which comes from the Transformer architecture openly shared by Google. Then came the myth that AI was too dangerous to share, and companies started optimizing for short-term revenue. That led many major AI labs and researchers to stop sharing and collaborating. With OAI and sama now saying they're willing to share open weights again, we have a real chance to return to a golden age of AI progress and democratization—powered by openness and collaboration, in the US and around the world. This is incredibly exciting. Let’s go, open science and open-source AI!
posted an update 11 days ago
Implemented a custom multimodal GRPO trainer that scales for Small VLMs, supports cpu and gpu with vllm + flash attention. Using SmolVLM-256M-Instruct reference & reward model, wasn’t trained for long btw, still got some sparks of “thinking”:) Code: https://github.com/Jaykef/ai-algorithms/blob/main/grpo_multimodal_reasoner.ipynb
View all activity

Organizations

MLX Community's profile picture

Jaward's activity

liked a model 14 days ago
liked a model 21 days ago
liked a model about 1 month ago
liked a dataset about 1 month ago
liked 2 models about 2 months ago
liked a model 2 months ago
liked a Space 2 months ago
liked 4 models 3 months ago
liked 2 datasets 4 months ago
liked a Space 5 months ago
liked a model 5 months ago
liked a model 6 months ago
liked 2 models 7 months ago
liked a Space 8 months ago