Hugging Face's logo
Wei Wu's picture
3 3 50

Wei Wu

Wei-Wu
droussis's profile picture
·

AI & ML interests

None yet

Recent Activity

liked a model 3 days ago
jiulaikankan/Qwen2.5-14B-ReasonGenRM
commented on a paper about 1 month ago
Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergy
reacted to codelion's post with 🔥 about 1 month ago
🚀 Just published: "OpenEvolve: Open-Source Evolutionary Code Optimization with Real-World GPU Kernel Discovery" We built the first open-source implementation of Google's AlphaEvolve system and used it to automatically discover GPU kernel optimizations that outperform human engineers! Key results: - 21.8% average decode speed improvement on Apple Silicon - 36.7% improvement on long-context transformer attention - Discovered novel vectorization patterns and 2-pass softmax algorithm The system evolved a Metal kernel for Qwen3's Grouped Query Attention from a basic 3-pass implementation into something with sophisticated Apple Silicon optimizations that would take experts months to discover manually. The evolved kernel automatically found the optimal vec<T,8> operations for 128-dim attention heads and fused softmax computation with value accumulation. Really excited about the potential here - imagine evolutionary algorithms automatically discovering optimizations across all our AI infrastructure. What would you want to optimize with this approach? Full write-up: https://huggingface.co/blog/codelion/openevolve-gpu-kernel-discovery GitHub: https://github.com/codelion/openevolve #AI #MachineLearning #GPU #OpenSource #Evolution #CodeOptimization #TransformerOptimization
View all activity

Organizations

Peking University's profile picture