Wei Wu's picture

3 3 50

Wei Wu

Wei-Wu

·

AI & ML interests

None yet

Recent Activity

liked a model 2 days ago

jiulaikankan/Qwen2.5-14B-ReasonGenRM

commented on a paper about 1 month ago

Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergy

reacted to codelion's post with 🔥 about 1 month ago

🚀 Just published: "OpenEvolve: Open-Source Evolutionary Code Optimization with Real-World GPU Kernel Discovery" We built the first open-source implementation of Google's AlphaEvolve system and used it to automatically discover GPU kernel optimizations that outperform human engineers! Key results: - 21.8% average decode speed improvement on Apple Silicon - 36.7% improvement on long-context transformer attention - Discovered novel vectorization patterns and 2-pass softmax algorithm The system evolved a Metal kernel for Qwen3's Grouped Query Attention from a basic 3-pass implementation into something with sophisticated Apple Silicon optimizations that would take experts months to discover manually. The evolved kernel automatically found the optimal vec<T,8> operations for 128-dim attention heads and fused softmax computation with value accumulation. Really excited about the potential here - imagine evolutionary algorithms automatically discovering optimizations across all our AI infrastructure. What would you want to optimize with this approach? Full write-up: https://huggingface.co/blog/codelion/openevolve-gpu-kernel-discovery GitHub: https://github.com/codelion/openevolve #AI #MachineLearning #GPU #OpenSource #Evolution #CodeOptimization #TransformerOptimization

View all activity

Organizations

upvoted a paper 11 months ago

NVLM: Open Frontier-Class Multimodal LLMs

Paper • 2409.11402 • Published Sep 17, 2024 • 75

upvoted 2 collections about 1 year ago

MoE

137 items • Updated Jul 9, 2024 • 20

Long context

94 items • Updated Sep 29, 2024 • 33