Febriyanto's picture

Febriyanto

arpenxd

·

ArgoPenyok

AI & ML interests

None yet

Recent Activity

reacted to Jaward's post with 🔥 2 days ago

Amazing work👏 Introduces Dream 7B - a discrete diffusion reasoning model, fully opensourced with weights on 🤗 - it outperforms existing non-autoregressive models and matches or beats frontier autoregressive of similar size on reasoning tasks. Models: - base: https://huggingface.co/Dream-org/Dream-v0-Base-7B - SFT: https://huggingface.co/Dream-org/Dream-v0-Instruct-7B Code: https://github.com/HKUNLP/Dream Project: https://hkunlp.github.io/blog/2025/dream/

reacted to BestWishYsh's post with 🔥 2 days ago

🚨 Hot Take: GPT-4o might NOT be a purely autoregressive model! 🚨 There’s a high chance it has a diffusion head. 🤯 If true, this could be a game-changer for AI architecture. What do you think? 🤔👇 Code: https://github.com/PicoTrex/GPT-ImgEval Paper: https://huggingface.co/papers/2504.02782

replied to lianghsun's post 2 days ago

With the arrival of Twinkle April — Twinkle AI’s annual open-source celebration held every April — our community is excited to unveil its very first project: 📊 Twinkle Eval (https://github.com/ai-twinkle/Eval), a next-generation evaluation tool led by our contributor @tedslin . Unlike traditional evaluation tools like iKala’s ievals (https://github.com/ikala-ai/ievals), which can only evaluate language models (LMs) one sample at a time, Twinkle Eval is designed with Large Reasoning Models (LRMs) in mind. As reasoning time increases with more complex models, traditional tools become increasingly inefficient 😲 — for example, evaluating LRMs on the https://huggingface.co/datasets/ikala/tmmluplus benchmark could take * half a day without finishing. One question we were especially curious about: Does shuffling multiple-choice answer order impact model accuracy? 🤔 → See: "Change Answer Order Can Decrease MMLU Accuracy" – arXiv:2406.19470v1 To address these challenges, Twinkle Eval brings three key innovations to the table: 1️⃣ Parallelized evaluation of samples 2️⃣ Multi-round testing for stability 3️⃣ Randomized answer order to test robustness After running experiments, we observed that Twinkle Eval can speed up evaluation by up to 15× 🚀🚀. Interestingly, most models scored slightly lower under the 2️⃣3️⃣ test settings compared to their claimed performance — suggesting further benchmarking is needed. This framework also comes with additional tunable parameters and detailed logging of LM behavior per question — perfect for those who want to dive deeper. 😆 If you find Twinkle Eval useful, please ⭐ the project and help spread the word 🤗

View all activity

Organizations

None yet

models

None public yet

datasets

None public yet