OpenMOSS, Fudan NLP, SII

university

https://open-moss.com/en/

Activity Feed Request to join this org

AI & ML interests

LLM

Recent Activity

Hzfinfdu updated a model 24 days ago

fnlp/Lorsa-Llama-3.1-8B

Hzfinfdu updated a model 24 days ago

fnlp/Lorsa-Pythia-160M

Hzfinfdu updated a collection about 1 month ago

Low Rank Sparse Attention

View all activity

fnlp's activity

Hzfinfdu

updated 2 models 24 days ago

fnlp/Lorsa-Llama-3.1-8B

Updated 24 days ago

fnlp/Lorsa-Pythia-160M

Updated 24 days ago • 1

Hzfinfdu

updated a collection about 1 month ago

Low Rank Sparse Attention

Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition". • 3 items • Updated Apr 30 • 2

Hzfinfdu

published a model about 1 month ago

fnlp/Lorsa

Updated Apr 28 • 2

Hzfinfdu

updated a collection about 1 month ago

Low Rank Sparse Attention

Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition". • 3 items • Updated Apr 30 • 2

Hzfinfdu

published 2 models about 1 month ago

fnlp/Lorsa-Llama-3.1-8B

Updated 24 days ago

fnlp/Lorsa-Pythia-160M

Updated 24 days ago • 1

Hzfinfdu

updated a collection about 1 month ago

Low Rank Sparse Attention

Open source weights of Lorsa modules introduced in "Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition". • 3 items • Updated Apr 30 • 2

xpqiu

authored a paper about 2 months ago

VisuoThink: Empowering LVLM Reasoning with Multimodal Tree Search

Paper • 2504.09130 • Published Apr 12 • 12

TaoJi

updated a dataset 2 months ago

fnlp/MHA2MLA-corpus-qwen1_5

Updated Apr 1 • 5

TaoJi

updated a collection 2 months ago

MHA2MLA

The MHA2MLA model published in the paper "Towards Economical Inference: Enabling DeepSeek's Multi-Head Latent Attention in Any Transformer-Based LLMs" • 22 items • Updated Apr 1 • 1

TaoJi

updated 2 datasets 2 months ago

fnlp/MHA2MLA-corpus-qwen2

Updated Apr 1 • 14

fnlp/MHA2MLA-corpus-mistral-v0_1

Updated Mar 31 • 8

TaoJi

published 3 datasets 2 months ago

fnlp/MHA2MLA-corpus-mistral-v0_1

Updated Mar 31 • 8

fnlp/MHA2MLA-corpus-qwen1_5

Updated Apr 1 • 5

fnlp/MHA2MLA-corpus-qwen2

Updated Apr 1 • 14

xpqiu

authored a paper 3 months ago

World Modeling Makes a Better Planner: Dual Preference Optimization for Embodied Task Planning

Paper • 2503.10480 • Published Mar 13 • 53