Li Dong

unilm's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored 4 papers about 1 month ago

Think Only When You Need with Large Hybrid-Reasoning Models

Paper • 2505.14631 • Published May 20 • 19

On-Policy RL with Optimal Reward Baseline

Paper • 2505.23585 • Published May 29 • 14

Rectified Sparse Attention

Paper • 2506.04108 • Published Jun 4 • 10

Reinforcement Pre-Training

Paper • 2506.08007 • Published Jun 9 • 246

authored 5 papers about 2 months ago

Imagine while Reasoning in Space: Multimodal Visualization-of-Thought

Paper • 2501.07542 • Published Jan 13 • 3

Zero-shot Cross-lingual Transfer of Neural Machine Translation with Multilingual Pretrained Encoders

Paper • 2104.08757 • Published Apr 18, 2021

WildLong: Synthesizing Realistic Long-Context Instruction Data at Scale

Paper • 2502.16684 • Published Feb 23

Scaling Laws of Synthetic Data for Language Models

Paper • 2503.19551 • Published Mar 25 • 1

Reward Reasoning Model

Paper • 2505.14674 • Published May 20 • 36

authored 4 papers 7 months ago

Language Models as Inductive Reasoners

Paper • 2212.10923 • Published Dec 21, 2022 • 2

Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks

Paper • 2208.10442 • Published Aug 22, 2022

RedStone: Curating General, Code, Math, and QA Data for Large Language Models

Paper • 2412.03398 • Published Dec 4, 2024 • 2

Multimodal Latent Language Modeling with Next-Token Diffusion

Paper • 2412.08635 • Published Dec 11, 2024 • 46

authored 7 papers 9 months ago

You Only Cache Once: Decoder-Decoder Architectures for Language Models

Paper • 2405.05254 • Published May 8, 2024 • 10

BitNet: Scaling 1-bit Transformers for Large Language Models

Paper • 2310.11453 • Published Oct 17, 2023 • 103

Retentive Network: A Successor to Transformer for Large Language Models

Paper • 2307.08621 • Published Jul 17, 2023 • 171

Data Selection via Optimal Control for Language Models

Paper • 2410.07064 • Published Oct 9, 2024 • 9

Self-Boosting Large Language Models with Synthetic Preference Data

Paper • 2410.06961 • Published Oct 9, 2024 • 17

Kosmos-G: Generating Images in Context with Multimodal Large Language Models

Paper • 2310.02992 • Published Oct 4, 2023 • 4

Kosmos-2.5: A Multimodal Literate Model

Paper • 2309.11419 • Published Sep 20, 2023 • 50