title: Emerging Properties in Unified Multimodal Pretraining
summary: Unifying multimodal understanding and generation has shown impressive
  capabilities in cutting-edge proprietary systems. In this work, we introduce
  BAGEL, an open0source foundational model that natively supports multimodal
  understanding and generation. BAGEL is a unified, decoder0only model pretrained
  on trillions of tokens curated from large0scale interleaved text, image, video,
  and web data. When scaled with such diverse multimodal interleaved data, BAGEL
  exhibits emerging capabilities in complex multimodal reasoning. As a result, it
  significantly outperforms open-source unified models in both multimodal
  generation and understanding across standard benchmarks, while exhibiting
  advanced multimodal reasoning abilities such as free-form image manipulation,
  future frame prediction, 3D manipulation, and world navigation. In the hope of
  facilitating further opportunities for multimodal research, we share the key
  findings, pretraining details, data creation protocal, and release our code and
  checkpoints to the community. The project page is at https://bagel-ai.org/
paper_authors._id: 682d2fd84540abccd3b835e8
paper_authors.name: Chaorui Deng
paper_authors._id: 682d2fd84540abccd3b835e9
paper_authors.name: Deyao Zhu
paper_authors._id: 682d2fd84540abccd3b835ea
paper_authors.name: Kunchang Li
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-05-21T08:41:06.469Z
paper_authors._id: 61fb81006374891646732f37
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1643872995181-61fb81006374891646732f37.jpeg
paper_authors.fullname: Kunchang Li
paper_authors.type: user
paper_authors.user: Andy1621
paper_authors._id: 682d2fd84540abccd3b835eb
paper_authors.name: Chenhui Gou
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-05-21T08:41:08.903Z
paper_authors._id: 652e9c5774d1b0d7ff73d091
paper_authors.avatarUrl: /avatars/a6d2098b3dde4a8b7488a193f0ecb776.svg
paper_authors.fullname: Chenhui Gou
paper_authors.type: user
paper_authors.user: gouc
paper_authors._id: 682d2fd84540abccd3b835ec
paper_authors.name: Feng Li
paper_authors._id: 682d2fd84540abccd3b835ed
paper_authors.name: Zeyu Wang
paper_authors._id: 682d2fd84540abccd3b835ee
paper_authors.name: Shu Zhong
paper_authors._id: 682d2fd84540abccd3b835ef
paper_authors.name: Weihao Yu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-05-21T09:31:55.569Z
paper_authors._id: 5df833bdda6d0311fd3d5403
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/5df833bdda6d0311fd3d5403/62OtGJEQXdOuhV9yCd4HS.png
paper_authors.fullname: Weihao Yu
paper_authors.type: user
paper_authors.user: whyu
paper_authors._id: 682d2fd84540abccd3b835f0
paper_authors.name: Xiaonan Nie
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-05-21T10:06:14.057Z
paper_authors._id: 64b6b81142134e053233c3c0
paper_authors.avatarUrl: /avatars/5c7455d99a7a2648f77a531c9a71eb98.svg
paper_authors.fullname: Xiaonan Nie
paper_authors.type: user
paper_authors.user: codecaution
paper_authors._id: 682d2fd84540abccd3b835f1
paper_authors.name: Ziang Song
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-05-21T10:06:07.780Z
paper_authors._id: 617fe76105423df678cef199
paper_authors.avatarUrl: /avatars/64c94a4d743edab18ecb4bb7c550f049.svg
paper_authors.fullname: Song
paper_authors.type: user
paper_authors.user: Ziang
paper_authors._id: 682d2fd84540abccd3b835f2
paper_authors.name: Guang Shi
paper_authors._id: 682d2fd84540abccd3b835f3
paper_authors.name: Haoqi Fan
paper_title: Emerging Properties in Unified Multimodal Pretraining
paper_summary: Unifying multimodal understanding and generation has shown impressive
  capabilities in cutting-edge proprietary systems. In this work, we introduce
  BAGEL, an open0source foundational model that natively supports multimodal
  understanding and generation. BAGEL is a unified, decoder0only model pretrained
  on trillions of tokens curated from large0scale interleaved text, image, video,
  and web data. When scaled with such diverse multimodal interleaved data, BAGEL
  exhibits emerging capabilities in complex multimodal reasoning. As a result, it
  significantly outperforms open-source unified models in both multimodal
  generation and understanding across standard benchmarks, while exhibiting
  advanced multimodal reasoning abilities such as free-form image manipulation,
  future frame prediction, 3D manipulation, and world navigation. In the hope of
  facilitating further opportunities for multimodal research, we share the key
  findings, pretraining details, data creation protocal, and release our code and
  checkpoints to the community. The project page is at https://bagel-ai.org/
paper_ai_summary: BAGEL, an open-source foundational model trained on diverse multimodal data, significantly outperforms existing models in both generation and understanding tasks.
paper_ai_keywords: multimodal understanding multimodal generation foundational model decoder-only model trillions of tokens large-scale interleaved data complex multimodal reasoning free-form image manipulation future frame prediction 3D manipulation world navigation