title: Cosmos World Foundation Model Platform for Physical AI
summary: Physical AI needs to be trained digitally first. It needs a digital twin of
  itself, the policy model, and a digital twin of the world, the world model. In
  this paper, we present the Cosmos World Foundation Model Platform to help
  developers build customized world models for their Physical AI setups. We
  position a world foundation model as a general-purpose world model that can be
  fine-tuned into customized world models for downstream applications. Our
  platform covers a video curation pipeline, pre-trained world foundation models,
  examples of post-training of pre-trained world foundation models, and video
  tokenizers. To help Physical AI builders solve the most critical problems of
  our society, we make our platform open-source and our models open-weight with
  permissive licenses available via https://github.com/NVIDIA/Cosmos.
paper_authors._id: 677dfaa14bf7f0d4734088a4
paper_authors.name: NVIDIA
paper_authors._id: 677dfaa14bf7f0d4734088a6
paper_authors.name: Niket Agarwal
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:41:16.772Z
paper_authors._id: 667b2e7f0ae3fef85fe33eb9
paper_authors.avatarUrl: /avatars/033f74277bf934d8d9703e9a8c5a6716.svg
paper_authors.fullname: Niket Agarwal
paper_authors.type: user
paper_authors.user: niketa12
paper_authors._id: 677dfaa14bf7f0d4734088a7
paper_authors.name: Arslan Ali
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:41:24.513Z
paper_authors._id: 6517ec608a6d58d1d7ec8ec1
paper_authors.avatarUrl: /avatars/4aac7fa6643f7f2d32e95cc991130ee9.svg
paper_authors.fullname: Arslan Ali
paper_authors.type: user
paper_authors.user: arslanali
paper_authors._id: 677dfaa14bf7f0d4734088a8
paper_authors.name: Maciej Bala
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:41:34.024Z
paper_authors._id: 675304737c4876b7a1475695
paper_authors.avatarUrl: /avatars/7ee3c443f6a143b4a79d679fb7f60fe5.svg
paper_authors.fullname: Maciej Bala
paper_authors.type: user
paper_authors.user: mbalaNV
paper_authors._id: 677dfaa14bf7f0d4734088a9
paper_authors.name: Yogesh Balaji
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:41:53.307Z
paper_authors._id: 66cd4e2564a8631d7328a637
paper_authors.avatarUrl: /avatars/024592abd427a8109f85c49e52e3bb7e.svg
paper_authors.fullname: Yogesh Balaji
paper_authors.type: user
paper_authors.user: yogeshbalaji
paper_authors._id: 677dfaa14bf7f0d4734088aa
paper_authors.name: Erik Barker
paper_authors._id: 677dfaa14bf7f0d4734088ab
paper_authors.name: Tiffany Cai
paper_authors._id: 677dfaa14bf7f0d4734088ac
paper_authors.name: Prithvijit Chattopadhyay
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:43:22.176Z
paper_authors._id: 628d451386d23ad1560882c4
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/628d451386d23ad1560882c4/UMxez0DEvX5qdP5ddqi-8.png
paper_authors.fullname: Prithvijit Chattopadhyay
paper_authors.type: user
paper_authors.user: prithv1
paper_authors._id: 677dfaa14bf7f0d4734088ad
paper_authors.name: Yongxin Chen
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:43:31.201Z
paper_authors._id: 66f4cf1a03b5ba8a7f1f6522
paper_authors.avatarUrl: /avatars/2768d6e37d3f280194cfb8ed274f6015.svg
paper_authors.fullname: Yongxin Chen
paper_authors.type: user
paper_authors.user: Ema11
paper_authors._id: 677dfaa14bf7f0d4734088ae
paper_authors.name: Yin Cui
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:43:42.260Z
paper_authors._id: 66f6510a1c8cb854dec2d05c
paper_authors.avatarUrl: /avatars/c344d7f6747beec0c3bab0c023b7b3d4.svg
paper_authors.fullname: Yin Cui
paper_authors.type: user
paper_authors.user: yinc-nvidia
paper_authors._id: 677dfaa14bf7f0d4734088af
paper_authors.name: Yifan Ding
paper_authors._id: 677dfaa14bf7f0d4734088b0
paper_authors.name: Daniel Dworakowski
paper_authors._id: 677dfaa14bf7f0d4734088b1
paper_authors.name: Jiaojiao Fan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:44:52.955Z
paper_authors._id: 67227b67dfa07920c2985d22
paper_authors.avatarUrl: /avatars/98f09002722950eadffe5c199d22bb4f.svg
paper_authors.fullname: Jiaojiao Fan
paper_authors.type: user
paper_authors.user: jjf233
paper_authors._id: 677dfaa14bf7f0d4734088b2
paper_authors.name: Michele Fenzi
paper_authors._id: 677dfaa14bf7f0d4734088b3
paper_authors.name: Francesco Ferroni
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:45:05.039Z
paper_authors._id: 6353d3e95eac2d2efa7501f9
paper_authors.avatarUrl: /avatars/4b063f54000bed4bfb1bfcc3cde1a09e.svg
paper_authors.fullname: Francesco Ferroni
paper_authors.type: user
paper_authors.user: fferroni
paper_authors._id: 677dfaa14bf7f0d4734088b4
paper_authors.name: Sanja Fidler
paper_authors._id: 677dfaa14bf7f0d4734088b5
paper_authors.name: Dieter Fox
paper_authors._id: 677dfaa14bf7f0d4734088b6
paper_authors.name: Songwei Ge
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:45:28.342Z
paper_authors._id: 67291c1a027e12eb38dc8a0c
paper_authors.avatarUrl: /avatars/00a0ca6da11d2ffd14a83d28e57c01b4.svg
paper_authors.fullname: Songwei Ge
paper_authors.type: user
paper_authors.user: SongweiGe
paper_authors._id: 677dfaa14bf7f0d4734088b7
paper_authors.name: Yunhao Ge
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:45:53.639Z
paper_authors._id: 6520e493b80dc49ba0f1e262
paper_authors.avatarUrl: /avatars/af21c1ee154b2c9a0d56e69a07508ccb.svg
paper_authors.fullname: Yunhao Ge
paper_authors.type: user
paper_authors.user: yunhaog
paper_authors._id: 677dfaa14bf7f0d4734088b8
paper_authors.name: Jinwei Gu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:46:02.830Z
paper_authors._id: 647e8118770c299e56fc2bc8
paper_authors.avatarUrl: /avatars/adf80f3473dda42450148789ae5c208f.svg
paper_authors.fullname: Jinwei Gu
paper_authors.type: user
paper_authors.user: jwgu
paper_authors._id: 677dfaa14bf7f0d4734088b9
paper_authors.name: Siddharth Gururani
paper_authors._id: 677dfaa14bf7f0d4734088ba
paper_authors.name: Ethan He
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2025-01-08T13:46:14.910Z
paper_authors._id: 62b20f6df4a72794189248fc
paper_authors.avatarUrl: /avatars/87e1125868616d4f7d6ee1e5ec4499b4.svg
paper_authors.fullname: Ethan He
paper_authors.type: user
paper_authors.user: ethanhe
paper_authors._id: 677dfaa14bf7f0d4734088bb
paper_authors.name: Jiahui Huang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-02-08T13:56:27.734Z
paper_authors._id: 644a717e75fce8ebef4e4955
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/noauth/zLga4NZBohFPlv50dcAo9.png
paper_authors.fullname: Jiahui Huang
paper_authors.type: user
paper_authors.user: heiwang1997
paper_authors._id: 677dfaa14bf7f0d4734088bc
paper_authors.name: Jacob Huffman
paper_authors._id: 677dfaa14bf7f0d4734088bd
paper_authors.name: Pooya Jannaty
paper_authors._id: 677dfaa14bf7f0d4734088be
paper_authors.name: Jingyi Jin
paper_authors._id: 677dfaa14bf7f0d4734088bf
paper_authors.name: Seung Wook Kim
paper_authors._id: 677dfaa14bf7f0d4734088c0
paper_authors.name: Gergely Klár
paper_authors._id: 677dfaa14bf7f0d4734088c1
paper_authors.name: Grace Lam
paper_authors._id: 677dfaa14bf7f0d4734088c2
paper_authors.name: Shiyi Lan
paper_authors._id: 677dfaa14bf7f0d4734088c3
paper_authors.name: Laura Leal-Taixe
paper_authors._id: 677dfaa14bf7f0d4734088c4
paper_authors.name: Anqi Li
paper_authors._id: 677dfaa14bf7f0d4734088c5
paper_authors.name: Zhaoshuo Li
paper_authors._id: 677dfaa14bf7f0d4734088c6
paper_authors.name: Chen-Hsuan Lin
paper_authors._id: 677dfaa14bf7f0d4734088c7
paper_authors.name: Tsung-Yi Lin
paper_authors._id: 677dfaa14bf7f0d4734088c8
paper_authors.name: Huan Ling
paper_authors._id: 677dfaa14bf7f0d4734088c9
paper_authors.name: Ming-Yu Liu
paper_authors._id: 677dfaa14bf7f0d4734088ca
paper_authors.name: Xian Liu
paper_authors._id: 677dfaa14bf7f0d4734088cb
paper_authors.name: Alice Luo
paper_authors._id: 677dfaa14bf7f0d4734088cc
paper_authors.name: Qianli Ma
paper_authors._id: 677dfaa14bf7f0d4734088cd
paper_authors.name: Hanzi Mao
paper_authors._id: 677dfaa14bf7f0d4734088ce
paper_authors.name: Kaichun Mo
paper_authors._id: 677dfaa14bf7f0d4734088cf
paper_authors.name: Arsalan Mousavian
paper_authors._id: 677dfaa14bf7f0d4734088d0
paper_authors.name: Seungjun Nah
paper_authors._id: 677dfaa14bf7f0d4734088d1
paper_authors.name: Sriharsha Niverty
paper_authors._id: 677dfaa14bf7f0d4734088d2
paper_authors.name: David Page
paper_authors._id: 677dfaa14bf7f0d4734088d3
paper_authors.name: Despoina Paschalidou
paper_authors._id: 677dfaa14bf7f0d4734088d4
paper_authors.name: Zeeshan Patel
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-01-09T10:07:14.790Z
paper_authors._id: 638ee4df6251c8bd7abd246e
paper_authors.avatarUrl: /avatars/8d8c4dac7d82cba6dcf884460bdc5328.svg
paper_authors.fullname: Zeeshan Patel
paper_authors.type: user
paper_authors.user: zeeshanp
paper_authors._id: 677dfaa14bf7f0d4734088d5
paper_authors.name: Lindsey Pavao
paper_authors._id: 677dfaa14bf7f0d4734088d6
paper_authors.name: Morteza Ramezanali
paper_authors._id: 677dfaa14bf7f0d4734088d7
paper_authors.name: Fitsum Reda
paper_authors._id: 677dfaa14bf7f0d4734088d8
paper_authors.name: Xiaowei Ren
paper_authors._id: 677dfaa14bf7f0d4734088d9
paper_authors.name: Vasanth Rao Naik Sabavat
paper_authors._id: 677dfaa14bf7f0d4734088da
paper_authors.name: Ed Schmerling
paper_authors._id: 677dfaa14bf7f0d4734088db
paper_authors.name: Stella Shi
paper_authors._id: 677dfaa14bf7f0d4734088dc
paper_authors.name: Bartosz Stefaniak
paper_authors._id: 677dfaa14bf7f0d4734088dd
paper_authors.name: Shitao Tang
paper_authors._id: 677dfaa14bf7f0d4734088de
paper_authors.name: Lyne Tchapmi
paper_authors._id: 677dfaa14bf7f0d4734088df
paper_authors.name: Przemek Tredak
paper_authors._id: 677dfaa14bf7f0d4734088e0
paper_authors.name: Wei-Cheng Tseng
paper_authors._id: 677dfaa14bf7f0d4734088e1
paper_authors.name: Jibin Varghese
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-01-22T20:49:55.440Z
paper_authors._id: 66d76b37483bbfc9e43eba4b
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/66d76b37483bbfc9e43eba4b/61G28x94O2MYzD2u_wnsD.png
paper_authors.fullname: Jibin Rajan Varghese
paper_authors.type: user
paper_authors.user: jibinv
paper_authors._id: 677dfaa14bf7f0d4734088e2
paper_authors.name: Hao Wang
paper_authors._id: 677dfaa14bf7f0d4734088e3
paper_authors.name: Haoxiang Wang
paper_authors._id: 677dfaa14bf7f0d4734088e4
paper_authors.name: Heng Wang
paper_authors._id: 677dfaa14bf7f0d4734088e5
paper_authors.name: Ting-Chun Wang
paper_authors._id: 677dfaa14bf7f0d4734088e6
paper_authors.name: Fangyin Wei
paper_authors._id: 677dfaa14bf7f0d4734088e7
paper_authors.name: Xinyue Wei
paper_authors._id: 677dfaa14bf7f0d4734088e8
paper_authors.name: Jay Zhangjie Wu
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-03-04T08:52:46.920Z
paper_authors._id: 633aaf695df91da9cea92960
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/633aaf695df91da9cea92960/9T4y1ru5wt5iKUUqf9_Tt.png
paper_authors.fullname: Jay Wu
paper_authors.type: user
paper_authors.user: jayw
paper_authors._id: 677dfaa14bf7f0d4734088e9
paper_authors.name: Jiashu Xu
paper_authors._id: 677dfaa14bf7f0d4734088ea
paper_authors.name: Wei Yang
paper_authors._id: 677dfaa14bf7f0d4734088eb
paper_authors.name: Lin Yen-Chen
paper_authors._id: 677dfaa14bf7f0d4734088ec
paper_authors.name: Xiaohui Zeng
paper_authors._id: 677dfaa14bf7f0d4734088ed
paper_authors.name: Yu Zeng
paper_authors._id: 677dfaa14bf7f0d4734088ee
paper_authors.name: Jing Zhang
paper_authors._id: 677dfaa14bf7f0d4734088ef
paper_authors.name: Qinsheng Zhang
paper_authors._id: 677dfaa14bf7f0d4734088f0
paper_authors.name: Yuxuan Zhang
paper_authors._id: 677dfaa14bf7f0d4734088f1
paper_authors.name: Qingqing Zhao
paper_authors._id: 677dfaa14bf7f0d4734088f2
paper_authors.name: Artur Zolkowski
paper_title: Cosmos World Foundation Model Platform for Physical AI
paper_summary: Physical AI needs to be trained digitally first. It needs a digital twin of
  itself, the policy model, and a digital twin of the world, the world model. In
  this paper, we present the Cosmos World Foundation Model Platform to help
  developers build customized world models for their Physical AI setups. We
  position a world foundation model as a general-purpose world model that can be
  fine-tuned into customized world models for downstream applications. Our
  platform covers a video curation pipeline, pre-trained world foundation models,
  examples of post-training of pre-trained world foundation models, and video
  tokenizers. To help Physical AI builders solve the most critical problems of
  our society, we make our platform open-source and our models open-weight with
  permissive licenses available via https://github.com/NVIDIA/Cosmos.
paper_ai_keywords: world model digital twin policy model Cosmos World Foundation Model Platform world foundation model fine-tuning video curation pipeline pre-trained world foundation models video tokenizer