title: Imagine360: Immersive 360 Video Generation from Perspective Anchor
summary: 360^circ videos offer a hyper-immersive experience that allows the viewers
  to explore a dynamic scene from full 360 degrees. To achieve more user-friendly
  and personalized content creation in 360^circ video format, we seek to lift
  standard perspective videos into 360^circ equirectangular videos. To this
  end, we introduce Imagine360, the first perspective-to-360^circ video
  generation framework that creates high-quality 360^circ videos with rich and
  diverse motion patterns from video anchors. Imagine360 learns fine-grained
  spherical visual and motion patterns from limited 360^circ video data with
  several key designs. 1) Firstly we adopt the dual-branch design, including a
  perspective and a panorama video denoising branch to provide local and global
  constraints for 360^circ video generation, with motion module and spatial
  LoRA layers fine-tuned on extended web 360^circ videos. 2) Additionally, an
  antipodal mask is devised to capture long-range motion dependencies, enhancing
  the reversed camera motion between antipodal pixels across hemispheres. 3) To
  handle diverse perspective video inputs, we propose elevation-aware designs
  that adapt to varying video masking due to changing elevations across frames.
  Extensive experiments show Imagine360 achieves superior graphics quality and
  motion coherence among state-of-the-art 360^circ video generation methods.
  We believe Imagine360 holds promise for advancing personalized, immersive
  360^circ video creation.
paper_authors._id: 675118447679a2657e4d1369
paper_authors.name: Jing Tan
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-05T09:33:59.672Z
paper_authors._id: 65367c40061949598892dbdc
paper_authors.avatarUrl: /avatars/4baf27263841471cbd5f629a8b99424d.svg
paper_authors.fullname: Jing Tan
paper_authors.type: user
paper_authors.user: jingtan
paper_authors._id: 675118447679a2657e4d136a
paper_authors.name: Shuai Yang
paper_authors.status: claimed_verified
paper_authors.statusLastChangedAt: 2025-06-06T07:42:58.099Z
paper_authors._id: 6373037cd3ba6bd3f9bc32fa
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6373037cd3ba6bd3f9bc32fa/dIL4AIcL24QL_Rp4B9ewS.png
paper_authors.fullname: Shuai Yang
paper_authors.type: user
paper_authors.user: ysmikey
paper_authors._id: 675118447679a2657e4d136b
paper_authors.name: Tong Wu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-05T09:33:26.828Z
paper_authors._id: 62fae9328e137d7c4b896498
paper_authors.avatarUrl: /avatars/1bda39dec585c099417cc9daa9f53c42.svg
paper_authors.fullname: Tong Wu
paper_authors.type: user
paper_authors.user: tongwu2020
paper_authors._id: 675118447679a2657e4d136c
paper_authors.name: Jingwen He
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-05T09:33:19.535Z
paper_authors._id: 670749a9d827da9f37508209
paper_authors.avatarUrl: /avatars/f14fc05ad405f3967b9af0bcc73d4207.svg
paper_authors.fullname: he jingwen
paper_authors.type: user
paper_authors.user: mimihe
paper_authors._id: 675118447679a2657e4d136d
paper_authors.name: Yuwei Guo
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-05T09:33:06.811Z
paper_authors._id: 6371f83d5ffa922d638ef486
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/6371f83d5ffa922d638ef486/UzWl3xhVvtol3Rz1mjQ9t.jpeg
paper_authors.fullname: Yuwei Guo
paper_authors.type: user
paper_authors.user: guoyww
paper_authors._id: 675118447679a2657e4d136e
paper_authors.name: Ziwei Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-05T09:32:44.270Z
paper_authors._id: 62ab1ac1d48b4d8b048a3473
paper_authors.avatarUrl: https://cdn-avatars.huggingface.co/v1/production/uploads/1656826685333-62ab1ac1d48b4d8b048a3473.png
paper_authors.fullname: Ziwei Liu
paper_authors.type: user
paper_authors.user: liuziwei7
paper_authors._id: 675118447679a2657e4d136f
paper_authors.name: Dahua Lin
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-12-05T09:32:38.520Z
paper_authors._id: 636317ed80c1a705a6eff396
paper_authors.avatarUrl: /avatars/3db090e101b916d9256d0d3e043db71d.svg
paper_authors.fullname: Dahua Lin
paper_authors.type: user
paper_authors.user: lindahua
paper_title: Imagine360: Immersive 360 Video Generation from Perspective Anchor
paper_summary: 360^circ videos offer a hyper-immersive experience that allows the viewers
  to explore a dynamic scene from full 360 degrees. To achieve more user-friendly
  and personalized content creation in 360^circ video format, we seek to lift
  standard perspective videos into 360^circ equirectangular videos. To this
  end, we introduce Imagine360, the first perspective-to-360^circ video
  generation framework that creates high-quality 360^circ videos with rich and
  diverse motion patterns from video anchors. Imagine360 learns fine-grained
  spherical visual and motion patterns from limited 360^circ video data with
  several key designs. 1) Firstly we adopt the dual-branch design, including a
  perspective and a panorama video denoising branch to provide local and global
  constraints for 360^circ video generation, with motion module and spatial
  LoRA layers fine-tuned on extended web 360^circ videos. 2) Additionally, an
  antipodal mask is devised to capture long-range motion dependencies, enhancing
  the reversed camera motion between antipodal pixels across hemispheres. 3) To
  handle diverse perspective video inputs, we propose elevation-aware designs
  that adapt to varying video masking due to changing elevations across frames.
  Extensive experiments show Imagine360 achieves superior graphics quality and
  motion coherence among state-of-the-art 360^circ video generation methods.
  We believe Imagine360 holds promise for advancing personalized, immersive
  360^circ video creation.
paper_ai_summary: Imagine360 generates high-quality, personalized 360° videos with rich motion patterns using dual-branch denoising, antipodal masks, and elevation-aware designs.
paper_ai_keywords: dual-branch design perspective video denoising panorama video denoising motion module spatial LoRA layers antipodal mask elevation-aware designs