title: VidPanos: Generative Panoramic Videos from Casual Panning Videos
summary: Panoramic image stitching provides a unified, wide-angle view of a scene that
  extends beyond the camera's field of view. Stitching frames of a panning video
  into a panoramic photograph is a well-understood problem for stationary scenes,
  but when objects are moving, a still panorama cannot capture the scene. We
  present a method for synthesizing a panoramic video from a casually-captured
  panning video, as if the original video were captured with a wide-angle camera.
  We pose panorama synthesis as a space-time outpainting problem, where we aim to
  create a full panoramic video of the same length as the input video. Consistent
  completion of the space-time volume requires a powerful, realistic prior over
  video content and motion, for which we adapt generative video models. Existing
  generative models do not, however, immediately extend to panorama completion,
  as we show. We instead apply video generation as a component of our panorama
  synthesis system, and demonstrate how to exploit the strengths of the models
  while minimizing their limitations. Our system can create video panoramas for a
  range of in-the-wild scenes including people, vehicles, and flowing water, as
  well as stationary background features.
paper_authors._id: 6711da38e6f26ad913eac179
paper_authors.name: Jingwei Ma
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-10-18T12:54:07.209Z
paper_authors._id: 634cddac04491d9f71132375
paper_authors.avatarUrl: /avatars/2397218ddaca00e89b1207eada295d89.svg
paper_authors.fullname: Jingwei Ma
paper_authors.type: user
paper_authors.user: jingweim
paper_authors._id: 6711da38e6f26ad913eac17a
paper_authors.name: Erika Lu
paper_authors._id: 6711da38e6f26ad913eac17b
paper_authors.name: Roni Paiss
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-10-18T12:54:20.845Z
paper_authors._id: 62cab8aeb189b6164d26bfbe
paper_authors.avatarUrl: /avatars/7ed117e375dd9280a5750a242cae24ca.svg
paper_authors.fullname: Roni Paiss
paper_authors.type: user
paper_authors.user: RoniPaiss
paper_authors._id: 6711da38e6f26ad913eac17c
paper_authors.name: Shiran Zada
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-10-18T12:54:26.118Z
paper_authors._id: 63510f62cba4ff2e81cb0492
paper_authors.avatarUrl: /avatars/2375a841491de8f40f66b6d0fb0df7b1.svg
paper_authors.fullname: Shiran Zada
paper_authors.type: user
paper_authors.user: shiranzada
paper_authors._id: 6711da38e6f26ad913eac17d
paper_authors.name: Aleksander Holynski
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-10-18T12:54:32.095Z
paper_authors._id: 62f6e2792e53c2efd33faa92
paper_authors.avatarUrl: /avatars/85d94b4022577747b8d2d10a82c2f3c7.svg
paper_authors.fullname: Aleksander Holynski
paper_authors.type: user
paper_authors.user: holynski
paper_authors._id: 6711da38e6f26ad913eac17e
paper_authors.name: Tali Dekel
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-10-18T12:54:38.194Z
paper_authors._id: 631cddec68f7da9ad24f6fc7
paper_authors.avatarUrl: /avatars/7d4f1ce805e5889ca6594bd4a93f2583.svg
paper_authors.fullname: Tali Dekel
paper_authors.type: user
paper_authors.user: talidekel
paper_authors._id: 6711da38e6f26ad913eac17f
paper_authors.name: Brian Curless
paper_authors._id: 6711da38e6f26ad913eac180
paper_authors.name: Michael Rubinstein
paper_authors._id: 6711da38e6f26ad913eac181
paper_authors.name: Forrester Cole
paper_authors.status: extracted_pending
paper_authors.statusLastChangedAt: 2024-10-18T03:47:06.381Z
paper_authors._id: 635003011d81beb8e244e68d
paper_authors.avatarUrl: /avatars/32f46e6778d1c52ebdd6f2511ba48257.svg
paper_authors.fullname: Forrester Cole
paper_authors.type: user
paper_authors.user: fcole
paper_title: VidPanos: Generative Panoramic Videos from Casual Panning Videos
paper_summary: Panoramic image stitching provides a unified, wide-angle view of a scene that
  extends beyond the camera's field of view. Stitching frames of a panning video
  into a panoramic photograph is a well-understood problem for stationary scenes,
  but when objects are moving, a still panorama cannot capture the scene. We
  present a method for synthesizing a panoramic video from a casually-captured
  panning video, as if the original video were captured with a wide-angle camera.
  We pose panorama synthesis as a space-time outpainting problem, where we aim to
  create a full panoramic video of the same length as the input video. Consistent
  completion of the space-time volume requires a powerful, realistic prior over
  video content and motion, for which we adapt generative video models. Existing
  generative models do not, however, immediately extend to panorama completion,
  as we show. We instead apply video generation as a component of our panorama
  synthesis system, and demonstrate how to exploit the strengths of the models
  while minimizing their limitations. Our system can create video panoramas for a
  range of in-the-wild scenes including people, vehicles, and flowing water, as
  well as stationary background features.
paper_ai_keywords: space-time outpainting generative video models panorama synthesis space-time volume