title: Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using
    Sparse RGB Cameras
summary: In this paper, we present a low-budget and high-authenticity bidirectional
  telepresence system, Tele-Aloha, targeting peer-to-peer communication
  scenarios. Compared to previous systems, Tele-Aloha utilizes only four sparse
  RGB cameras, one consumer-grade GPU, and one autostereoscopic screen to achieve
  high-resolution (2048x2048), real-time (30 fps), low-latency (less than 150ms)
  and robust distant communication. As the core of Tele-Aloha, we propose an
  efficient novel view synthesis algorithm for upper-body. Firstly, we design a
  cascaded disparity estimator for obtaining a robust geometry cue. Additionally
  a neural rasterizer via Gaussian Splatting is introduced to project latent
  features onto target view and to decode them into a reduced resolution.
  Further, given the high-quality captured data, we leverage weighted blending
  mechanism to refine the decoded image into the final resolution of 2K.
  Exploiting world-leading autostereoscopic display and low-latency iris
  tracking, users are able to experience a strong three-dimensional sense even
  without any wearable head-mounted display device. Altogether, our telepresence
  system demonstrates the sense of co-presence in real-life experiments,
  inspiring the next generation of communication.
paper_authors._id: 6650a2c5607894ea804c6f8c
paper_authors.name: Hanzhang Tu
paper_authors._id: 6650a2c5607894ea804c6f8d
paper_authors.name: Ruizhi Shao
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-24T15:10:07.128Z
paper_authors._id: 64785ad575a9a0cfabcf5083
paper_authors.avatarUrl: /avatars/5b8526bf2d8389310ca1799655cbbcd8.svg
paper_authors.fullname: Ruizhi Shao
paper_authors.type: user
paper_authors.user: DSaurus
paper_authors._id: 6650a2c5607894ea804c6f8e
paper_authors.name: Xue Dong
paper_authors._id: 6650a2c5607894ea804c6f8f
paper_authors.name: Shunyuan Zheng
paper_authors._id: 6650a2c5607894ea804c6f90
paper_authors.name: Hao Zhang
paper_authors._id: 6650a2c5607894ea804c6f91
paper_authors.name: Lili Chen
paper_authors._id: 6650a2c5607894ea804c6f92
paper_authors.name: Meili Wang
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-24T15:11:45.224Z
paper_authors._id: 661f35f65113774d1d21be17
paper_authors.avatarUrl: /avatars/5f3c502c28a256c191363bc2d6886905.svg
paper_authors.fullname: Wang Meiling
paper_authors.type: user
paper_authors.user: Amling2024
paper_authors._id: 6650a2c5607894ea804c6f93
paper_authors.name: Wenyu Li
paper_authors._id: 6650a2c5607894ea804c6f94
paper_authors.name: Siyan Ma
paper_authors._id: 6650a2c5607894ea804c6f95
paper_authors.name: Shengping Zhang
paper_authors._id: 6650a2c5607894ea804c6f96
paper_authors.name: Boyao Zhou
paper_authors._id: 6650a2c5607894ea804c6f97
paper_authors.name: Yebin Liu
paper_authors.status: admin_assigned
paper_authors.statusLastChangedAt: 2024-05-24T15:12:55.947Z
paper_authors._id: 62e14dbe4db2175cd2735a80
paper_authors.avatarUrl: /avatars/e6385dcedcb97e1b36281b49210321aa.svg
paper_authors.fullname: Yebin Liu
paper_authors.type: user
paper_authors.user: YebinLiu
paper_title: Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using
    Sparse RGB Cameras
paper_summary: In this paper, we present a low-budget and high-authenticity bidirectional
  telepresence system, Tele-Aloha, targeting peer-to-peer communication
  scenarios. Compared to previous systems, Tele-Aloha utilizes only four sparse
  RGB cameras, one consumer-grade GPU, and one autostereoscopic screen to achieve
  high-resolution (2048x2048), real-time (30 fps), low-latency (less than 150ms)
  and robust distant communication. As the core of Tele-Aloha, we propose an
  efficient novel view synthesis algorithm for upper-body. Firstly, we design a
  cascaded disparity estimator for obtaining a robust geometry cue. Additionally
  a neural rasterizer via Gaussian Splatting is introduced to project latent
  features onto target view and to decode them into a reduced resolution.
  Further, given the high-quality captured data, we leverage weighted blending
  mechanism to refine the decoded image into the final resolution of 2K.
  Exploiting world-leading autostereoscopic display and low-latency iris
  tracking, users are able to experience a strong three-dimensional sense even
  without any wearable head-mounted display device. Altogether, our telepresence
  system demonstrates the sense of co-presence in real-life experiments,
  inspiring the next generation of communication.
paper_ai_keywords: bidirectional telepresence system Tele-Aloha peer-to-peer communication scenarios sparse RGB cameras consumer-grade RGB camera autostereoscopic screen high-resolution real-time low-latency novel view synthesis algorithm cascaded disparity estimator geometry cue neural rasterizer Gaussian Splatting latent features target view weighted blending mechanism autostereoscopic display low-latency iris tracking three-dimensional sense co-presence