The office of the future: A unified approach to image-based modeling and spatially immersive displays (1998)
by Ramesh Raskar, Greg Welch, Matt Cutts, Adam Lake, Lev Stesin, Henry Fuchs
Venue: In Proceedings of SIGGRAPH 98, Computer Graphics Proceedings, Annual Conference Series
Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments
by Jun Rekimoto, Masanori Saitoh , 1999
"... This paper describes our design and implementation of a computer augmented environment that allows users to smoothly interchange digital information among their portable computers, table and wall displays, and other physical objects. Supported by a camera-based object recognition system, users can e ..."
This paper describes our design and implementation of a computer augmented environment that allows users to smoothly interchange digital information among their portable computers, table and wall displays, and other physical objects. Supported by a camera-based object recognition system, users can easily integrate their portable computers with the pre-installed ones in the environment. Users can use displays projected on tables and walls as a spatially continuous extension of their portable computers. Using an interaction technique called hyperdragging, users can transfer information from one computer to another, by only knowing the physical relationship between them. We also provide a mechanism for attaching digital data to physical objects, such as a videotape or a document folder, to link physical and digital spaces.
Spacetime faces: High resolution capture for modeling and animation
by Li Zhang, Noah Snavely, Brian Curless, Steven M. Seitz - IN ACM TRANSACTIONS ON GRAPHICS (PROC. OF ACM SIGGRAPH) , 2004
"... We present an end-to-end system that goes from video sequences to high resolution, editable, dynamically controllable face models. The capture system employs synchronized video cameras and structured light projectors to record videos of a moving face from multiple viewpoints. A novel spacetime stere ..."
We present an end-to-end system that goes from video sequences to high resolution, editable, dynamically controllable face models. The capture system employs synchronized video cameras and structured light projectors to record videos of a moving face from multiple viewpoints. A novel spacetime stereo algorithm is introduced to compute depth maps accurately and overcome over-fitting deficiencies in prior work. A new template fitting and tracking procedure fills in missing data and yields point correspondence across the entire sequence without using markers. We demonstrate a datadriven, interactive method for inverse kinematics that draws on the large set of fitted templates and allows for posing new expressions by dragging surface points directly. Finally, we describe new tools that model the dynamics in the input sequence to enable new animations, created via key-framing or texture-synthesis techniques.
3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes
by Wojciech Matusik, Hanspeter Pfister - ACM Transactions on Graphics , 2004
"... Three-dimensional TV is expected to be the next revolution in the history of television. We implemented a 3D TV prototype system with real-time acquisition, transmission, and 3D display of dynamic scenes. We developed a distributed, scalable architecture to manage the high computation and bandwidth ..."
Three-dimensional TV is expected to be the next revolution in the history of television. We implemented a 3D TV prototype system with real-time acquisition, transmission, and 3D display of dynamic scenes. We developed a distributed, scalable architecture to manage the high computation and bandwidth demands. Our system consists of an array of cameras, clusters of network-connected PCs, and a multi-projector 3D display. Multiple video streams are individually encoded and sent over a broadband network to the display. The 3D display shows high-resolution (1024 × 768) stereoscopic color images for multiple viewpoints without special glasses. We implemented systems with rear-projection and front-projection lenticular screens. In this paper, we provide a detailed overview of our 3D TV system, including an examination of design choices and tradeoffs. We present the calibration and image alignment procedures that are necessary to achieve good image quality. We present qualitative results and some early user feedback. We believe this is the first real-time end-to-end 3D TV system with enough views and resolution to provide a truly immersive 3D experience.
The Everywhere Displays Projector: A Device to Create Ubiquitous Graphical Interfaces
by Claudio Pinhanez , 2001
"... This paper introduces the Everywhere Displays projector, a device that uses a rotating mirror to steer the light from an LCD/DLP projector onto different surfaces of an environment. Issues of brightness, oblique projection distortion, focus, obstruction, and display resolution are examined. Solut ..."
This paper introduces the Everywhere Displays projector, a device that uses a rotating mirror to steer the light from an LCD/DLP projector onto different surfaces of an environment. Issues of brightness, oblique projection distortion, focus, obstruction, and display resolution are examined. Solutions to some of these problems are deschbed, together with a plan to use a video camera to allow device-free interaction with the projected images. The EDprojector is a practical way to create ubiquitous graphical interfaces to access computational power and networked data. In particular, it is envisioned as an alternative to the carrying of laptops and to the installation of displays in furniture, objects, and walls. In addition, the use of ED-projectors to augment reality without the use of goggles is examined and illustrated with examples.
...they also require the fast and accurate tracking of the user's head to be effective. We are exploring the use of the ED-projector in such environments. Unlike in previous works with static projectors =-=[9, 10, 13]-=-, the rotating mirror expands the reach of projector to almost the entire room. It also enables the augmented reality image to follow an object around an environment (as long as there is a mechanism t...
Multi-Projector Displays Using Camera-Based Registration
by Ramesh Raskar, Michael Brown, Ruigang Yang, Wei-chao Chen, Greg Welch, Herman Towles, Brent Seales, Henry Fuchs, Greg Welch Herman Towles , 1999
"... Conventional projector-based display systems are typically designed around precise and regular configurations of projectors and display surfaces. While this results in rendering simplicity and speed, it also means painstaking construction and ongoing maintenance. In previously published work, we int ..."
Conventional projector-based display systems are typically designed around precise and regular configurations of projectors and display surfaces. While this results in rendering simplicity and speed, it also means painstaking construction and ongoing maintenance. In previously published work, we introduced a vision of projector-based displays constructed from a collection of casually-arranged projectors and display surfaces. In this paper, we present flexible yet practical methods for realizing this vision, enabling low-cost mega-pixel display systems with large physical dimensions, higher resolution, or both. The techniques a#ord new opportunities to build personal 3D visualization systems in o#ces, conference rooms, theaters, or even your living room. As a demonstration of the simplicity and e#ectiveness of the methods that we continue to perfect, we show in the included video that a 10-year old child can construct and calibrate a two-camera, two-projector, head-tracked display syst...
iLamps: Geometrically aware and self-configuring projectors
by Ramesh Raskar, Jeroen van Baar, Paul Beardsley, Thomas Willwacher, Srinivas Rao, Clifton Forlines - ACM TOG , 2003
"... Projectors are currently undergoing a transformation as they evolve from static output devices to portable, environment-aware, communicating systems. An enhanced projector can determine and respond to the geometry of the display surface, and can be used in an ad-hoc cluster to create a self-configur ..."
Projectors are currently undergoing a transformation as they evolve from static output devices to portable, environment-aware, communicating systems. An enhanced projector can determine and respond to the geometry of the display surface, and can be used in an ad-hoc cluster to create a self-configuring display. Information display is such a prevailing part of everyday life that new and more flexible ways to present data are likely to have significant impact. This paper examines geometrical issues for enhanced projectors, relating to customized projection for different shapes of display surface, object augmentation, and co-operation between multiple units. We introduce a new technique for adaptive projection on nonplanar surfaces using conformal texture mapping. We describe object augmentation with a hand-held projector, including interaction techniques. We describe the concept of a display created by an ad-hoc cluster of heterogeneous enhanced projectors, with a new global alignment scheme, and new parametric image transfer methods for quadric surfaces, to make a seamless projection. The work is illustrated by several prototypes and applications.
blue-c: A Spatially Immersive Display and 3D Video Portal for Telepresence
by Markus Gross, Stephan Würmlin, Martin Naef, Edouard Lamboray, Christian Spagno, Andreas Kunz, Esther Koller-meier, Tomas Svoboda, Luc Van Gool, Silke Lang, Kai Strehlke, Andrew Vande Moere, Oliver, Eth Zürich, Oliver Staadt - ACM Transactions on Graphics , 2003
"... We present blue-c, a new immersive projection and 3D video acquisition environment for virtual design and collaboration. It combines simultaneous acquisition of multiple live video streams with advanced 3D projection technology in a CAVE^TM-like environment, creating the impression of total immersio ..."
We present blue-c, a new immersive projection and 3D video acquisition environment for virtual design and collaboration. It combines simultaneous acquisition of multiple live video streams with advanced 3D projection technology in a CAVE^TM-like environment, creating the impression of total immersion. The blue-c portal currently consists of three rectangular projection screens that are built from glass panels containing liquid crystal layers. These screens can be switched from a whitish opaque state (for projection) to a transparent state (for acquisition), which allows the video cameras to "look through" the walls. Our projection technology is based on active stereo using two LCD projectors per screen. The projectors are synchronously shuttered along with the screens, the stereo glasses, active illumination devices, and the acquisition hardware. From multiple video streams, we compute a 3D video representation of the user in real time. The resulting video inlays are integrated into a networked virtual environment. Our design is highly scalable, enabling blue-c to connect to portals with less sophisticated hardware.
Shader Lamps: Animating Real Objects with Image Based Illuminations
by Ramesh Raskar, Kok-lim Low, Greg Welch , 2000
"... We describe a new paradigm for three-dimensional computer graphics, using projectors to graphically animate physical objects in the real world. The idea is to replace a physical object---with its inherent color, texture, and material properties---with a neutral object and projected imagery, reproduc ..."
We describe a new paradigm for three-dimensional computer graphics, using projectors to graphically animate physical objects in the real world. The idea is to replace a physical object---with its inherent color, texture, and material properties---with a neutral object and projected imagery, reproducing the original appearance directly on the object. Furthermore the projected imagery can be used to reproduce alternative appearances, including alternate shading, lighting, and even animation. Because the approach is to effectively "lift" the visual properties of the object into the projector, we call the projectors shader lamps. Some limited effects have previously been demonstrated along these lines for specific applications, however the real challenges to realizing this as a new medium for computer graphics lies in addressing the problems related to complete illumination of nontrivial physical objects. Our approach offers a very compelling method of visualization for a variety of applications including dynamic mechanical and architectural models, animated or "living" dioramas, artistic effects, entertainment, and even general visualization for problems that have meaningful physical shape representations. We present and demonstrate methods for using multiple shader lamps to animate physical objects of varying complexity, from a flower vase, to some wooden blocks, to a model of the Taj Mahal.
...t recently, there is a new trend to use light projectors to render imagery directly in our real physical surroundings. Examples include the Luminous Room [Underkoffler99] and the Office of the Future =-=[Raskar98]-=-. What we are pursuing here is a more complete extension of these ideas—the incorporation of three-dimensional computer graphics and animation directly into the real world all around us. Figure 1: The...
Support For Multitasking and Background Awareness Using Interactive Peripheral Displays
by Blair Macintyre, Elizabeth Mynatt, Stephen Voida, Klaus Hansen, Joe Tullio, Gregory Corso , 2001
"... In this paper, we describe Kimura, an augmented office environment to support conorion multitasking practices. Previous systems, such as Rooms, limit users by constraining the interaction to the desktop monitor. In Kimura, we leverage interactive projected peripheral displays to support the perusal, ..."
In this paper, we describe Kimura, an augmented office environment to support conorion multitasking practices. Previous systems, such as Rooms, limit users by constraining the interaction to the desktop monitor. In Kimura, we leverage interactive projected peripheral displays to support the perusal, manipulation and awareness of background activities. Furthermore, each activity is represented by a montage comprised of images from current and past interaction on the desktop. These montages help remind the user of past actions, and serve as a springboard for ambient context-aware reminders and notifications.
...ous more to a file manager than a task manager. A number of systems have proposed moving 2D documents off the desktop and into the real 3D physical world via headmounted displays [5][6] or projectors =-=[21]-=-[23]. These systems aim to increase the apparently available screen space, capitalize on people's spatial abilities, and leverage the association of virtual information to physical objects. One limita...
A Distributed Graphics System for Large Tiled Displays
by Greg Humphreys, Pat Hanrahan - Proceedings of Visualization '99, IEEE , 1999
"... Recent interest in large displays has led to renewed development of tiled displays, which are comprised of several individual displays arranged in an array and used as one large logical display. Stan-ford's "Interactive Mural " is an example of such a display, using an overlapping four by two array ..."
Recent interest in large displays has led to renewed development of tiled displays, which are comprised of several individual displays arranged in an array and used as one large logical display. Stan-ford's "Interactive Mural " is an example of such a display, using an overlapping four by two array of projectors that back-project onto a diffuse screen to form a 6 ' by 2 ' display area with a resolution of over 60 dpi. Writing software to make effective use of the large display space is a challenge because normal window system inter-action metaphors break down. One promising approach is to switch to immersive applications; another approach, the one we are inves-tigating, is to emulate office, conference room or studio environ-ments which use the space to display a collection of visual material to support group activities. In this paper we describe a virtual graphics system that is de-signed to support multiple simultaneous rendering streams from both local and remote sites. The system abstracts the physical num-ber of computers, graphics subsystems and projectors used to create the display. We provide performance measurements to show that the system scales well and thus supports a variety of different hard-ware configurations. The system is also interesting because it uses transparent "layers, " instead of windows, to manage the screen. 1
... performance of graphics systems, it is now practical to perform this blending step in software. Finally, projects similar to ours are currently underway at Princeton University[2] and UNC Chapel Hill=-=[19]-=-. 3 Design Goals and Implications Our main goal while designing this system was to create a graphics system that effectively virtualized the distributed nature of our display, without sacrificing fami...