Using the mediated-reality toolkit, we are creating a window manager for the XWindows system that will overlay xterms and other windows onto planar patches in the environment around the user. The lightspace and graphics-hardware based framework along with EyeTap technology allows realtime tracking, replacement and rendering.
Reality Window Manager (RWM) is an application of Computer Mediated Reality in which computer information is displayed in the real-world, attached to real-world objects.
The image above depicts the concept of RWM (Reality Window Manager) where
the billboard has been replaced by a web browser. Click the images for a video,
processed using videoorbits to both register the computer content and
interpolate motion between images.