| Rekimoto |

Augmented Surfaces: A Spatially Continuous Workspace for Hybrid Computing Environments

"Augmented Surfaces" is a computer augmented environment that allows users to smoothly interchange digital information among their portable computers, table and wall displays, and other physical objects. Supported by a camera-based object recognition system, users can easily integrate their portable computers with the pre-installed ones in the environment. Users can use displays projected on tables and walls as a spatially continuous extension of their portable computers. Using an interaction technique called hyperdragging or pick&drop (pick&beam), users can transfer information from one computer to another, by only knowing the physical relationship between them. We also provide a mechanism for attaching digital data to physical objects, such as a videotape or a document folder, to link physical and digital spaces.

Evolution of augmented direct manipulation environments: (a) A user can perform individual tasks with a portable computer. (b) The table becomes an extension of the portable computer. (c) Pre-installed computer displays (table and wall) also serve as shared workspaces for collaborative tasks.


(a)

(b)

(c)

Hyperdragging: A direct manipulation technique for moving information across the boundary of computers and surfaces. (a) A user can start moving an object on a computer in the normal manner by dragging it with the pointing device. (b) When the cursor reaches the edge of the screen, it ``jumps'' to the table surface. (c) The user can also drop an item on a physical object, such as a VCR tape, to make a link between real and virtual objects.

Capturing an image of the real object, then Hyperdragging it.

"HyperDragging" is now used in Sony VAIO-U as FlyingPointer


Pick-and-Drop by a laser pointer allows a user to smoothly transfer data between table and wall.

Digital Attachment: attaching digital data to real things.


PropCamera is used to create a 3D view of the furniture layout

Other (large) images


Baseball Watching Station


  • Video used in CHI'99 presentation (3'14") MPEG Full Size (33MB), QuickTime 160x120 10fps (8MB)
  • Jun Rekimoto and Masanori Saitoh, "Augmented Surfaces: A Spatially Continuous Workspace for Hybrid Computing Environments", Proceedings of CHI'99, 1999. PDF
  • HyperDragging is used in Sony VAIO-U, as FlyingPointer
  • | Rekimoto | AugSurfaces |