Fujitsu Laboratories has developed a next generation user interface which can accurately detect the users finger and what it is touching, creating an interactive touchscreen-like system, using objects in the real word.”We think paper and many other objects could be manipulated by touching them, as with a touchscreen. This system doesnt use any special hardware; it consists of just a device like an ordinary webcam, plus a commercial projector. Its capabilities are achieved by image processing technology.”Using this technology, information can be imported from a document as data, by selecting the necessary parts with your finger.This technology measures the shape of real-world objects, and automatically adjusts the coordinate systems for the camera, projector, and real world. In this way, it can coordinate the display with touching, not only for flat surfaces like tables and paper, but also for the curved surfaces of objects such as books.

via Touchscreen interface for seamless data transfer between the real and virtual worlds – DigInfo TV.