Sixth Sense Technology
SixthSense is a usable gestural interface device comprising a neckworn pendant that contains both a data projector and camera. The neckworn projector and camera combination was first proposed by MIT Media Lab student Steve Mann.[1] The concept was further developed by Pranav Mistry, while he was also a student at the MIT Media Lab. Mistry is now a team leader in Samsung Electronics 's Silicon Valley office.
Contents
[hide] * 1 Construction and workings * 2 Example applications * 3 Cost and license * 4 References * 5 External links
-------------------------------------------------
Construction and workings[edit source | editbeta]
Steve Mann and Pranav Mistry with their camera+projector pendants
The SixthSense technology contain a pocket projector, a mirror and a camera contained in a pendant-like, wearable device. Both the projector the camera and sensors are connected to a mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks users ' hand gestures and physical objects using computer-vision based techniques.[2] The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tips of the user’s fingers. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. SixthSense supports multi-touch and multi-user interaction.
-------------------------------------------------
Example applications[edit source | editbeta]
Augmented reality newspaper.
The SixthSense prototype contains a number of demonstration applications. * The map application lets the user navigate a map displayed on a nearby surface using hand gestures to zoom and pan * The drawing application lets the user draw on any
Contents
[hide] * 1 Construction and workings * 2 Example applications * 3 Cost and license * 4 References * 5 External links
-------------------------------------------------
Construction and workings[edit source | editbeta]
Steve Mann and Pranav Mistry with their camera+projector pendants
The SixthSense technology contain a pocket projector, a mirror and a camera contained in a pendant-like, wearable device. Both the projector the camera and sensors are connected to a mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks users ' hand gestures and physical objects using computer-vision based techniques.[2] The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking fiducials) at the tips of the user’s fingers. The movements and arrangements of these fiducials are interpreted into gestures that act as interaction instructions for the projected application interfaces. SixthSense supports multi-touch and multi-user interaction.
-------------------------------------------------
Example applications[edit source | editbeta]
Augmented reality newspaper.
The SixthSense prototype contains a number of demonstration applications. * The map application lets the user navigate a map displayed on a nearby surface using hand gestures to zoom and pan * The drawing application lets the user draw on any
References: edit source | editbeta] 1. ^ IEEE ISWC P. 177 2. ^ Intelligent Image Processing, John Wiley and Sons, 384pp, 02001NOV02, ISBN 0-471-40637-6 3. ^ http://www.ted.com/talks/pranav_mistry_the_thrilling_potential_of_sixthsense_technology.html TED Talks – Pranav Mistry: The thrilling potential of SixthSense technology 4. ^ sixthsense. Pranav Mistry.