Preview

Skinput Technology

Good Essays
Open Document
Open Document
8326 Words
Grammar
Grammar
Plagiarism
Plagiarism
Writing
Writing
Score
Score
Skinput Technology
Skinput: Appropriating the Body as an Input Surface
Chris Harrison1,2, Desney Tan2, Dan Morris2 Human-Computer Interaction Institute Carnegie Mellon University 5000 Forbes Avenue, Pittsburgh, PA 15213 chris.harrison@cs.cmu.edu
ABSTRACT
1

Microsoft Research One Microsoft Way Redmond, WA 98052 {desney, dan}@microsoft.com propriated surfaces with them (at this point, one might as well just have a larger device). However, there is one surface that has been previous overlooked as an input canvas, and one that happens to always travel with us: our skin. Appropriating the human body as an input device is appealing not only because we have roughly two square meters of external surface area, but also because much of it is easily accessible by our hands (e.g., arms, upper legs, torso). Furthermore, proprioception – our sense of how our body is configured in three-dimensional space – allows us to accurately interact with our bodies in an eyes-free manner. For example, we can readily flick each of our fingers, touch the tip of our nose, and clap our hands together without visual assistance. Few external input devices can claim this accurate, eyes-free input characteristic and provide such a large interaction area. In this paper, we present our work on Skinput – a method that allows the body to be appropriated for finger input using a novel, non-invasive, wearable bio-acoustic sensor. The contributions of this paper are: 1) We describe the design of a novel, wearable sensor for bio-acoustic signal acquisition (Figure 1). 2) We describe an analysis approach that enables our system to resolve the location of finger taps on the body.

2

We present Skinput, a technology that appropriates the human body for acoustic transmission, allowing the skin to be used as an input surface. In particular, we resolve the location of finger taps on the arm and hand by analyzing mechanical vibrations that propagate through the body. We collect these signals using a novel array of



References: 1. Ahmad, F., and Musilek, P. A Keystroke and Pointer Control Input Interface for Wearable Computers. In Proc. IEEE PERCOM ’06, 2-11. 2. Amento, B., Hill, W., and Terveen, L. The Sound of One Hand: A Wrist-mounted Bio-acoustic Fingertip Gesture Interface. In CHI ‘02 Ext. Abstracts, 724-725. 3. Argyros, A.A., and Lourakis, M.I.A. Vision-based Interpretation of Hand Gestures for Remote Control of a Computer Mouse. In Proc. ECCV 2006 Workshop on Computer Vision in HCI, LNCS 3979, 40-51. 4. Burges, C.J. A Tutorial on Support Vector Machines for Pattern Recognition. Data Mining and Knowledge Discovery, 2.2, June 1998, 121-167. 5. Clinical Guidelines on the Identification, Evaluation, and Treatment of Overweight and Obesity in Adults. National Heart, Lung and Blood Institute. Jun. 17, 1998. 6. Deyle, T., Palinko, S., Poole, E.S., and Starner, T. Hambone: A Bio-Acoustic Gesture Interface. In Proc. ISWC '07. 1-8. 7. Erol, A., Bebis, G., Nicolescu, M., Boyle, R.D., and Twombly, X. Vision-based hand pose estimation: A review. Computer Vision and Image Understanding. 108, Oct., 2007. 8. Fabiani, G.E. McFarland, D.J. Wolpaw, J.R. and Pfurtscheller, G. Conversion of EEG activity into cursor movement by a brain-computer interface (BCI). IEEE Trans. on Neural Systems and Rehabilitation Engineering, 12.3, 331-8. Sept. 2004. 9. Grimes, D., Tan, D., Hudson, S.E., Shenoy, P., and Rao, R. Feasibility and pragmatics of classifying working memory load with an electroencephalograph. Proc. CHI ’08, 835-844. 10. Harrison, C., and Hudson, S.E. Scratch Input: Creating Large, Inexpensive, Unpowered and Mobile finger Input Surfaces. In Proc. UIST ’08, 205-208. 11. Hirshfield, L.M., Solovey, E.T., Girouard, A., Kebinger, J., Jacob, R.J., Sassaroli, A., and Fantini, S. Brain measurement for usability testing and adaptive interfaces: an example of uncovering syntactic workload with functional near infrared spectroscopy. In Proc. CHI ’09, 2185-2194. 12. Ishii, H., Wisneski, C., Orbanes, J., and Chun, B., Paradiso, J. PingPongPlus: design of an athletic-tangible interface for computer-supported cooperative play. Proc. CHI ’99, 394-401. 13. Lakshmipathy, V., Schmandt, C., and Marmasse, N. TalkBack: a conversational answering machine. In Proc. UIST ’03, 41-50. 14. Lee, J.C., and Tan, D.S. Using a low-cost electroencephalograph for task classification in HCI research. In Proc. CHI ’06, 81-90. 15. Lyons, K., Skeels, C., Starner, T., Snoeck, C. M., Wong, B.A., and Ashbrook, D. Augmenting conversations using dualpurpose speech. In Proc. UIST ’04. 237-246. 16. Mandryk, R.L., and Atkins, M.S. A Fuzzy Physiological Approach for Continuously Modeling Emotion During Interaction with Play Environments. Intl Journal of Human-Computer Studies, 6(4), 329-347, 2007. 17. Mandryk, R.L., Inkpen, K.M., and Calvert, T.W. Using Psychophysiological Techniques to Measure User Experience with Entertainment Technologies. Behaviour and Information Technology, 25(2), 141-58, March 2006. 18. McFarland, D.J., Sarnacki, W.A., and Wolpaw, J.R. Brain– computer interface (BCI) operation: optimizing information transfer rates. Biological Psychology, 63(3), 237-51. Jul 2003. 19. Mistry, P., Maes, P., and Chang, L. WUW - wear Ur world: a wearable gestural interface. In CHI ‘09 Ext. Abst., 4111-4116. 20. Moore, M., and Dua, U. A galvanic skin response interface for people with severe motor disabilities. In Proc. ACM SIGACCESS Accessibility and Comp. ‘04, 48-54. 21. Paradiso, J.A., Leo, C.K., Checka, N., and Hsiao, K. Passive acoustic knock tracking for interactive windows. In CHI ‘02 Extended Abstracts, 732-733. 22. Post, E.R. and Orth, M. Smart Fabric, or “Wearable Clothing.” In Proc. ISWC ’97, 167. 23. Rosenberg, R. The biofeedback Pointer: EMG Control of a Two Dimensional Pointer. In Proc. ISWC ’98, 4-7. 24. Saponas, T.S., Tan, D.S., Morris, D., and Balakrishnan, R. Demonstrating the feasibility of using forearm electromyography for muscle-computer interfaces. In Proc. CHI ’09, 515-24. 25. Sturman, D.J. and Zeltzer, D. A Survey of Glove-based Input. IEEE Comp Graph and Appl, 14.1, Jan 1994. 26. Wilson, A. PlayAnywhere: a compact interactive tabletop projection-vision system. In Proc. UIST ‘05, 83-92. 27. Wilson, A.D. Robust computer vision-based detection of pinching for one and two-handed gesture input. In Proc. UIST ’06, 255-258. 28. Witten, I.H. and Frank, E. Data Mining: Practical machine learning tools and techniques, 2nd Edition, Morgan Kaufmann, San Francisco, 2005.

You May Also Find These Documents Helpful

  • Powerful Essays

    In this part of the assignment I will be reflecting on the specialist input (e) design I have designed. I have designed a keyboard which has Braille keys, for the purpose of the people who are blind, as this keyboard will be an advantage for the blind which means that they will not be isolated just because they are blind, but in fact using this keyboard the blind can continue their daily lives like others going to work and schools etc. One of the Fundamental principles of HCI is that the user has ease of use, and I have applied this principle in my design allows people to type on the keyboard with ease.…

    • 1959 Words
    • 8 Pages
    Powerful Essays
  • Good Essays

    Midijam System Overview

    • 617 Words
    • 3 Pages

    References: [1] Emerging Frameworks for Tangible User Interfaces, IBM System Journal. [2] Livid, www.lividinstruments.com [3] Arduino. www.arduino.cc [4] Ableton Live, www.ableton.com [5] Cycling 74, www.cycling.74.com [6] THE MIDI MANUAL-A Practical Guide to MIDI in the Project Studio,Third Edition [7] DMX512, www.usitt.org…

    • 617 Words
    • 3 Pages
    Good Essays
  • Satisfactory Essays

    Week 5 Assignment 1

    • 545 Words
    • 2 Pages

    7. Animate: The laptop can talk and respond to its user and recognize the user with facial recognition.…

    • 545 Words
    • 2 Pages
    Satisfactory Essays
  • Good Essays

    Tupac Shakur: The Speeder

    • 556 Words
    • 3 Pages

    Now, there are some companies working to develop artificial limb. One of them is Touch Bionic. Its i-Limb Pulse bionic hand can read the electric pulse in patient’s arm and then transforms the signals into finger movement.…

    • 556 Words
    • 3 Pages
    Good Essays
  • Better Essays

    Tiger Siberian Tiger

    • 6105 Words
    • 25 Pages

    The tiger (Panthera tigris), a member of the Felidae family, is the largest of the four "big cats" in the genus Panthera.[4] The tiger is native to much of eastern and southern Asia, and is an apex predator and an obligate carnivore. The larger tiger subspecies are comparable in size to the biggest extinct felids,[5][6] reaching up to 3.3 metres (11 ft) in total length, weighing up to 300 kilograms (660 pounds), and having canines up to 4 inches (100 mm) long.[7] Aside from their great bulk and power, their most recognisable feature is a pattern of dark vertical stripes that overlays near-white to reddish-orange fur, with lighter underparts. The most numerous tiger subspecies is the Bengal tiger, while the largest is the Siberian tiger.…

    • 6105 Words
    • 25 Pages
    Better Essays
  • Good Essays

    Gestural Communication involves the use of body language, eye contact and hand gestures to get the message across to the patient. `…

    • 3305 Words
    • 14 Pages
    Good Essays
  • Satisfactory Essays

    Intro to Computers

    • 340 Words
    • 2 Pages

    Name and describe three special-purpose input devices people commonly use in public places, such as stores, banks, and libraries. [RQ, no. 4]…

    • 340 Words
    • 2 Pages
    Satisfactory Essays
  • Good Essays

    Tacit Research Paper

    • 424 Words
    • 2 Pages

    Tacit or, in a more formal name, “Hand Mounted Haptic Feedback Sonar Obstacle Avoidance Assistive Device,” is a product made especially for the blind or for people who have vision problems. It calculates the distance to objects in front of them and translates that into pressure on the wrist. It’s wrist mounted and senses things from about 1 inch (2 cm) to 10 feet (3.5m). This device has generally fast response time (fractions of a second) to quickly navigate complex surroundings. It is designed to facilitate a vision impaired person to get around complex environments. Installed to the back of the hand, the force feedback means it does not interfere with other assistive devices that install elsewhere and use audio feedback cues. The learning curve is measured in seconds, everyone who has worn it has figured it out immediately.…

    • 424 Words
    • 2 Pages
    Good Essays
  • Good Essays

    No more woof

    • 728 Words
    • 3 Pages

    The EEG readings are then analyzed by a Raspberry Pi microcomputer, which will, according to NSID, be programmed to translate those EEG readings into simple phrases like, "I'm hungry," or "Who is that person?" Once translated, those phrases will be reported over a small speaker.…

    • 728 Words
    • 3 Pages
    Good Essays
  • Powerful Essays

    Paper VS Electronic Media

    • 1727 Words
    • 7 Pages

    Paper vs. Electronic Media: Work Efficiency and Environmental Impact Hirohito Shibata; Fuji Xerox Co., Ltd., 6-1 Minatomirai, Nishi-ku, Yokohama, Kanagawa, 220-8668, Japan Abstract Table 1. CO2 emissions per unit quantity for each product This presentation quantitatively compares paper and electronic media from the perspectives of CO2 emissions and work efficiency. Should we reject paper out of hand based on environmental considerations?…

    • 1727 Words
    • 7 Pages
    Powerful Essays
  • Best Essays

    Health Care Interface Design

    • 3501 Words
    • 15 Pages

    Healthcare interface design is one of the important aspects many researchers are focusing on over the past decades. It is increasingly supported by multiple technologies including human computer…

    • 3501 Words
    • 15 Pages
    Best Essays
  • Better Essays

    Keyboard as an Input Device

    • 3719 Words
    • 15 Pages

    The keyboard is the most common and widely used input device.Using a keyboard for too long can lead to health problems such as repetitive strain injury (RSI).To try to overcome this, different styles of keyboard have been developed, for example, the ergonomic keyboard. They are supposed to put your hands into a much more natural position than a traditional keyboard.…

    • 3719 Words
    • 15 Pages
    Better Essays
  • Powerful Essays

    Brain Based Learning

    • 1436 Words
    • 6 Pages

    Huitt, W. (2003). The Information Processing Approach to Cognition. Retrieved December 29, 2009, from Valdosta State University: http://chiron.valdosta.edu/whuitt/col/cogsys/infoproc.html…

    • 1436 Words
    • 6 Pages
    Powerful Essays
  • Powerful Essays

    IMPLEMENTATION OF THE COMPREHENSIVE AGRARIAN REFORM PROGRAM IN THE MUNICIPALITIES OF PRESIDENT ROXAS, DUMALAG AND SAPIAN, CAPIZ Anthony P. Arostique MPA Colegio Dela Purisima Concepcion Roxas City, Capiz, Philippines…

    • 2122 Words
    • 9 Pages
    Powerful Essays
  • Powerful Essays

    INFORMATION TECHNOLOGIES

    • 13498 Words
    • 69 Pages

    Botta-Genoulaz, V., Millet, P. A., & Grabot , B. (2005). A Survey on the Recent Research Literature on…

    • 13498 Words
    • 69 Pages
    Powerful Essays