Scratch input

Scratch input using geophones (contact microphones) bonded to each fingernail as a musical instrument. The awful sounds generated by running fingernails down the chalkboard are separately pitch-corrected, resulting in a pleasant-sounding musical instrument.

In computing, scratch input is an acoustic-based method of Human-Computer Interaction (HCI) that takes advantage of the characteristic sound produced when a finger nail or other object is dragged over a surface, such as a table or wall. The technique is not limited to fingers; a stick or writing implements (e.g. chalk, or a pen) can also be used. The sound is often inaudible to the naked ear (i.e., silent). However, specialized microphones can digitize the sounds for interactive purposes. Scratch input was invented by Mann et al. in 2007,[1][2][3] though the term was first used by Harrison et al.[4]

History

A natural interface for musical expression operating on scratch input principles was first published and presented in June 2007.[1] Later that year, it was extended to an implementation on a smartphone and also a wearable computer system.[2]

In 2008, the Scratch Input project[4] demonstrated a mobile device input system utilizing scratch input, simultaneously popularizing the term.[5] This system captured audio transmitted through a surface on which a mobile phone was placed, enabling the entire surface to be used as an input device.

Uses

Scratch input is an enabling input technique that is used in multitude of applications. The earliest application was a highly expressive musical instrument (Mann et al.) for use with mobile devices on natural objects, surfaces, or the like, as a non-synthesizing (i.e. idiophonic) musical instrument. Harrison et al.[4] proposed it to create large, ad hoc gestural input areas when mobile devices are rested on tables.

Scratching a stick on bricks and mortar, with vision-assisted gesture recognition. This gives better results than scratch input alone. (Public performance in Toronto, Ontario; image from the 2007 paper.)
Scratch input with ice skates is called a pagophone.[3]

Commercial potential

Microsoft has expressed interested in Scratch Input.[5]

With this we can start to think of every flat surface as an potential input area. If mass produced this sensor could cost less than a dollar....Despite the limitations, the technology holds enough promise to make it into the hands of consumers. It is exciting because it is so low cost. This idea has the potential to go beyond just a research project.

— Daniel Wigdor, User experience architect at Microsoft and curator of the emerging technology demos at SIGGRAPH

See also

References

  1. 1 2 Steve Mann, "Natural Interfaces for Musical Expression: Physiphones and a physics-based organology", Proceedings of the 2007 Conference on New Interfaces for Musical Expression (NIME07), June 6–10, New York, NY, USA.
  2. 1 2 Steve Mann, Ryan Janzen, Raymond Lo, and Chris Aimone, "Inventing new instruments based on a computational `hack' to make a badly tuned or unpitched instrument play in perfect harmony", Proceedings of the 2007 International Computer Music Conference (ICMC2007), August 27–31, Copenhagen.
  3. 1 2 Steve Mann, Ryan Janzen and Raymond Lo, "Hyperacoustic instruments: Computer-controlled instruments that are not electrophones", Proc. International IEEE conference (ICME 2008), Hannover, Germany, June 23–26, 2008.
  4. 1 2 3 Harrison, Chris and Hudson, Scott E. "Scratch Input: Creating Large, Inexpensive, Unpowered and Mobile finger Input Surfaces". In Proceedings of the 21st Annual ACM Symposium on User interface Software and Technology. UIST '08. ACM, New York, NY, 205-208
  5. 1 2 Priya Ganapati (7 August 2009). "To Answer the Phone, Scratch Your Jeans". WIRED.
This article is issued from Wikipedia - version of the 11/28/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.