Seen music: Ambient music data visualization for children with hearing impairments

Jeeeun Kim, Swamy Ananthanarayan, Tom Yeh

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

8 Scopus citations

Abstract

In this paper, we propose a prototype of music visualization system that captures and records the music component into digital data form, and then displays the data in visual form for children with hearing impairments. The analog sound data of music played physically is scaled into a binary matrix and scalar values that is then used as data structures for transcribing the output. We designed a system that detects tune and speed from a physical violin, and demonstrated three tangible music visualizations that children see in their daily lives, employing a flowerpot, plants and a picture of frame. We describe how the data captured from physical musical instruments can be seen through these objects, and suggest future possibilities for interactive sound visualization in music education for children with hearing impairments. Copyright is held by the owner/author(s).

Original languageEnglish
Title of host publicationProceedings of IDC 2015
Subtitle of host publicationThe 14th International Conference on Interaction Design and Children
PublisherAssociation for Computing Machinery, Inc
Pages426-429
Number of pages4
ISBN (Electronic)9781450335904
DOIs
StatePublished - 21 Jun 2015
Event14th International Conference on Interaction Design and Children, IDC 2015 - Boston, United States
Duration: 21 Jun 201524 Jun 2015

Publication series

NameProceedings of IDC 2015: The 14th International Conference on Interaction Design and Children

Conference

Conference14th International Conference on Interaction Design and Children, IDC 2015
Country/TerritoryUnited States
CityBoston
Period21/06/1524/06/15

Keywords

  • Assistive technology
  • Music education
  • Music visualization

Fingerprint

Dive into the research topics of 'Seen music: Ambient music data visualization for children with hearing impairments'. Together they form a unique fingerprint.

Cite this