TY - GEN
T1 - Seen music
T2 - 14th International Conference on Interaction Design and Children, IDC 2015
AU - Kim, Jeeeun
AU - Ananthanarayan, Swamy
AU - Yeh, Tom
PY - 2015/6/21
Y1 - 2015/6/21
N2 - In this paper, we propose a prototype of music visualization system that captures and records the music component into digital data form, and then displays the data in visual form for children with hearing impairments. The analog sound data of music played physically is scaled into a binary matrix and scalar values that is then used as data structures for transcribing the output. We designed a system that detects tune and speed from a physical violin, and demonstrated three tangible music visualizations that children see in their daily lives, employing a flowerpot, plants and a picture of frame. We describe how the data captured from physical musical instruments can be seen through these objects, and suggest future possibilities for interactive sound visualization in music education for children with hearing impairments. Copyright is held by the owner/author(s).
AB - In this paper, we propose a prototype of music visualization system that captures and records the music component into digital data form, and then displays the data in visual form for children with hearing impairments. The analog sound data of music played physically is scaled into a binary matrix and scalar values that is then used as data structures for transcribing the output. We designed a system that detects tune and speed from a physical violin, and demonstrated three tangible music visualizations that children see in their daily lives, employing a flowerpot, plants and a picture of frame. We describe how the data captured from physical musical instruments can be seen through these objects, and suggest future possibilities for interactive sound visualization in music education for children with hearing impairments. Copyright is held by the owner/author(s).
KW - Assistive technology
KW - Music education
KW - Music visualization
UR - http://www.scopus.com/inward/record.url?scp=84961875603&partnerID=8YFLogxK
U2 - 10.1145/2771839.2771870
DO - 10.1145/2771839.2771870
M3 - Conference contribution
AN - SCOPUS:84961875603
T3 - Proceedings of IDC 2015: The 14th International Conference on Interaction Design and Children
SP - 426
EP - 429
BT - Proceedings of IDC 2015
PB - Association for Computing Machinery, Inc
Y2 - 21 June 2015 through 24 June 2015
ER -