Exploring the design space of an augmented display for conveying facial expressions for people with autism

Seunga Chung, Uran Oh

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Facial expression is considered as the most intuitive and effective way of conveying one's emotion among other nonverbal interactions.However, people with autism have limited access to this rich communication channel due to their inability to read facial expressions. To help them be aware of others' emotions, we developed a CNN-based facial expression recognition system using Microsoft Hololens and explored three different modes for displaying facial expressions of a conversation partner varying the levels of explicitness. Subjective feedback from a preliminary study with 6 pilot participants suggests that each mode is worth investigating for serving people with various needs and preferences who wish to receive augmented visual hints on others' emotion.

Original languageEnglish
Title of host publicationAdjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages435-437
Number of pages3
ISBN (Electronic)9781728147659
DOIs
StatePublished - Oct 2019
Event18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019 - Beijing, China
Duration: 14 Oct 201918 Oct 2019

Publication series

NameAdjunct Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019

Conference

Conference18th IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2019
Country/TerritoryChina
CityBeijing
Period14/10/1918/10/19

Bibliographical note

Publisher Copyright:
© 2019 IEEE.

Keywords

  • Autism
  • Emotion-recognition
  • Facial-expressions
  • Mixed-reality

Fingerprint

Dive into the research topics of 'Exploring the design space of an augmented display for conveying facial expressions for people with autism'. Together they form a unique fingerprint.

Cite this