Cocomix: Utilizing Comments to Improve Non-Visual Webtoon Accessibility

Mina Huh, Yun Jung Lee, Dasom Choi, Haesoo Kim, Uran Oh, Juho Kim

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

5 Scopus citations

Abstract

Webtoon is a type of digital comics read online where readers can leave comments to share their thoughts on the story. While it has experienced a surge in popularity internationally, people with visual impairments cannot enjoy webtoon with the lack of an accessible format. While traditional image description practices can be adopted, resulting descriptions cannot preserve webtoons' unique values such as control over the reading pace and social engagement through comments. To improve the webtoon reading experience for BLV users, we propose Cocomix, an interactive webtoon reader that leverages comments into the design of novel webtoon interactions. Since comments can identify story highlights and provide additional context, we designed a system that provides 1) comments-based adaptive descriptions with selective access to details and 2) panel-anchored comments for easy access to relevant descriptive comments. Our evaluation (N=12) showed that Cocomix users could adapt the description for various needs and better utilize comments.

Original languageEnglish
Title of host publicationCHI 2022 - Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450391573
DOIs
StatePublished - 29 Apr 2022
Event2022 CHI Conference on Human Factors in Computing Systems, CHI 2022 - Virtual, Online, United States
Duration: 30 Apr 20225 May 2022

Publication series

NameConference on Human Factors in Computing Systems - Proceedings

Conference

Conference2022 CHI Conference on Human Factors in Computing Systems, CHI 2022
Country/TerritoryUnited States
CityVirtual, Online
Period30/04/225/05/22

Bibliographical note

Funding Information:
dance of descriptive comments, there exist barriers to fully utilize comments. First, comments are inherently unstructured. Sentences that are incomplete or conveying meanings with emojis have the risk of misunderstanding [71]. Second, echoing the C4 distilled from the formative study, it is difcult to locate descriptive sentences as the majority of comments are non-descriptive, or lack a clear reference target. With no fltering feature supported by the platform, BLV readers go through many non-descriptive sentences to fnd a useful comment. Third, the presentation order of comments is not helpful for utilizing comments as descriptions. Most platforms only provide the sorting of comments by the number of likes or the time uploaded. Consequently, descriptive comments are not presented as the story order and users cannot selectively read comments relevant to the panel of their interest.

Publisher Copyright:
© 2022 ACM.

Keywords

  • Accessibility
  • Comments
  • Digital comics
  • Image description
  • Webtoons

Fingerprint

Dive into the research topics of 'Cocomix: Utilizing Comments to Improve Non-Visual Webtoon Accessibility'. Together they form a unique fingerprint.

Cite this