Bridging Literacy with AI: AI-Integrated Digital Textbook for Deaf and Hard-of-Hearing Students

Ga Young Lee, Seonhee Na, Kyuwon Kim, Hyo Jeong So

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Deaf and hard-of-hearing (DHH) students often experience delays in print literacy due to limited access to spoken language. This study developed a prototype of an AI-integrated digital textbook (AIDT) for Korean language learning, which incorporated visual learning materials and simplified versions of complex texts to enhance accessibility and support reading comprehension. Personalized instruction tailored to individual needs was also embedded, based on insights gathered through prior participatory design phases. A usability test was conducted with six DHH students and four teachers using five learning tasks. The results revealed both the strengths and limitations of the AIDT prototype. Students appreciated the interactive and visually rich features by reporting increased engagement and a greater sense of independence in their learning. However, they encountered challenges related to insufficient sign language support and a non-intuitive interface. Teachers recognized the potential of AIDT to reduce instructional workload and to promote self-directed and personalized learning. At the same time, they emphasized the need for clearer navigation features to better track student learning progress. These findings suggest that AIDTs can be a valuable tool for supporting Korean language learning among DHH students when designed with accessibility and usability in mind. We propose future research directions that include refining the interface design, enhancing sign language scaffolding, improving navigation features, and exploring classroom integration to better support the diverse learning needs of DHH students.

Original languageEnglish
Title of host publicationProceedings - 24th Annual ACM Interaction Design and Children Conference, IDC 2025
PublisherAssociation for Computing Machinery, Inc
Pages821-825
Number of pages5
ISBN (Electronic)9798400714733
DOIs
StatePublished - 23 Jun 2025
Event24th Annual ACM Interaction Design and Children Conference, IDC 2025 - Reykjavik, Iceland
Duration: 23 Jun 202526 Jun 2025

Publication series

NameProceedings - 24th Annual ACM Interaction Design and Children Conference, IDC 2025

Conference

Conference24th Annual ACM Interaction Design and Children Conference, IDC 2025
Country/TerritoryIceland
CityReykjavik
Period23/06/2526/06/25

Bibliographical note

Publisher Copyright:
© 2025 Copyright held by the owner/author(s).

Keywords

  • AI digital textbooks (AIDT)
  • Deaf and hard-of-hearing (DHH) learners
  • print literacy
  • usability test

Fingerprint

Dive into the research topics of 'Bridging Literacy with AI: AI-Integrated Digital Textbook for Deaf and Hard-of-Hearing Students'. Together they form a unique fingerprint.

Cite this