Tracking Eye Movements to Extract Visual Patterns for Better Language Problem-Solving Skills in School-aged Children

Charyeong Kim; Ryunha Lee; Dongsun Yim

doi:10.1145/3772363.3798583

Tracking Eye Movements to Extract Visual Patterns for Better Language Problem-Solving Skills in School-aged Children

Charyeong Kim
, Ryunha Lee
, Dongsun Yim

Department of Communication Disorders

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

This study investigated language problem-solving skills and eye-gaze patterns in children with specific language impairment (SLI) compared to typically developing (TD). Additionally, it verified whether visual cues-designed based on the gaze strategies of high-performing children-could enhance task performance. Thirty elementary grades 1-2 students participated in the study. They performed Language Problem-solving Skills Tasks across four domains: situation, cause, emotion, and problem-solution inference. Tasks were administered under two conditions: with and without visual cues that highlighted key information. Performance accuracy and eye-tracking metrics (AOI fixation duration[%], AOI fixation count, and AOI average fixation duration[ms]) were collected and analyzed during both the question and response phases. The findings demonstrate that visual cues serve as effective scaffolding by guiding attention to core information, thereby enhancing language problem-solving skills in children with SLI. This suggests that interventions providing explicit visual guidance can significantly aid the cognitive and linguistic processing of children with language impairments.

Original language	English
Title of host publication	CHI 2026 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems
Editors	Nuria Oliver, David A. Shamma, Heloisa Candello, Pablo Cesar, Pedro Lopes, Valentino Artizzu, Fiona Draxler, Gustavo Lopez, Anke V. Reinschluessel, Xin Tong, Phoebe O. Toups Dugas
Publisher	Association for Computing Machinery
ISBN (Electronic)	9798400722813
DOIs	https://doi.org/10.1145/3772363.3798583
State	Published - 13 Apr 2026
Event	Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems, CHI 2026 - Barcelona, Spain Duration: 13 Apr 2026 → 17 Apr 2026

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems, CHI 2026
Country/Territory	Spain
City	Barcelona
Period	13/04/26 → 17/04/26

Bibliographical note

Publisher Copyright:
© 2026 Copyright held by the owner/author(s).

Keywords

language problem-solving skills
scaffolding
Specific Language Impaired(SLI)
visual cue

Access to Document

10.1145/3772363.3798583

Cite this

Kim, C., Lee, R., & Yim, D. (2026). Tracking Eye Movements to Extract Visual Patterns for Better Language Problem-Solving Skills in School-aged Children. In N. Oliver, D. A. Shamma, H. Candello, P. Cesar, P. Lopes, V. Artizzu, F. Draxler, G. Lopez, A. V. Reinschluessel, X. Tong, & P. O. Toups Dugas (Eds.), CHI 2026 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems Article 692 (Conference on Human Factors in Computing Systems - Proceedings ). Association for Computing Machinery. https://doi.org/10.1145/3772363.3798583

Kim, Charyeong ; Lee, Ryunha ; Yim, Dongsun. / Tracking Eye Movements to Extract Visual Patterns for Better Language Problem-Solving Skills in School-aged Children. CHI 2026 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems. editor / Nuria Oliver ; David A. Shamma ; Heloisa Candello ; Pablo Cesar ; Pedro Lopes ; Valentino Artizzu ; Fiona Draxler ; Gustavo Lopez ; Anke V. Reinschluessel ; Xin Tong ; Phoebe O. Toups Dugas. Association for Computing Machinery, 2026. (Conference on Human Factors in Computing Systems - Proceedings ).

@inproceedings{9eec99ea9a1e465b9e656d13b6e30a95,

title = "Tracking Eye Movements to Extract Visual Patterns for Better Language Problem-Solving Skills in School-aged Children",

abstract = "This study investigated language problem-solving skills and eye-gaze patterns in children with specific language impairment (SLI) compared to typically developing (TD). Additionally, it verified whether visual cues-designed based on the gaze strategies of high-performing children-could enhance task performance. Thirty elementary grades 1-2 students participated in the study. They performed Language Problem-solving Skills Tasks across four domains: situation, cause, emotion, and problem-solution inference. Tasks were administered under two conditions: with and without visual cues that highlighted key information. Performance accuracy and eye-tracking metrics (AOI fixation duration[\%], AOI fixation count, and AOI average fixation duration[ms]) were collected and analyzed during both the question and response phases. The findings demonstrate that visual cues serve as effective scaffolding by guiding attention to core information, thereby enhancing language problem-solving skills in children with SLI. This suggests that interventions providing explicit visual guidance can significantly aid the cognitive and linguistic processing of children with language impairments.",

keywords = "language problem-solving skills, scaffolding, Specific Language Impaired(SLI), visual cue",

author = "Charyeong Kim and Ryunha Lee and Dongsun Yim",

note = "Publisher Copyright: {\textcopyright} 2026 Copyright held by the owner/author(s).; Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems, CHI 2026 ; Conference date: 13-04-2026 Through 17-04-2026",

year = "2026",

month = apr,

day = "13",

doi = "10.1145/3772363.3798583",

language = "English",

series = "Conference on Human Factors in Computing Systems - Proceedings ",

publisher = "Association for Computing Machinery",

editor = "Nuria Oliver and Shamma, \{David A.\} and Heloisa Candello and Pablo Cesar and Pedro Lopes and Valentino Artizzu and Fiona Draxler and Gustavo Lopez and Reinschluessel, \{Anke V.\} and Xin Tong and \{Toups Dugas\}, \{Phoebe O.\}",

booktitle = "CHI 2026 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems",

}

Kim, C, Lee, R & Yim, D 2026, Tracking Eye Movements to Extract Visual Patterns for Better Language Problem-Solving Skills in School-aged Children. in N Oliver, DA Shamma, H Candello, P Cesar, P Lopes, V Artizzu, F Draxler, G Lopez, AV Reinschluessel, X Tong & PO Toups Dugas (eds), CHI 2026 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems., 692, Conference on Human Factors in Computing Systems - Proceedings , Association for Computing Machinery, Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems, CHI 2026, Barcelona, Spain, 13/04/26. https://doi.org/10.1145/3772363.3798583

Tracking Eye Movements to Extract Visual Patterns for Better Language Problem-Solving Skills in School-aged Children. / Kim, Charyeong; Lee, Ryunha; Yim, Dongsun.
CHI 2026 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems. ed. / Nuria Oliver; David A. Shamma; Heloisa Candello; Pablo Cesar; Pedro Lopes; Valentino Artizzu; Fiona Draxler; Gustavo Lopez; Anke V. Reinschluessel; Xin Tong; Phoebe O. Toups Dugas. Association for Computing Machinery, 2026. 692 (Conference on Human Factors in Computing Systems - Proceedings ).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Tracking Eye Movements to Extract Visual Patterns for Better Language Problem-Solving Skills in School-aged Children

AU - Kim, Charyeong

AU - Lee, Ryunha

AU - Yim, Dongsun

PY - 2026/4/13

Y1 - 2026/4/13

N2 - This study investigated language problem-solving skills and eye-gaze patterns in children with specific language impairment (SLI) compared to typically developing (TD). Additionally, it verified whether visual cues-designed based on the gaze strategies of high-performing children-could enhance task performance. Thirty elementary grades 1-2 students participated in the study. They performed Language Problem-solving Skills Tasks across four domains: situation, cause, emotion, and problem-solution inference. Tasks were administered under two conditions: with and without visual cues that highlighted key information. Performance accuracy and eye-tracking metrics (AOI fixation duration[%], AOI fixation count, and AOI average fixation duration[ms]) were collected and analyzed during both the question and response phases. The findings demonstrate that visual cues serve as effective scaffolding by guiding attention to core information, thereby enhancing language problem-solving skills in children with SLI. This suggests that interventions providing explicit visual guidance can significantly aid the cognitive and linguistic processing of children with language impairments.

AB - This study investigated language problem-solving skills and eye-gaze patterns in children with specific language impairment (SLI) compared to typically developing (TD). Additionally, it verified whether visual cues-designed based on the gaze strategies of high-performing children-could enhance task performance. Thirty elementary grades 1-2 students participated in the study. They performed Language Problem-solving Skills Tasks across four domains: situation, cause, emotion, and problem-solution inference. Tasks were administered under two conditions: with and without visual cues that highlighted key information. Performance accuracy and eye-tracking metrics (AOI fixation duration[%], AOI fixation count, and AOI average fixation duration[ms]) were collected and analyzed during both the question and response phases. The findings demonstrate that visual cues serve as effective scaffolding by guiding attention to core information, thereby enhancing language problem-solving skills in children with SLI. This suggests that interventions providing explicit visual guidance can significantly aid the cognitive and linguistic processing of children with language impairments.

KW - language problem-solving skills

KW - scaffolding

KW - Specific Language Impaired(SLI)

KW - visual cue

UR - https://www.scopus.com/pages/publications/105038096500

U2 - 10.1145/3772363.3798583

DO - 10.1145/3772363.3798583

M3 - Conference contribution

AN - SCOPUS:105038096500

T3 - Conference on Human Factors in Computing Systems - Proceedings

BT - CHI 2026 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems

A2 - Oliver, Nuria

A2 - Shamma, David A.

A2 - Candello, Heloisa

A2 - Cesar, Pablo

A2 - Lopes, Pedro

A2 - Artizzu, Valentino

A2 - Draxler, Fiona

A2 - Lopez, Gustavo

A2 - Reinschluessel, Anke V.

A2 - Tong, Xin

A2 - Toups Dugas, Phoebe O.

PB - Association for Computing Machinery

T2 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems, CHI 2026

Y2 - 13 April 2026 through 17 April 2026

ER -

Kim C, Lee R, Yim D. Tracking Eye Movements to Extract Visual Patterns for Better Language Problem-Solving Skills in School-aged Children. In Oliver N, Shamma DA, Candello H, Cesar P, Lopes P, Artizzu V, Draxler F, Lopez G, Reinschluessel AV, Tong X, Toups Dugas PO, editors, CHI 2026 - Extended Abtracts of the 2026 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery. 2026. 692. (Conference on Human Factors in Computing Systems - Proceedings ). doi: 10.1145/3772363.3798583

Tracking Eye Movements to Extract Visual Patterns for Better Language Problem-Solving Skills in School-aged Children

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Fingerprint

Cite this