Supporting everyday activities for persons with visual impairments through computer vision-augmented touch

Leah Findlater; Lee Stearns; Ruofei Du; Uran Oh; David Ross; Rama Chellappa; Jon E. Froehlich

doi:10.1145/2700648.2811381

Supporting everyday activities for persons with visual impairments through computer vision-augmented touch

Leah Findlater, Lee Stearns, Ruofei Du, Uran Oh, David Ross, Rama Chellappa, Jon E. Froehlich

Department of Computer Science & Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

9 Scopus citations

Abstract

The HandSight project investigates how wearable micro-cameras can be used to augment a blind or visually impaired user's sense of touch with computer vision. Our goal is to support an array of activities of daily living by sensing and feeding back non-tactile information (e.g., color, printed text, patterns) about an object as it is touched. In this poster paper, we provide an overview of the project, our current proof-of-concept prototype, and a summary of findings from finger-based text reading studies. As this is an early-stage project, we also enumerate current open questions.

Original language	English
Title of host publication	ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility
Publisher	Association for Computing Machinery, Inc
Pages	383-384
Number of pages	2
ISBN (Electronic)	9781450334006
DOIs	https://doi.org/10.1145/2700648.2811381
State	Published - 26 Oct 2015
Event	17th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2015 - Lisbon, Portugal Duration: 26 Oct 2015 → 28 Oct 2015

Publication series

Name	ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility

Conference

Conference	17th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2015
Country/Territory	Portugal
City	Lisbon
Period	26/10/15 → 28/10/15

Bibliographical note

Publisher Copyright:
© 2015 ACM.

Keywords

Blind
Computer vision
Vision-augmented touch
Visually impaired
Wearable computing

Access to Document

10.1145/2700648.2811381

Cite this

Findlater, L., Stearns, L., Du, R., Oh, U., Ross, D., Chellappa, R., & Froehlich, J. E. (2015). Supporting everyday activities for persons with visual impairments through computer vision-augmented touch. In ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility (pp. 383-384). (ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility). Association for Computing Machinery, Inc. https://doi.org/10.1145/2700648.2811381

Findlater, Leah ; Stearns, Lee ; Du, Ruofei et al. / Supporting everyday activities for persons with visual impairments through computer vision-augmented touch. ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc, 2015. pp. 383-384 (ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility).

@inproceedings{0d60a51b294d4440a3220948eeba90fb,

title = "Supporting everyday activities for persons with visual impairments through computer vision-augmented touch",

abstract = "The HandSight project investigates how wearable micro-cameras can be used to augment a blind or visually impaired user's sense of touch with computer vision. Our goal is to support an array of activities of daily living by sensing and feeding back non-tactile information (e.g., color, printed text, patterns) about an object as it is touched. In this poster paper, we provide an overview of the project, our current proof-of-concept prototype, and a summary of findings from finger-based text reading studies. As this is an early-stage project, we also enumerate current open questions.",

keywords = "Blind, Computer vision, Vision-augmented touch, Visually impaired, Wearable computing",

author = "Leah Findlater and Lee Stearns and Ruofei Du and Uran Oh and David Ross and Rama Chellappa and Froehlich, {Jon E.}",

note = "Publisher Copyright: {\textcopyright} 2015 ACM.; 17th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2015 ; Conference date: 26-10-2015 Through 28-10-2015",

year = "2015",

month = oct,

day = "26",

doi = "10.1145/2700648.2811381",

language = "English",

series = "ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility",

publisher = "Association for Computing Machinery, Inc",

pages = "383--384",

booktitle = "ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility",

}

Findlater, L, Stearns, L, Du, R, Oh, U, Ross, D, Chellappa, R & Froehlich, JE 2015, Supporting everyday activities for persons with visual impairments through computer vision-augmented touch. in ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility. ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility, Association for Computing Machinery, Inc, pp. 383-384, 17th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2015, Lisbon, Portugal, 26/10/15. https://doi.org/10.1145/2700648.2811381

Supporting everyday activities for persons with visual impairments through computer vision-augmented touch. / Findlater, Leah; Stearns, Lee; Du, Ruofei et al.
ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc, 2015. p. 383-384 (ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Supporting everyday activities for persons with visual impairments through computer vision-augmented touch

AU - Findlater, Leah

AU - Stearns, Lee

AU - Du, Ruofei

AU - Oh, Uran

AU - Ross, David

AU - Chellappa, Rama

AU - Froehlich, Jon E.

PY - 2015/10/26

Y1 - 2015/10/26

N2 - The HandSight project investigates how wearable micro-cameras can be used to augment a blind or visually impaired user's sense of touch with computer vision. Our goal is to support an array of activities of daily living by sensing and feeding back non-tactile information (e.g., color, printed text, patterns) about an object as it is touched. In this poster paper, we provide an overview of the project, our current proof-of-concept prototype, and a summary of findings from finger-based text reading studies. As this is an early-stage project, we also enumerate current open questions.

AB - The HandSight project investigates how wearable micro-cameras can be used to augment a blind or visually impaired user's sense of touch with computer vision. Our goal is to support an array of activities of daily living by sensing and feeding back non-tactile information (e.g., color, printed text, patterns) about an object as it is touched. In this poster paper, we provide an overview of the project, our current proof-of-concept prototype, and a summary of findings from finger-based text reading studies. As this is an early-stage project, we also enumerate current open questions.

KW - Blind

KW - Computer vision

KW - Vision-augmented touch

KW - Visually impaired

KW - Wearable computing

UR - http://www.scopus.com/inward/record.url?scp=84962652559&partnerID=8YFLogxK

U2 - 10.1145/2700648.2811381

DO - 10.1145/2700648.2811381

M3 - Conference contribution

AN - SCOPUS:84962652559

T3 - ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility

SP - 383

EP - 384

BT - ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility

PB - Association for Computing Machinery, Inc

T2 - 17th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2015

Y2 - 26 October 2015 through 28 October 2015

ER -

Findlater L, Stearns L, Du R, Oh U, Ross D, Chellappa R et al. Supporting everyday activities for persons with visual impairments through computer vision-augmented touch. In ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility. Association for Computing Machinery, Inc. 2015. p. 383-384. (ASSETS 2015 - Proceedings of the 17th International ACM SIGACCESS Conference on Computers and Accessibility). doi: 10.1145/2700648.2811381

Supporting everyday activities for persons with visual impairments through computer vision-augmented touch

Abstract

Publication series

Conference

Bibliographical note

Keywords

Access to Document

Fingerprint

Cite this