Browse with me: An online clothes shopping assistantfor people with visual impairments

Abigale J. Stangl, Esha Kothari, Suyog D. Jain, Tom Yeh, Kristen Grauman, Danna Gurari

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

34 Scopus citations

Abstract

Our interviewswithpeoplewhohave visual impairmentsshow clothes shopping is an important activity in their lives. Unfortunately, clothes shopping web sites remain largely inaccessible. We propose design recommendations to address online accessibility issues reported by visually impaired study participants and an implementation, which we call BrowseWithMe, to address these issues. BrowseWithMe employs artificial intelligence to automatically convert a product web page into a structured representation that enables a user to interactively ask the BrowseWithMe system what the user wants to learn abouta product (e.g., Whatis the price? Can I see a magnified image of the pants?). This enables people to be active solicitors of the specific information they are seeking rather than passivelisteners of unparsed information. Experiments demonstrate BrowseWithMe can make online clothes shopping more accessible and produce accurate image descriptions.

Original languageEnglish
Title of host publicationASSETS 2018 - Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility
PublisherAssociation for Computing Machinery, Inc
Pages107-118
Number of pages12
ISBN (Electronic)9781450356503
DOIs
StatePublished - 8 Oct 2018
Event20th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2018 - Galway, Ireland
Duration: 22 Oct 201824 Oct 2018

Publication series

NameASSETS 2018 - Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility

Conference

Conference20th International ACM SIGACCESS Conference on Computers and Accessibility, ASSETS 2018
Country/TerritoryIreland
CityGalway
Period22/10/1824/10/18

Bibliographical note

Funding Information:
We thank study participants and crowd workers for their valuable time. This work is supported by NSF awards to D. G. (IIS-1755593) and K. G. (IIS-1514118) aswellasan Amazon ResearchAwardtoK.G.

Publisher Copyright:
© 2018 Copyright heldby theowner/author(s).

Fingerprint

Dive into the research topics of 'Browse with me: An online clothes shopping assistantfor people with visual impairments'. Together they form a unique fingerprint.

Cite this