A picture is worth a thousand keywords: Image-based object search on a mobile platform

Tom Yeh; Kristen Grauman; Konrad Tollmar; Trevor Darrell

doi:10.1145/1056808.1057083

A picture is worth a thousand keywords: Image-based object search on a mobile platform

Tom Yeh, Kristen Grauman, Konrad Tollmar, Trevor Darrell

Department of Psychology

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

37 Scopus citations

Abstract

Finding information based on an object's visual appearance is useful when specific keywords for the object are not known. We have developed a mobile image-based search system that takes images of objects as queries and finds relevant web pages by matching them to similar images on the web. Image-based search works well when matching full scenes, such as images of buildings or landmarks, and for matching objects when the boundary of the object in the image is available. We demonstrate the effectiveness of a simple interactive paradigm for obtaining a segmented object boundary, and show how a shape-based image matching algorithm can use the object outline to find similar images on the web.

Original language	English
Title of host publication	CHI'05 Extended Abstracts on Human Factors in Computing Systems, CHI EA'05
Pages	2025-2028
Number of pages	4
DOIs	https://doi.org/10.1145/1056808.1057083
State	Published - 2005
Event	Conference on Human Factors in Computing Systems, CHI EA 2005 - Portland, OR, United States Duration: 2 Apr 2005 → 7 Apr 2005

Publication series

Name	Conference on Human Factors in Computing Systems - Proceedings

Conference

Conference	Conference on Human Factors in Computing Systems, CHI EA 2005
Country/Territory	United States
City	Portland, OR
Period	2/04/05 → 7/04/05

Keywords

Content-based image retrieval
Interactive segmentation
Mobile interface
Object recognition

Access to Document

10.1145/1056808.1057083

Cite this

@inproceedings{e4950409c4c645278610db3abad248a9,

title = "A picture is worth a thousand keywords: Image-based object search on a mobile platform",

abstract = "Finding information based on an object's visual appearance is useful when specific keywords for the object are not known. We have developed a mobile image-based search system that takes images of objects as queries and finds relevant web pages by matching them to similar images on the web. Image-based search works well when matching full scenes, such as images of buildings or landmarks, and for matching objects when the boundary of the object in the image is available. We demonstrate the effectiveness of a simple interactive paradigm for obtaining a segmented object boundary, and show how a shape-based image matching algorithm can use the object outline to find similar images on the web.",

keywords = "Content-based image retrieval, Interactive segmentation, Mobile interface, Object recognition",

author = "Tom Yeh and Kristen Grauman and Konrad Tollmar and Trevor Darrell",

year = "2005",

doi = "10.1145/1056808.1057083",

language = "English",

isbn = "1595930027",

series = "Conference on Human Factors in Computing Systems - Proceedings",

pages = "2025--2028",

booktitle = "CHI'05 Extended Abstracts on Human Factors in Computing Systems, CHI EA'05",

note = "Conference on Human Factors in Computing Systems, CHI EA 2005 ; Conference date: 02-04-2005 Through 07-04-2005",

}

Yeh, T, Grauman, K, Tollmar, K & Darrell, T 2005, A picture is worth a thousand keywords: Image-based object search on a mobile platform. in CHI'05 Extended Abstracts on Human Factors in Computing Systems, CHI EA'05. Conference on Human Factors in Computing Systems - Proceedings, pp. 2025-2028, Conference on Human Factors in Computing Systems, CHI EA 2005, Portland, OR, United States, 2/04/05. https://doi.org/10.1145/1056808.1057083

A picture is worth a thousand keywords: Image-based object search on a mobile platform. / Yeh, Tom; Grauman, Kristen; Tollmar, Konrad et al.
CHI'05 Extended Abstracts on Human Factors in Computing Systems, CHI EA'05. 2005. p. 2025-2028 (Conference on Human Factors in Computing Systems - Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A picture is worth a thousand keywords

T2 - Conference on Human Factors in Computing Systems, CHI EA 2005

AU - Yeh, Tom

AU - Grauman, Kristen

AU - Tollmar, Konrad

AU - Darrell, Trevor

PY - 2005

Y1 - 2005

N2 - Finding information based on an object's visual appearance is useful when specific keywords for the object are not known. We have developed a mobile image-based search system that takes images of objects as queries and finds relevant web pages by matching them to similar images on the web. Image-based search works well when matching full scenes, such as images of buildings or landmarks, and for matching objects when the boundary of the object in the image is available. We demonstrate the effectiveness of a simple interactive paradigm for obtaining a segmented object boundary, and show how a shape-based image matching algorithm can use the object outline to find similar images on the web.

AB - Finding information based on an object's visual appearance is useful when specific keywords for the object are not known. We have developed a mobile image-based search system that takes images of objects as queries and finds relevant web pages by matching them to similar images on the web. Image-based search works well when matching full scenes, such as images of buildings or landmarks, and for matching objects when the boundary of the object in the image is available. We demonstrate the effectiveness of a simple interactive paradigm for obtaining a segmented object boundary, and show how a shape-based image matching algorithm can use the object outline to find similar images on the web.

KW - Content-based image retrieval

KW - Interactive segmentation

KW - Mobile interface

KW - Object recognition

UR - http://www.scopus.com/inward/record.url?scp=34948879563&partnerID=8YFLogxK

U2 - 10.1145/1056808.1057083

DO - 10.1145/1056808.1057083

M3 - Conference contribution

AN - SCOPUS:34948879563

SN - 1595930027

SN - 9781595930026

T3 - Conference on Human Factors in Computing Systems - Proceedings

SP - 2025

EP - 2028

BT - CHI'05 Extended Abstracts on Human Factors in Computing Systems, CHI EA'05

Y2 - 2 April 2005 through 7 April 2005

ER -

A picture is worth a thousand keywords: Image-based object search on a mobile platform

Abstract

Publication series

Conference

Keywords

Access to Document

Fingerprint

Cite this