What Makes an Object Memorable?

Handle URI:
http://hdl.handle.net/10754/621295
Title:
What Makes an Object Memorable?
Authors:
Dubey, Rachit; Peterson, Joshua; Khosla, Aditya; Yang, Ming-Hsuan; Ghanem, Bernard ( 0000-0002-5534-587X )
Abstract:
Recent studies on image memorability have shed light on what distinguishes the memorability of different images and the intrinsic and extrinsic properties that make those images memorable. However, a clear understanding of the memorability of specific objects inside an image remains elusive. In this paper, we provide the first attempt to answer the question: what exactly is remembered about an image? We augment both the images and object segmentations from the PASCAL-S dataset with ground truth memorability scores and shed light on the various factors and properties that make an object memorable (or forgettable) to humans. We analyze various visual factors that may influence object memorability (e.g. color, visual saliency, and object categories). We also study the correlation between object and image memorability and find that image memorability is greatly affected by the memorability of its most memorable object. Lastly, we explore the effectiveness of deep learning and other computational approaches in predicting object memorability in images. Our efforts offer a deeper understanding of memorability in general thereby opening up avenues for a wide variety of applications. © 2015 IEEE.
KAUST Department:
Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division; Electrical Engineering Program; Visual Computing Center (VCC)
Citation:
Dubey R, Peterson J, Khosla A, Yang M-H, Ghanem B (2015) What Makes an Object Memorable? 2015 IEEE International Conference on Computer Vision (ICCV). Available: http://dx.doi.org/10.1109/ICCV.2015.130.
Publisher:
Institute of Electrical and Electronics Engineers (IEEE)
Journal:
2015 IEEE International Conference on Computer Vision (ICCV)
Conference/Event name:
15th IEEE International Conference on Computer Vision, ICCV 2015
Issue Date:
19-Feb-2016
DOI:
10.1109/ICCV.2015.130
Type:
Conference Paper
Additional Links:
https://ivul.kaust.edu.sa/Documents/Publications/2015/What%20makes%20an%20object%20memorable.pdf; http://ieeexplore.ieee.org/document/7410487/
Appears in Collections:
Conference Papers; Electrical Engineering Program; Visual Computing Center (VCC); Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division

Full metadata record

DC FieldValue Language
dc.contributor.authorDubey, Rachiten
dc.contributor.authorPeterson, Joshuaen
dc.contributor.authorKhosla, Adityaen
dc.contributor.authorYang, Ming-Hsuanen
dc.contributor.authorGhanem, Bernarden
dc.date.accessioned2016-11-03T06:57:04Z-
dc.date.available2016-11-03T06:57:04Z-
dc.date.issued2016-02-19en
dc.identifier.citationDubey R, Peterson J, Khosla A, Yang M-H, Ghanem B (2015) What Makes an Object Memorable? 2015 IEEE International Conference on Computer Vision (ICCV). Available: http://dx.doi.org/10.1109/ICCV.2015.130.en
dc.identifier.doi10.1109/ICCV.2015.130en
dc.identifier.urihttp://hdl.handle.net/10754/621295-
dc.description.abstractRecent studies on image memorability have shed light on what distinguishes the memorability of different images and the intrinsic and extrinsic properties that make those images memorable. However, a clear understanding of the memorability of specific objects inside an image remains elusive. In this paper, we provide the first attempt to answer the question: what exactly is remembered about an image? We augment both the images and object segmentations from the PASCAL-S dataset with ground truth memorability scores and shed light on the various factors and properties that make an object memorable (or forgettable) to humans. We analyze various visual factors that may influence object memorability (e.g. color, visual saliency, and object categories). We also study the correlation between object and image memorability and find that image memorability is greatly affected by the memorability of its most memorable object. Lastly, we explore the effectiveness of deep learning and other computational approaches in predicting object memorability in images. Our efforts offer a deeper understanding of memorability in general thereby opening up avenues for a wide variety of applications. © 2015 IEEE.en
dc.publisherInstitute of Electrical and Electronics Engineers (IEEE)en
dc.relation.urlhttps://ivul.kaust.edu.sa/Documents/Publications/2015/What%20makes%20an%20object%20memorable.pdfen
dc.relation.urlhttp://ieeexplore.ieee.org/document/7410487/en
dc.titleWhat Makes an Object Memorable?en
dc.typeConference Paperen
dc.contributor.departmentComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Divisionen
dc.contributor.departmentElectrical Engineering Programen
dc.contributor.departmentVisual Computing Center (VCC)en
dc.identifier.journal2015 IEEE International Conference on Computer Vision (ICCV)en
dc.conference.date11 December 2015 through 18 December 2015en
dc.conference.name15th IEEE International Conference on Computer Vision, ICCV 2015en
dc.eprint.versionPost-printen
dc.contributor.institutionUniversity of California, Berkeley, United Statesen
dc.contributor.institutionMassachusetts Institute of Technology, United Statesen
dc.contributor.institutionUniversity of California, Merced, United Statesen
kaust.authorDubey, Rachiten
kaust.authorGhanem, Bernarden
All Items in KAUST are protected by copyright, with all rights reserved, unless otherwise indicated.