Temporal frequency probing for 5D transient analysis of global light transport

Handle URI:
http://hdl.handle.net/10754/556517
Title:
Temporal frequency probing for 5D transient analysis of global light transport
Authors:
O'Toole, Matthew; Heide, Felix; Xiao, Lei; Hullin, Matthias B.; Heidrich, Wolfgang ( 0000-0002-4227-8508 ) ; Kutulakos, Kiriakos N.
Abstract:
We analyze light propagation in an unknown scene using projectors and cameras that operate at transient timescales. In this new photography regime, the projector emits a spatio-temporal 3D signal and the camera receives a transformed version of it, determined by the set of all light transport paths through the scene and the time delays they induce. The underlying 3D-to-3D transformation encodes scene geometry and global transport in great detail, but individual transport components (e.g., direct reflections, inter-reflections, caustics, etc.) are coupled nontrivially in both space and time. To overcome this complexity, we observe that transient light transport is always separable in the temporal frequency domain. This makes it possible to analyze transient transport one temporal frequency at a time by trivially adapting techniques from conventional projector-to-camera transport. We use this idea in a prototype that offers three never-seen-before abilities: (1) acquiring time-of-flight depth images that are robust to general indirect transport, such as interreflections and caustics; (2) distinguishing between direct views of objects and their mirror reflection; and (3) using a photonic mixer device to capture sharp, evolving wavefronts of "light-in-flight".
KAUST Department:
Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Citation:
Temporal frequency probing for 5D transient analysis of global light transport 2014, 33 (4):1 ACM Transactions on Graphics
Publisher:
Association for Computing Machinery (ACM)
Journal:
ACM Transactions on Graphics
Conference/Event name:
41st International Conference and Exhibition on Computer Graphics and Interactive Techniques, ACM SIGGRAPH 2014
Issue Date:
27-Jul-2014
DOI:
10.1145/2601097.2601103
Type:
Conference Paper
ISSN:
07300301
Additional Links:
http://dl.acm.org/citation.cfm?doid=2601097.2601103
Appears in Collections:
Conference Papers; Computer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division

Full metadata record

DC FieldValue Language
dc.contributor.authorO'Toole, Matthewen
dc.contributor.authorHeide, Felixen
dc.contributor.authorXiao, Leien
dc.contributor.authorHullin, Matthias B.en
dc.contributor.authorHeidrich, Wolfgangen
dc.contributor.authorKutulakos, Kiriakos N.en
dc.date.accessioned2015-06-07T22:00:02Zen
dc.date.available2015-06-07T22:00:02Zen
dc.date.issued2014-07-27en
dc.identifier.citationTemporal frequency probing for 5D transient analysis of global light transport 2014, 33 (4):1 ACM Transactions on Graphicsen
dc.identifier.issn07300301en
dc.identifier.doi10.1145/2601097.2601103en
dc.identifier.urihttp://hdl.handle.net/10754/556517en
dc.description.abstractWe analyze light propagation in an unknown scene using projectors and cameras that operate at transient timescales. In this new photography regime, the projector emits a spatio-temporal 3D signal and the camera receives a transformed version of it, determined by the set of all light transport paths through the scene and the time delays they induce. The underlying 3D-to-3D transformation encodes scene geometry and global transport in great detail, but individual transport components (e.g., direct reflections, inter-reflections, caustics, etc.) are coupled nontrivially in both space and time. To overcome this complexity, we observe that transient light transport is always separable in the temporal frequency domain. This makes it possible to analyze transient transport one temporal frequency at a time by trivially adapting techniques from conventional projector-to-camera transport. We use this idea in a prototype that offers three never-seen-before abilities: (1) acquiring time-of-flight depth images that are robust to general indirect transport, such as interreflections and caustics; (2) distinguishing between direct views of objects and their mirror reflection; and (3) using a photonic mixer device to capture sharp, evolving wavefronts of "light-in-flight".en
dc.publisherAssociation for Computing Machinery (ACM)en
dc.relation.urlhttp://dl.acm.org/citation.cfm?doid=2601097.2601103en
dc.rights© ACM, 2014. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in ACM Transactions on Graphics, Volume 33 Issue 4, July 2014. http://doi.acm.org/10.1145/2601097.2601103en
dc.titleTemporal frequency probing for 5D transient analysis of global light transporten
dc.typeConference Paperen
dc.contributor.departmentComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Divisionen
dc.identifier.journalACM Transactions on Graphicsen
dc.conference.date2014-08-10 to 2014-08-14en
dc.conference.name41st International Conference and Exhibition on Computer Graphics and Interactive Techniques, ACM SIGGRAPH 2014en
dc.conference.locationVancouver, BC, CANen
dc.eprint.versionPost-printen
dc.contributor.institutionUniversity of Torontoen
dc.contributor.institutionUniversity of British Columbiaen
dc.contributor.institutionUniversity of Bonnen
kaust.authorHeidrich, Wolfgangen
All Items in KAUST are protected by copyright, with all rights reserved, unless otherwise indicated.