Doppler time-of-flight imaging

Handle URI:
http://hdl.handle.net/10754/621249
Title:
Doppler time-of-flight imaging
Authors:
Heide, Felix; Wetzstein, Gordon; Hullin, Matthias; Heidrich, Wolfgang ( 0000-0002-4227-8508 )
Abstract:
Over the last few years, depth cameras have become increasingly popular for a range of applications, including human-computer interaction and gaming, augmented reality, machine vision, and medical imaging. Many of the commercially-available devices use the time-of-flight principle, where active illumination is temporally coded and analyzed on the camera to estimate a per-pixel depth map of the scene. In this paper, we propose a fundamentally new imaging modality for all time-of-flight (ToF) cameras: per-pixel velocity measurement. The proposed technique exploits the Doppler effect of objects in motion, which shifts the temporal frequency of the illumination before it reaches the camera. Using carefully coded illumination and modulation frequencies of the ToF camera, object velocities directly map to measured pixel intensities. We show that a slight modification of our imaging system allows for color, depth, and velocity information to be captured simultaneously. Combining the optical flow computed on the RGB frames with the measured metric axial velocity allows us to further estimate the full 3D metric velocity field of the scene. We believe that the proposed technique has applications in many computer graphics and vision problems, for example motion tracking, segmentation, recognition, and motion deblurring.
KAUST Department:
KAUST, Saudi Arabia
Citation:
Heide F, Wetzstein G, Hullin M, Heidrich W (2015) Doppler time-of-flight imaging. ACM SIGGRAPH 2015 Emerging Technologies on - SIGGRAPH ’15. Available: http://dx.doi.org/10.1145/2782782.2792497.
Publisher:
Association for Computing Machinery (ACM)
Journal:
ACM SIGGRAPH 2015 Emerging Technologies on - SIGGRAPH '15
Conference/Event name:
International Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2015
Issue Date:
30-Jul-2015
DOI:
10.1145/2782782.2792497
Type:
Conference Paper
Appears in Collections:
Conference Papers

Full metadata record

DC FieldValue Language
dc.contributor.authorHeide, Felixen
dc.contributor.authorWetzstein, Gordonen
dc.contributor.authorHullin, Matthiasen
dc.contributor.authorHeidrich, Wolfgangen
dc.date.accessioned2016-11-03T06:56:26Z-
dc.date.available2016-11-03T06:56:26Z-
dc.date.issued2015-07-30en
dc.identifier.citationHeide F, Wetzstein G, Hullin M, Heidrich W (2015) Doppler time-of-flight imaging. ACM SIGGRAPH 2015 Emerging Technologies on - SIGGRAPH ’15. Available: http://dx.doi.org/10.1145/2782782.2792497.en
dc.identifier.doi10.1145/2782782.2792497en
dc.identifier.urihttp://hdl.handle.net/10754/621249-
dc.description.abstractOver the last few years, depth cameras have become increasingly popular for a range of applications, including human-computer interaction and gaming, augmented reality, machine vision, and medical imaging. Many of the commercially-available devices use the time-of-flight principle, where active illumination is temporally coded and analyzed on the camera to estimate a per-pixel depth map of the scene. In this paper, we propose a fundamentally new imaging modality for all time-of-flight (ToF) cameras: per-pixel velocity measurement. The proposed technique exploits the Doppler effect of objects in motion, which shifts the temporal frequency of the illumination before it reaches the camera. Using carefully coded illumination and modulation frequencies of the ToF camera, object velocities directly map to measured pixel intensities. We show that a slight modification of our imaging system allows for color, depth, and velocity information to be captured simultaneously. Combining the optical flow computed on the RGB frames with the measured metric axial velocity allows us to further estimate the full 3D metric velocity field of the scene. We believe that the proposed technique has applications in many computer graphics and vision problems, for example motion tracking, segmentation, recognition, and motion deblurring.en
dc.publisherAssociation for Computing Machinery (ACM)en
dc.titleDoppler time-of-flight imagingen
dc.typeConference Paperen
dc.contributor.departmentKAUST, Saudi Arabiaen
dc.identifier.journalACM SIGGRAPH 2015 Emerging Technologies on - SIGGRAPH '15en
dc.conference.date9 August 2015 through 13 August 2015en
dc.conference.nameInternational Conference on Computer Graphics and Interactive Techniques, SIGGRAPH 2015en
dc.contributor.institutionStanford University, United Statesen
dc.contributor.institutionUniversity of British Columbia, Canadaen
dc.contributor.institutionUniversity of Bonn, Germanyen
kaust.authorHeide, Felixen
kaust.authorHeidrich, Wolfgangen
All Items in KAUST are protected by copyright, with all rights reserved, unless otherwise indicated.