Computational imaging with multi-camera time-of-flight systems

Handle URI:
http://hdl.handle.net/10754/621386
Title:
Computational imaging with multi-camera time-of-flight systems
Authors:
Shrestha, Shikhar; Heide, Felix; Heidrich, Wolfgang ( 0000-0002-4227-8508 ) ; Wetzstein, Gordon
Abstract:
Depth cameras are a ubiquitous technology used in a wide range of applications, including robotic and machine vision, human computer interaction, autonomous vehicles as well as augmented and virtual reality. In this paper, we explore the design and applications of phased multi-camera time-of-flight (ToF) systems. We develop a reproducible hardware system that allows for the exposure times and waveforms of up to three cameras to be synchronized. Using this system, we analyze waveform interference between multiple light sources in ToF applications and propose simple solutions to this problem. Building on the concept of orthogonal frequency design, we demonstrate state-of-the-art results for instantaneous radial velocity capture via Doppler time-of-flight imaging and we explore new directions for optically probing global illumination, for example by de-scattering dynamic scenes and by non-line-of-sight motion detection via frequency gating. © 2016 ACM.
KAUST Department:
University of British Columbia and KAUST
Citation:
Shrestha S, Heide F, Heidrich W, Wetzstein G (2016) Computational imaging with multi-camera time-of-flight systems. ACM Transactions on Graphics 35: 1–11. Available: http://dx.doi.org/10.1145/2897824.2925928.
Publisher:
Association for Computing Machinery (ACM)
Conference/Event name:
ACM SIGGRAPH 2016
Issue Date:
11-Jul-2016
DOI:
10.1145/2897824.2925928
Type:
Conference Paper
ISSN:
0730-0301
Sponsors:
National Science Foundation[1553333, 1539120]; Intuitive Surgical; KAUST Office of Sponsored Research; Intel Partnership on Visual and Experiential Computing
Appears in Collections:
Conference Papers

Full metadata record

DC FieldValue Language
dc.contributor.authorShrestha, Shikharen
dc.contributor.authorHeide, Felixen
dc.contributor.authorHeidrich, Wolfgangen
dc.contributor.authorWetzstein, Gordonen
dc.date.accessioned2016-11-03T08:28:05Z-
dc.date.available2016-11-03T08:28:05Z-
dc.date.issued2016-07-11en
dc.identifier.citationShrestha S, Heide F, Heidrich W, Wetzstein G (2016) Computational imaging with multi-camera time-of-flight systems. ACM Transactions on Graphics 35: 1–11. Available: http://dx.doi.org/10.1145/2897824.2925928.en
dc.identifier.issn0730-0301en
dc.identifier.doi10.1145/2897824.2925928en
dc.identifier.urihttp://hdl.handle.net/10754/621386-
dc.description.abstractDepth cameras are a ubiquitous technology used in a wide range of applications, including robotic and machine vision, human computer interaction, autonomous vehicles as well as augmented and virtual reality. In this paper, we explore the design and applications of phased multi-camera time-of-flight (ToF) systems. We develop a reproducible hardware system that allows for the exposure times and waveforms of up to three cameras to be synchronized. Using this system, we analyze waveform interference between multiple light sources in ToF applications and propose simple solutions to this problem. Building on the concept of orthogonal frequency design, we demonstrate state-of-the-art results for instantaneous radial velocity capture via Doppler time-of-flight imaging and we explore new directions for optically probing global illumination, for example by de-scattering dynamic scenes and by non-line-of-sight motion detection via frequency gating. © 2016 ACM.en
dc.description.sponsorshipNational Science Foundation[1553333, 1539120]en
dc.description.sponsorshipIntuitive Surgicalen
dc.description.sponsorshipKAUST Office of Sponsored Researchen
dc.description.sponsorshipIntel Partnership on Visual and Experiential Computingen
dc.publisherAssociation for Computing Machinery (ACM)en
dc.subjectComputational photographyen
dc.titleComputational imaging with multi-camera time-of-flight systemsen
dc.typeConference Paperen
dc.contributor.departmentUniversity of British Columbia and KAUSTen
dc.conference.date2016-07-24 to 2016-07-28en
dc.conference.nameACM SIGGRAPH 2016en
dc.conference.locationAnaheim, CA, USAen
dc.contributor.institutionStanford Universityen
dc.contributor.institutionStanford University and University of British Columbiaen
kaust.authorHeidrich, Wolfgangen
All Items in KAUST are protected by copyright, with all rights reserved, unless otherwise indicated.