Towards transient imaging at interactive rates with single-photon detectors

Type
Conference Paper

Authors
Lindell, David B.
O'Toole, Matthew
Wetzstein, Gordon

Online Publication Date
2018-05-31

Print Publication Date
2018-05

Date
2018-05-31

Abstract
Active imaging at the picosecond timescale reveals transient light transport effects otherwise not accessible by computer vision and image processing algorithms. For example, analyzing the time of flight of short laser pulses emitted into a scene and scattered back to a detector allows for depth imaging, which is crucial for autonomous driving and many other applications. Moreover, analyzing or removing global light transport effects from photographs becomes feasible. While several transient imaging systems have recently been proposed using various imaging technologies, none is capable of acquiring transient images at interactive framerates. In this paper, we present an imaging system that records transient images at up to 25 Hz. We show several transient video clips recorded with this system and demonstrate transient imaging applications, including direct-global light transport separation and enhanced depth imaging.

Citation
Lindell DB, O’Toole M, Wetzstein G (2018) Towards transient imaging at interactive rates with single-photon detectors. 2018 IEEE International Conference on Computational Photography (ICCP). Available: http://dx.doi.org/10.1109/iccphot.2018.8368466.

Acknowledgements
D.B.L. is supported by a Stanford Graduate Fellowship in Science and Engineering. M.O. is supported by the Government of Canada through the Banting Postdoctoral Fellowships program. G.W. is supported by a National Science Foundation CAREER award (IIS 1553333), a Terman Faculty Fellowship, the DARPA REVEAL program, a Sloan Fellowship, and by the KAUST Office of Sponsored Research through the Visual Computing Center CCF grant.

Publisher
Institute of Electrical and Electronics Engineers (IEEE)

Journal
2018 IEEE International Conference on Computational Photography (ICCP)

DOI
10.1109/iccphot.2018.8368466

Permanent link to this record