Three-dimensional registration and shape reconstruction from depth data without matching: A PDE approach
Type
ArticleKAUST Department
Applied Mathematics and Computational Science ProgramComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Date
2019-06-06Permanent link to this record
http://hdl.handle.net/10754/656328
Metadata
Show full item recordAbstract
The widespread availability of depth sensors like the Kinect camera makes it easy to gather three-dimensional (3D) data. However, accurately and efficiently merging large datasets collected from different views is still a core problem in computer vision. This question is particularly challenging if the relative positions of the views are not known, if there are few or no overlapping points, or if there are multiple objects. Here, we develop a method to reconstruct the 3D shapes of objects from depth data taken from different views whose relative positions are not known. Our method does not assume that common points in the views exist nor that the number of objects is known a priori. To reconstruct the shapes, we use partial differential equations (PDE) to compute upper and lower bounds for distance functions, which are solutions of the Eikonal equation constrained by the depth data. To combine various views, we minimize a function that measures the compatibility of relative positions. As we illustrate in several examples, we can reconstruct complex objects, even in the case where multiple views do not overlap, and, therefore, do not have points in common. We present several simulations to illustrate our method including multiple objects, non-convex objects, and complex shapes. Moreover, we present an application of our PDE approach to object classification from depth data.Citation
Gomes, D., Costeira, J., & Saúde, J. (2019). Three-dimensional registration and shape reconstruction from depth data without matching: A PDE approach. Portugaliae Mathematica, 75(3), 285–311. doi:10.4171/pm/2020Sponsors
D. Gomes was partially supported by baseline and start-up funds from King Abdullah University of Science and Technology (KAUST). J. Saude was partially supported by the Portuguese Foundation for Science and Technology through the Carnegie Mellon Portugal Program under the Grant SFRH/BD/52162/2013. The authors contributed equally to this work.Publisher
European Mathematical Publishing HouseJournal
Portugaliae MathematicaDOI
10.4171/pm/2020Additional Links
https://www.ems-ph.org/doi/10.4171/PM/2020ae974a485f413a2113503eed53cd6c53
10.4171/pm/2020