Repfinder: Finding approximately repeated scene elements for image editing
Type
ArticleKAUST Department
Computer Science ProgramComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
Visual Computing Center (VCC)
Date
2010-07-26Permanent link to this record
http://hdl.handle.net/10754/575545
Metadata
Show full item recordAbstract
Repeated elements are ubiquitous and abundant in both manmade and natural scenes. Editing such images while preserving the repetitions and their relations is nontrivial due to overlap, missing parts, deformation across instances, illumination variation, etc. Manually enforcing such relations is laborious and error-prone. We propose a novel framework where user scribbles are used to guide detection and extraction of such repeated elements. Our detection process, which is based on a novel boundary band method, robustly extracts the repetitions along with their deformations. The algorithm only considers the shape of the elements, and ignores similarity based on color, texture, etc. We then use topological sorting to establish a partial depth ordering of overlapping repeated instances. Missing parts on occluded instances are completed using information from other instances. The extracted repeated instances can then be seamlessly edited and manipulated for a variety of high level tasks that are otherwise difficult to perform. We demonstrate the versatility of our framework on a large set of inputs of varying complexity, showing applications to image rearrangement, edit transfer, deformation propagation, and instance replacement. © 2010 ACM.Citation
Cheng, M.-M., Zhang, F.-L., Mitra, N. J., Huang, X., & Hu, S.-M. (2010). RepFinder. ACM Transactions on Graphics, 29(4), 1–8. doi:10.1145/1778765.1778820Sponsors
We thank all the reviewers for their helpful suggestions and Ralph Martin for his valuable comments. This work was supported by the National Basic Research Project of China (Project Number 2006CB303106), the National High Technology Research, the Development Program of China (Project Number 2009AA01Z330) and the Intel-MoE Joint Research Fund (MOE-INTEL-08-01). Niloy Mitra was partially funded by a Microsoft outstanding young faculty fellowship.Journal
ACM Transactions on Graphicsae974a485f413a2113503eed53cd6c53
10.1145/1778765.1778820