Show simple item record

dc.contributor.authorZsolnai-Fehér, Károly
dc.contributor.authorWonka, Peter
dc.contributor.authorWimmer, Michael
dc.date.accessioned2020-07-26T12:48:30Z
dc.date.available2019-12-19T07:21:22Z
dc.date.available2020-07-26T12:48:30Z
dc.date.issued2020-07-20
dc.identifier.citationZsolnai-Fehér, K., Wonka, P., & Wimmer, M. (2020). Photorealistic Material Editing Through Direct Image Manipulation. Computer Graphics Forum, 39(4), 107–120. doi:10.1111/cgf.14057
dc.identifier.issn1467-8659
dc.identifier.issn0167-7055
dc.identifier.doi10.1111/cgf.14057
dc.identifier.urihttp://hdl.handle.net/10754/660691
dc.description.abstractCreating photorealistic materials for light transport algorithms requires carefully fine-tuning a set of material properties to achieve a desired artistic effect. This is typically a lengthy process that involves a trained artist with specialized knowledge. In this work, we present a technique that aims to empower novice and intermediate-level users to synthesize high-quality photorealistic materials by only requiring basic image processing knowledge. In the proposed workflow, the user starts with an input image and applies a few intuitive transforms (e.g., colorization, image inpainting) within a 2D image editor of their choice, and in the next step, our technique produces a photorealistic result that approximates this target image. Our method combines the advantages of a neural network-augmented optimizer and an encoder neural network to produce high-quality output results within 30 seconds. We also demonstrate that it is resilient against poorly-edited target images and propose a simple extension to predict image sequences with a strict time budget of 1–2 seconds per image.
dc.description.sponsorshipWe would like to thank Reynante Martinez for providing us the geometry and some of the materials for the Paradigm (Fig. 1) and Genesis scenes (Fig. 3), ianofshields for the Liquify scene that served as a basis for Fig. 9, Robin Marin for the material test scene, Andrew Price and Gábor Mészáros for their help with geometry modeling, Felícia Zsolnai-Fehér for her help improving our figures, Christian Freude, David Ha, Philipp Erler and Adam Celarek for their useful comments. We also thank the anonymous reviewers for their help improving this manuscript and NVIDIA for providing the hardware to train our neural networks. This work was partially funded by Austrian Science Fund (FWF), project number P27974.
dc.publisherWiley
dc.relation.urlhttps://onlinelibrary.wiley.com/doi/abs/10.1111/cgf.14057
dc.rightsArchived with thanks to Computer Graphics Forum
dc.titlePhotorealistic Material Editing Through Direct Image Manipulation
dc.typeArticle
dc.contributor.departmentComputer Science Program
dc.contributor.departmentVisual Computing Center (VCC)
dc.contributor.departmentComputer, Electrical and Mathematical Sciences and Engineering (CEMSE) Division
dc.identifier.journalComputer Graphics Forum
dc.rights.embargodate2021-07-20
dc.eprint.versionPost-print
dc.contributor.institutionTU Wien
dc.identifier.volume39
dc.identifier.issue4
dc.identifier.pages107-120
dc.identifier.arxivid1909.11622
kaust.personWonka, Peter
dc.identifier.eid2-s2.0-85088168432
refterms.dateFOA2019-12-19T07:22:28Z
dc.date.published-online2020-07-20
dc.date.published-print2020-07
dc.date.posted2019-09-12


Files in this item

Thumbnail
Name:
Preprintfile1.pdf
Size:
8.962Mb
Format:
PDF
Description:
Pre-print

This item appears in the following Collection(s)

Show simple item record

VersionItemEditorDateSummary

*Selected version