Mathematically representing the shape of an object is a key ingredient for solving inverse rendering problems. Explicit representations like meshes are efficient to render in a differentiable fashion but have difficulties handling topology changes. Implicit representations like signed-distance functions, on the other hand, offer better support of topology changes but are much more difficult to use for physics-based differentiable rendering. We introduce a new physics-based inverse rendering pipeline that uses both implicit and explicit representations. Our technique enjoys the benefit of both representations by supporting both topology changes and differentiable rendering of complex effects such as environmental illumination, soft shadows, and interreflection. We demonstrate the effectiveness of our technique using several synthetic and real examples.
@article{Cai:2022:PSDR-MeshSDF, title={Physics-Based Inverse Rendering using Combined Implicit and Explicit Geometries}, author={Cai, G. and Yan, K. and Dong, Z. and Gkioulekas, I. and Zhao, S.}, journal={Computer Graphics Forum}, volume={41}, number={4}, year={2022} }
We thank the anonymous reviewers for their constructive feedback. This work was supported in part by NSF grants 1900783, 1900849, and 1900927. Ioannis Gkioulekas was supported by a Sloan Research Fellowship.