Path-Space Differentiable Rendering of Implicit Surfaces
Siwei Zhou1, Youngha Chang2, Nobuhiko Mukai2, Hiroaki Santo1, Fumio Okura1, Yasuyuki Matsushita1, and Shuang Zhao3,4
1Osaka University          2Tokyo City University          3University of California, Irvine          4NVIDIA
ACM SIGGRAPH 2024 (Conference Track Full Paper)
teaser
Abstract

Physics-based differentiable rendering is a key ingredient for integrating forward rendering into probabilistic inference and machine learning pipelines. As a state-of-the-art formulation for differentiable rendering, differential path integrals have enabled the development of efficient Monte Carlo estimators for both interior and boundary integrals. Unfortunately, this formulation has been designed mostly for explicit geometries like polygonal meshes.

In this paper, we generalize the theory of differential path integrals to support implicit geometries like level sets and signed-distance functions (SDFs). In addition, we introduce new Monte Carlo estimators for efficiently sampling discontinuity boundaries that are also implicitly specified. We demonstrate the effectiveness of our theory and algorithms using several differentiable-rendering and inverse-rendering examples.

Downloads
  • Paper: pdf (8.1 MB)
  • Source code: coming soon!
Bibtex citation
@inproceedings{Zhou:2024:PSDR-SDF,
  title={Path-Space Differentiable Rendering of Implicit Surfaces},
  author={Zhou, S. and Chang, Y. and Mukai, N. and Santo, H. and Okura, F. and Matsushita, Y. and Zhao, S.},
  booktitle = {ACM SIGGRAPH 2024 Conference Proceedings},
  year = {2024},
}
Acknowledgments

We thank the anonymous reviewers for their constructive suggestions. We also thank Heng Guo for his advice and insights. This work was partially supported by JSPS KAKENHI grant JP23H05491 and NSF grant 1900927.