Research

EyeNeRF: A Hybrid Representation for Photorealistic Synthesis, Animation and Relighting of Human Eyes

ACM Transactions on Graphics (Proceedings of SIGGRAPH) 2022

A volumetric synthesis model for high-quality photorealistic performance capture and animation of human eyes

VoLux-GAN: A Generative Model for 3D Face Synthesis with HDRI Relighting

ACM SIGGRAPH 2022 Conference Proceedings

A generative model that synthesizes novel 3D human faces that can be photorealistically relit under desired environments

VariTex: Variational Neural Face Textures

International Conference on Computer Vision (ECCV) 2021

A generative model that synthesizes novel 3D human faces with fine-grained explicit control over extreme poses and expressions

Real-time Global Illumination Decomposition of Videos

ACM Transactions on Graphics 2021 (Presented at SIGGRAPH 2021)

An optimization based technique to decompose videos into per-frame reflectance and global illumination layers in real-time

Deep Relightable Textures: Volumetric Performance Capture with Neural Rendering

ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 2020

First technique to perform high-quality view synthesis and relighting of dynamic full-body human performances in a Lightstage

Self-supervised Outdoor Scene Relighting

European Conference on Computer Vision (ECCV) 2020

A neural rendering technique to relight outdoor scenes under desired lighting from a single image

Deep Reflectance Fields: High-Quality Facial Reflectance Field Inference From Color Gradient Illumination

ACM Transactions on Graphics (Proceedings of SIGGRAPH) 2019

A neural rendering technique to capture fully relightable high-resolution dynamic facial performances in a Lightstage

Live Intrinsic Material Estimation

IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2018 - Spotlight

An ML technique to estimate high-frequency material of an object of any shape from a single image and lighting from depth+video

Live User-Guided Intrinsic Video For Static Scenes

IEEE Transactions on Visualization and Computer Graphics (TVCG) 2017

Presented at International Symposium on Mixed and Augmented Reality (ISMAR) 2017

An interactive technique guided by 3D user strokes to perform geometry reconstruction and intrinsic decomposition of static scenes

Live Intrinsic Video

ACM Transactions on Graphics (Proceedings of SIGGRAPH) 2016

The first technique to perform intrinsic decomposition of live video streams using fast non-linear GPU optimization