Portrait Reconstruction and Relighting Using the Sun as a Light Stage
, , ,
arXiv 2022
, , ,
arXiv 2022
About
I am a Research Scientist on Prof. 's computational photography team at . Prior to this, I did my Ph.D. in computer vision and computer graphics with Prof. at , . My dissertation Shape, Reflectance, and Illumination From Appearance concerns inverse rendering and its applications such as free-viewpoint relighting.
Past Experiences
| Intern & Student Researcher, , 2020–2021, w/ |
| Intern & Student Researcher, , 2019–2020, w/ & |
| Ph.D. & S.M. (CS), , 2016–2021, w/ |
| Research Engineer, Institute for Infocomm Research, 2015–2016, w/ Liyuan Li |
| Exchange Student (ECE), University of Waterloo, Spring 2014 |
| B.Eng. (EE), National University of Singapore, 2011–2015, w/ |
News
| Aug. 2021 | Graduated from MIT (doctoral dissertation available below) |
| Aug. 2021 | NeRFactor conditionally accepted to SIGGRAPH Asia, to be presented in December, 2021 |
| Dec. 2020 | Neural Light Transport (NLT) accepted to TOG, to be presented at SIGGRAPH in August, 2021 |
| Apr. 2019 | MoSculp on exhibition in the MIT Museum (photos available here) |
| Jan. 2019 | Awarded Snap Research Fellowship |
| Dec. 2018 | Presented GenRe at NeurIPS and released our codebase for training/testing GenRe and ShapeHD |
| Sep. 2018 | MoSculp featured as and covered by , , , etc. |
| Oct. 2016 | Our paper on Bayesian modeling of Alzheimer's disease heterogeneity out in PNAS and covered by , , etc. |
| May 2016 | Our work on Alzheimer's disease subtypes awarded the Magna Cum Laude Award and oral presentation at 2016 |
Recent Publications
* indicates equal contribution. See also my Google Scholar.
Shape, Reflectance, and Illumination From Appearance
Committee: , ,
MIT Doctoral Dissertation 2021
Committee: , ,
MIT Doctoral Dissertation 2021
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination
, , , , ,
2021 (Proc. )
, , , , ,
2021 (Proc. )
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis
, , , Matthew Tancik, Ben Mildenhall,
2021
, , , Matthew Tancik, Ben Mildenhall,
2021
Neural Light Transport for Relighting and View Synthesis
, , , , , , Sergio Orts-Escolano, Philip Davidson, , , , ,
2021 (Presented at )
, , , , , , Sergio Orts-Escolano, Philip Davidson, , , , ,
2021 (Presented at )
Light Stage Super-Resolution: Continuous High-Frequency Relighting
, Zexiang Xu, , , , , , ,
2020 (Proc. )
, Zexiang Xu, , , , , , ,
2020 (Proc. )
Portrait Shadow Manipulation
, , , , , ,
2020 (Proc. )
, , , , , ,
2020 (Proc. )
Perspective Plane Program Induction From a Single Image
*, *, , , ,
2020
*, *, , , ,
2020
Latent Atrophy Factors Related to Phenotypical Variants of Posterior Cortical Atrophy
Colin Groot, , Jacob W. Vogel, , , , Yolande A. L. Pijnenburg, Bruce L. Miller, Howard J. Rosen, Renaud La Joie, Frederik Barkhof, Philip Scheltens, Wiesje M. van der Flier, Gil D. Rabinovici, Rik Ossenkoppele
Neurology 2020
Colin Groot, , Jacob W. Vogel, , , , Yolande A. L. Pijnenburg, Bruce L. Miller, Howard J. Rosen, Renaud La Joie, Frederik Barkhof, Philip Scheltens, Wiesje M. van der Flier, Gil D. Rabinovici, Rik Ossenkoppele
Neurology 2020
Program-Guided Image Manipulators
*, *, , , ,
2019
*, *, , , ,
2019
Reconciling Dimensional and Categorical Models of Autism Heterogeneity: A Brain Connectomics and Behavioral Study
*, *, Dorothea L. Floris, , Adriana Di Martino,
Biological Psychiatry 2019
*, *, Dorothea L. Floris, , Adriana Di Martino,
Biological Psychiatry 2019
Learning to Reconstruct Shapes From Unseen Classes
*, *, , , ,
2018
(Oral/Accepted/Submitted: 30/1011/4856)
*, *, , , ,
2018
(Oral/Accepted/Submitted: 30/1011/4856)
Learning Shape Priors for Single-View 3D Completion and Reconstruction
*, *, , , ,
2018
*, *, , , ,
2018
Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling
*, *, , , , , ,
2018
*, *, , , , , ,
2018
Bayesian Model Reveals Latent Atrophy Factors With Dissociable Cognitive Trajectories in Alzheimer's Disease
, , , , ,
2016
& at 2016
, , , , etc.
, , , , ,
2016
& at 2016
, , , , etc.
Press Coverage
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
Side Work
Non-Referred Notes and Side Projects
Webpage Monitor
A minimal Python webpage monitor that I have been using to stay updated when a researcher I follow updates their webpage (e.g., adding a new paper).
A minimal Python webpage monitor that I have been using to stay updated when a researcher I follow updates their webpage (e.g., adding a new paper).
This Website
A simple, responsive webpage for academics. Feel free to use it, but on your page, please attribute the source to this page and HTML5 UP.
A simple, responsive webpage for academics. Feel free to use it, but on your page, please attribute the source to this page and HTML5 UP.
xiuminglib
My Python library that includes useful functions for signal/image processing, 3D modeling and rendering with Blender, visualization utility, etc.
My Python library that includes useful functions for signal/image processing, 3D modeling and rendering with Blender, visualization utility, etc.
Depth-Preserving Style Transfer
An improvement to Johnson et al. [2016] aiming to preserve depth variations in the original content image during style transfer (MIT 6.869 class project with Ruizhi Liao and Yu Xia).
An improvement to Johnson et al. [2016] aiming to preserve depth variations in the original content image during style transfer (MIT 6.869 class project with Ruizhi Liao and Yu Xia).
ReML Estimation in Linear Models
A tutorial on Restricted Maximum Likelihood Estimation in linear regression and Linear Mixed-Effects Models.
A tutorial on Restricted Maximum Likelihood Estimation in linear regression and Linear Mixed-Effects Models.
GrabCut
A MATLAB implementation excluding border matting and user editing.
A MATLAB implementation excluding border matting and user editing.
Basic Photometric Stereo
A MATLAB implementation of the basic photometric stereo algorithm.
A MATLAB implementation of the basic photometric stereo algorithm.
Bandgap of 2D Photonic Crystal
Replicating a classic textbook plot with COMSOL-MATLAB scripting.
Replicating a classic textbook plot with COMSOL-MATLAB scripting.
Services
Conference Reviewer
SIGGRAPH Asia 2022, ICML 2022, ICLR 2022, CVPR 2022, SIGGRAPH Asia 2021, NeurIPS 2021, MMA 2021, ICLR 2021, ICCV 2021, CVPR 2021, PG 2020, NeurIPS 2020, ECCV 2020, CVPR 2020, AAAI 2020, MM 2019, ICML 2019, ICCV 2019, GLOBECOM 2018