Xiuming Zhang 張修明

I am a Research Scientist on Prof. 's computational photography team at . Prior to this, I did my Ph.D. in computer vision and computer graphics with Prof. at , . My dissertation Shape, Reflectance, and Illumination From Appearance concerns inverse rendering and its applications such as free-viewpoint relighting.

CV Bio

Past Experiences


Aug. 2021Graduated from MIT (doctoral dissertation available below)
Aug. 2021NeRFactor conditionally accepted to SIGGRAPH Asia, to be presented in December, 2021
Dec. 2020Neural Light Transport (NLT) accepted to TOG, to be presented at SIGGRAPH in August, 2021
Apr. 2019MoSculp on exhibition in the MIT Museum (photos available here)
Jan. 2019Awarded Snap Research Fellowship
Dec. 2018Presented GenRe at NeurIPS and released our codebase for training/testing GenRe and ShapeHD
Sep. 2018MoSculp featured as and covered by , , , etc.
Oct. 2016Our paper on Bayesian modeling of Alzheimer's disease heterogeneity out in PNAS and covered by , , etc.
May 2016Our work on Alzheimer's disease subtypes awarded the Magna Cum Laude Award and oral presentation at 2016

Recent Publications

* indicates equal contribution. See also my Google Scholar.

Portrait Reconstruction and Relighting Using the Sun as a Light Stage
, , ,
arXiv 2022
Shape, Reflectance, and Illumination From Appearance
Committee: , ,
MIT Doctoral Dissertation 2021
NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination
, , , , ,
2021 (Proc. )
Editing Conditional Radiance Fields
Steven Liu, , , Richard Zhang, Jun-Yan Zhu, Bryan Russell
NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis
, , , Matthew Tancik, Ben Mildenhall,
Neural Light Transport for Relighting and View Synthesis
, , , , , , Sergio Orts-Escolano, Philip Davidson, , , , ,
2021 (Presented at )
Multi-Plane Program Induction With 3D Box Priors
*, *, , , , Noah Snavely,
Light Stage Super-Resolution: Continuous High-Frequency Relighting
, Zexiang Xu, , , , , , ,
2020 (Proc. )
Portrait Shadow Manipulation
, , , , , ,
2020 (Proc. )
Perspective Plane Program Induction From a Single Image
*, *, , , ,
Latent Atrophy Factors Related to Phenotypical Variants of Posterior Cortical Atrophy
Colin Groot, , Jacob W. Vogel, , , , Yolande A. L. Pijnenburg, Bruce L. Miller, Howard J. Rosen, Renaud La Joie, Frederik Barkhof, Philip Scheltens, Wiesje M. van der Flier, Gil D. Rabinovici, Rik Ossenkoppele
Neurology 2020
Program-Guided Image Manipulators
*, *, , , ,
Reconciling Dimensional and Categorical Models of Autism Heterogeneity: A Brain Connectomics and Behavioral Study
*, *, Dorothea L. Floris, , Adriana Di Martino,
Biological Psychiatry 2019
Learning to Reconstruct Shapes From Unseen Classes
*, *, , , ,
(Oral/Accepted/Submitted: 30/1011/4856)
MoSculp: Interactive Visualization of Shape and Time
, , , , , , ,
, , (), etc.
MIT Museum
Learning Shape Priors for Single-View 3D Completion and Reconstruction
*, *, , , ,
Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling
*, *, , , , , ,
Bayesian Model Reveals Latent Atrophy Factors With Dissociable Cognitive Trajectories in Alzheimer's Disease
, , , , ,
& at 2016
, , , , etc.

Press Coverage

Side Work

Non-Referred Notes and Side Projects

Webpage Monitor
A minimal Python webpage monitor that I have been using to stay updated when a researcher I follow updates their webpage (e.g., adding a new paper).
This Website
A simple, responsive webpage for academics. Feel free to use it, but on your page, please attribute the source to this page and HTML5 UP.
My Python library that includes useful functions for signal/image processing, 3D modeling and rendering with Blender, visualization utility, etc.
Depth-Preserving Style Transfer
An improvement to Johnson et al. [2016] aiming to preserve depth variations in the original content image during style transfer (MIT 6.869 class project with Ruizhi Liao and Yu Xia).
ReML Estimation in Linear Models
A tutorial on Restricted Maximum Likelihood Estimation in linear regression and Linear Mixed-Effects Models.
A MATLAB implementation excluding border matting and user editing.
Basic Photometric Stereo
A MATLAB implementation of the basic photometric stereo algorithm.
Bandgap of 2D Photonic Crystal
Replicating a classic textbook plot with COMSOL-MATLAB scripting.