Xiuming Zhang

About

Xiuming Zhang 張修明

I'm currently a Senior Machine Learning Scientist at , working on 3D computer vision, neural rendering, and NeRF. Before , I worked on computational photography at Emerging Products Group. I did my Ph.D. in computer vision and computer graphics with at . During , I also received mentorship from via internships at . My dissertation studies inverse rendering and its applications, including 3D shape reconstruction and free-viewpoint relighting. Here is a more formal, third-person bio.

CV Google Scholar xiuming6zhang at gmail dot com

Past Experiences

Research Scientist, Emerging Products Group, 2021–2022

Research Intern, , 2020–2021, w/

Research Intern, , 2019–2020, w/ &

Ph.D. & S.M. (CS), , 2016–2021, w/

Research Engineer, , 2015–2016

Exchange Student (ECE), , Spring 2014

B.Eng. (EE), , 2011–2015, w/

News

Oct. 2022	Joined to work on 3D perception.
Oct. 2021	Joined Emerging Products Group to work on computational photography.
Aug. 2021	Graduated from MIT ().
Aug. 2021	conditionally accepted to SIGGRAPH Asia.
Dec. 2020	accepted to TOG, to be presented at SIGGRAPH in August 2021.
Apr. 2019	on exhibition in the MIT Museum ().
Jan. 2019	Awarded .
Dec. 2018	Oral presentation of at NeurIPS.
Sep. 2018	featured as and covered by , , etc.
Oct. 2016	Our paper on Bayesian modeling of Alzheimer's disease heterogeneity and covered by , , etc.
May 2016	awarded the Magna Cum Laude Award and oral presentation at 2016.

Recent Publications

* indicates equal contribution.

Portrait Reconstruction and Relighting Using the Sun as a Light Stage
, , ,
arXiv 2022

Shape, Reflectance, and Illumination From Appearance
Committee: , ,
MIT Doctoral Dissertation 2021

NeRFactor: Neural Factorization of Shape and Reflectance Under an Unknown Illumination
, , , , ,
2021 (Proc. )

Editing Conditional Radiance Fields
, , , , ,
2021

NeRV: Neural Reflectance and Visibility Fields for Relighting and View Synthesis
, , , , ,
2021

Neural Light Transport for Relighting and View Synthesis
, , , , , , , , , , , ,
2021 (Presented at )

Multi-Plane Program Induction With 3D Box Priors
*, *, , , , ,
2020

Light Stage Super-Resolution: Continuous High-Frequency Relighting
, , , , , , , ,
2020 (Proc. )

Portrait Shadow Manipulation
, , , , , ,
2020 (Proc. )

Perspective Plane Program Induction From a Single Image
*, *, , , ,
2020

Latent Atrophy Factors Related to Phenotypical Variants of Posterior Cortical Atrophy
Colin Groot, , Jacob W. Vogel, , , , Yolande A. L. Pijnenburg, Bruce L. Miller, Howard J. Rosen, Renaud La Joie, Frederik Barkhof, Philip Scheltens, Wiesje M. van der Flier, Gil D. Rabinovici, Rik Ossenkoppele
Neurology 2020

Program-Guided Image Manipulators
*, *, , , ,
2019

Reconciling Dimensional and Categorical Models of Autism Heterogeneity: A Brain Connectomics and Behavioral Study
*, *, Dorothea L. Floris, , Adriana Di Martino,
Biological Psychiatry 2019

Learning to Reconstruct Shapes From Unseen Classes
*, *, , , ,
2018
(Oral/Accepted/Submitted: 30/1011/4856)

MoSculp: Interactive Visualization of Shape and Time
, , , , , , ,
2018
, , , , etc.

Learning Shape Priors for Single-View 3D Completion and Reconstruction
*, *, , , ,
2018

Pix3D: Dataset and Methods for Single-Image 3D Shape Modeling
*, *, , , , , ,
2018

Bayesian Model Reveals Latent Atrophy Factors With Dissociable Cognitive Trajectories in Alzheimer's Disease
, , , , ,
2016
& at 2016
, , , etc.

Press Coverage

Side Work

Non-Referred Notes & Side Projects

Webpage Monitor
A minimal Python webpage monitor that I use to track when a researcher I follow updates their webpage (e.g., adding a new paper).

This Website
A simple, responsive webpage for academics. Feel free to use it, but on your page, please attribute the source to this page and .

xiuminglib
My Python library for signal/image processing, 3D modeling and rendering with Blender, visualization, etc.

Depth-Preserving Style Transfer
An improvement to aiming to preserve depth variations during style transfer (MIT 6.869 class project with and ).

ReML Estimation in Linear Models
A tutorial on Restricted Maximum Likelihood Estimation in linear regression and Linear Mixed-Effects Models.

GrabCut
A MATLAB implementation excluding border matting and user editing.

Basic Photometric Stereo
A MATLAB implementation of the basic photometric stereo algorithm.

Bandgap of 2D Photonic Crystal
Replicating a classic textbook plot with COMSOL-MATLAB scripting.