About

Xiuming Zhang 張修明

I'm currently a Principal Research Scientist in Sanja Fidler's Spatial Intelligence Lab at NVIDIA, working on generative world simulation for closed-loop training of physical AI agents. Before NVIDIA, I worked on autonomous driving at Tesla Autopilot and on computational photography in Marc Levoy's Emerging Products Group at Adobe. I did my Ph.D. in computer vision and computer graphics with Bill Freeman at MIT CSAIL. While at MIT, I also received mentorship from Jon Barron via internships at Google Research. My dissertation Shape, Reflectance, and Illumination From Appearance studies inverse rendering and its applications, including 3D shape reconstruction and free-viewpoint relighting. Here is a more formal bio.

October 2025: We are looking for research interns at NVIDIA. Email me!

Google Scholar xiuming6zhang at gmail dot com

Recent Experiences

News

Jul. 2025 Joined Sanja Fidler's Spatial Intelligence Lab at NVIDIA.
Jun. 2025 Robotaxi launched in Austin, TX.
Sep. 2024 Helped ship Actually Smart Summon to FSD customers.
Mar. 2024 Shipped Autopark to FSD customers.
Dec. 2023 Shipped High-Fidelity Park Assist to all Tesla cars.
Apr. 2023 DiffusionRig (personalized face editing) released for CVPR 2023.
Oct. 2022 Joined Tesla Autopilot to work on 3D perception.
Oct. 2021 Joined Marc Levoy's Adobe Emerging Products Group to work on computational photography.
Aug. 2021 Graduated from MIT (doctoral dissertation).
Aug. 2021 NeRFactor conditionally accepted to SIGGRAPH Asia.
Dec. 2020 Neural Light Transport (NLT) accepted to TOG, to be presented at SIGGRAPH in August 2021.
Apr. 2019 MoSculp on exhibition in the MIT Museum (photos).
Jan. 2019 Awarded Snap Research Fellowship.
Dec. 2018 Oral presentation of GenRe at NeurIPS.
Sep. 2018 MoSculp featured as 9/19 MIT Homepage and covered by Forbes, BBC, etc.
Oct. 2016 Paper on Bayesian modeling of Alzheimer's disease heterogeneity out in PNAS and covered by Psychology Today, MGH/HMS, etc.
May 2016 Work on Alzheimer's disease subtypes awarded the Magna Cum Laude Award and an oral presentation at ISMRM 2016.

Products

[official] [reviews]
Full Self-Driving (FSD)
Worked on 3D perception and E2E safety for FSD releases to both customer and Robotaxi fleets, contributing to both online models shipped to cars and offline data pipelines scaling to 20K GPUs.
Tesla 2022–2025
[official] [reviews]
Actually Smart Summon
Helped vehicles perceive static and dynamic 3D scenes, allowing them to autonomously pick up their owners (e.g., from a store exit in the rain) without collisions.
Tesla 2024
[official] [reviews]
Autopark
Developed the offline part of parkable space prediction, enabling autonomous parking into parallel, perpendicular, and angled spots—marked or unmarked—in unseen environments.
Tesla 2023
[official] [reviews] [patent]
High-Fidelity Park Assist
Tackled various aspects of this next-generation, real-time 3D reconstruction system, covering deformable human body, car geometry from partial views, and large-scale static scenes.
Tesla 2023

Recent Publications

* indicates equal contribution.

[paper] [bibtex]
Latent Atrophy Factors Related to Phenotypical Variants of Posterior Cortical Atrophy
Colin Groot, B. T. Thomas Yeo, Jacob W. Vogel, Xiuming Zhang, Nanbo Sun, Elizabeth C. Mormino, Yolande A. L. Pijnenburg, Bruce L. Miller, Howard J. Rosen, Renaud La Joie, Frederik Barkhof, Philip Scheltens, Wiesje M. van der Flier, Gil D. Rabinovici, Rik Ossenkoppele
Neurology 2020

Press Coverage

Side Work

Non-Refereed Notes & Side Projects

[code]
Webpage Monitor
A minimal Python webpage monitor that I use to track when a researcher I follow updates their webpage (e.g., adding a new paper).
[code]
This Website
A simple, responsive webpage for academics. Feel free to use it, but on your page, please attribute the source to this page and HTML5 UP.
[doc] [code]
xiuminglib
My Python library for signal/image processing, 3D modeling and rendering with Blender, visualization, etc.
[paper]
ReML Estimation in Linear Models
A tutorial on Restricted Maximum Likelihood Estimation in linear regression and Linear Mixed-Effects Models.
[code]
GrabCut
A MATLAB implementation excluding border matting and user editing.
[code]
Basic Photometric Stereo
A MATLAB implementation of the basic photometric stereo algorithm.
[code]
Bandgap of 2D Photonic Crystal
Replicating a classic textbook plot with COMSOL-MATLAB scripting.

Services

Conference Reviewer

NeurIPS 2025, ICLR 2025, ICCV 2025, CVPR 2025, SIGGRAPH 2024, NeurIPS 2024, ICLR 2024, EG 2024, ECCV 2024, CVPR 2024, SIGGRAPH Asia 2023, NeurIPS 2023, EG 2023, CVPR 2023, SIGGRAPH Asia 2022, NeurIPS 2022, ICML 2022, ICLR 2022, ECCV 2022, CVPR 2022, SIGGRAPH Asia 2021, NeurIPS 2021, MMA 2021, ICLR 2021, ICCV 2021, CVPR 2021, PG 2020, NeurIPS 2020, ECCV 2020, CVPR 2020, AAAI 2020, MM 2019, ICML 2019, ICCV 2019, GLOBECOM 2018

Journal Reviewer

IJCV, TCSVT, TPAMI