Computational Scientific Imaging Lab @ PKU

孙赫

助理教授、研究员、博士生导师
北京大学未来技术学院、前沿交叉学科研究院、国家生物医学成像科学中心

孙赫，北京大学生物医学工程与物理学助理教授、博雅青年学者，国家生物医学成像科学中心(NBIC)计算科学成像研究室主任。主要研究方向为自适应光学和计算成像，其实验室致力于结合前沿算法（计算物理、控制理论和AI）和硬件创新，开发新一代成像仪器，支持微纳尺度显微到天体物理现象的极端尺度科学观测。研究成果获IEEE Aerospace Conference最佳论文等学术奖项，并已应用于银河系黑洞成像、类地系外行星探测等国际大科学任务，以及超声断层、计算显微镜等多种生物医学成像技术。

入选国家级青年人才、首届浦江青年学者、Amazon AI4Science学者，并主持国家自然科学基金面上、原创探索、科技部重点研发、北京市重点等多项省部级科研项目。

联系方式：邮箱 课题组主页 Google Scholar GitHub Twitter
孙赫
招生
课题组长期招收本科实习生、博士/硕士研究生、博士后和访问学者。更多详情 →
动态
- 2026年4月 1篇论文被ICML接收。VLM3D: 多模态大模型引导的高保真3D重建与生成 →
- 2026年3月 孙赫获评首届浦江青年学者(表彰其在人工智能赋能科学研究相关领域的开创性探索)。
- 2026年2月 2篇论文被CVPR接收。InstantViR: 35+FPS实时单步扩散视频复原 →，MARVAL: 超高维图像生成模型的蒸馏与后训练 →
- 2026年1月 1篇论文被IEEE TIP接收。LatentDEM: 基于隐式扩散先验的盲逆问题求解 →
更多 →

简历

研究

我的研究涵盖以下方向，更多详情请访问课题组主页。

变形镜动画

自适应光学

事件视界望远镜拍摄的M87黑洞图像

计算成像

计算光学&波动物理

计算光学&波动物理

AI + 科学

AI + 科学

论文

截至2026年，我在顶尖期刊（如 Nature Astronomy/IEEE TPAMI）和AI会议（如 NeurIPS/ICML/CVPR）发表100+篇论文(一作/通讯30+)，Google Scholar引用10,000+次。以下为部分近期代表性工作，完整列表请访问 Google Scholar。

Astronomy & Space Science

  • α-DPI for black hole feature extraction
    α-Deep Probabilistic Inference (α-DPI): Efficient Uncertainty Quantification from Exoplanet Astrometry to Black Hole Feature Extraction
    He Sun†, Katherine L. Bouman, Paul Tiede, Jason J. Wang, Sarah Blunt, Dimitri Mawet. The Astrophysical Journal, 2022.
    Black Hole Imaging Bayesian Inference paper website code
  • 3D satellite reconstruction from telescope images
    Reconstructing Satellites in 3D from Amateur Telescope Images
    Zhiming Chang, Boyang Liu, Yifei Xia, Weimin Bai, Weimin Guo, Boxin Shi, He Sun†. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025.
    Satellite Imaging 3D Vision paper website code
  • High-contrast computational imaging for astronomy
    Advances in High-Contrast Computational Imaging for Astronomy
    Bin Ren†, Kaining Yang, Ruobing Dong, He Sun†. Laser & Optoelectronics Progress, 2026.
    Exoplanet Imaging Adaptive Optics paper

Biomedicine

  • EM Generalist: Physics-driven diffusion model for electron microscopy
    EM Generalist: A Physics-Driven Diffusion Foundation Model for Electron Microscopy
    Enze Ye, Chixiang Lu, Zixuan Jiang, Weimin Bai, Shaochi Ren, Chenyu Wang, Jinyang Zhang, Ruohua Shi, Lei Ma, Kun Song, Xiaojuan Qi, Haibo Jiang, He Sun†. Nature Communications, under review.
    Electron Microscopy Generative AI paper website code
  • Ultrasound tomography of musculoskeletal tissues
    Ultrasound Tomography of Musculoskeletal Tissues with Generative Neural Physics
    Zhijun Zeng, Youjia Zheng, Chang Su, Qianhang Wu, Hao Hu, Zeyuan Dong, Shan Gao, Yang Lv, Rui Tang, Ligang Cui, Zhiyong Hou, Weijun Lin, Zuoqiang Shi†, Yubing Li†, He Sun†. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), under review.
    Ultrasound Tomography Neural PDE paper website

2026

  • VLM3D text-to-3D
    Let Language Constrain Geometry: Vision-Language Models as Semantic and Spatial Critics for 3D Generation
    Weimin Bai, Yubo Li, Weijian Luo, Zeqiang Lai, Yequan Wang, Wenzheng Chen†, He Sun†. ICML, 2026.
    3D Vision Vision-Language Models paper website code
  • MAVA fast RL inference
    Masked Auto-Regressive Variational Acceleration: Fast Inference Makes Practical Reinforcement Learning
    Yuxuan Gu, Weimin Bai, Yifei Wang, Weijian Luo, He Sun†. CVPR, 2026.
    Generative AI Reinforcement Learning paper website code
  • InstantViR video restoration
    InstantViR: Real-Time Video Inverse Problem Solver with Distilled Diffusion Prior
    Weimin Bai, Suzhe Xu, Yiwei Ren, Jinhua Hao, Ming Sun, Wenzheng Chen, He Sun†. CVPR, 2026, Highlight.
    Video Restoration Diffusion Model paper website code
  • Blind inversion with latent diffusion priors
    Blind Inversion using Latent Diffusion Priors
    Weimin Bai, Siyi Chen, Wenzheng Chen†, He Sun†. IEEE Transactions on Image Processing (TIP), 2026.
    Inverse Problems Diffusion Model paper website code
  • High-contrast computational imaging for astronomy
    Advances in High-Contrast Computational Imaging for Astronomy
    Bin Ren†, Kaining Yang, Ruobing Dong, He Sun†. Laser & Optoelectronics Progress, 2026.
    Exoplanet Imaging Adaptive Optics paper
  • EM Generalist diffusion model
    EM Generalist: A Physics-Driven Diffusion Foundation Model for Electron Microscopy
    Enze Ye, Chixiang Lu, Zixuan Jiang, Weimin Bai, Shaochi Ren, Chenyu Wang, Jinyang Zhang, Ruohua Shi, Lei Ma, Kun Song, Xiaojuan Qi†, Haibo Jiang†, He Sun†. Nature Communications, under review.
    Electron Microscopy Diffusion Model paper website code

2025

  • FlowDAS data assimilation
    FlowDAS: A Flow-Based Framework for Data Assimilation
    Siyi Chen, Yixuan Jia, Qing Qu, He Sun†, Jeffrey A. Fessler. NeurIPS, 2025.
    Data Assimilation Generative AI paper code
  • Uni-Instruct one-step diffusion
    Uni-Instruct: One-step Diffusion Model through Unified Diffusion Divergence Instruction
    Yifei Wang, Weimin Bai, Colin Zhang, Debing Zhang, Weijian Luo†, He Sun. NeurIPS, 2025.
    Generative AI Diffusion Model paper code
  • Dive3D text-to-3D
    Dive3D: Diverse Distillation-based Text-to-3D Generation via Score Implicit Matching
    Weimin Bai, Yubo Li, Weijian Luo, Wenzheng Chen, He Sun†. TMLR, 2025.
    3D Vision Diffusion Model paper website code
  • Satellite 3D reconstruction
    Reconstructing Satellites in 3D from Amateur Telescope Images
    Zhiming Chang, Boyang Liu, Yifei Xia, Youming Guo, Boxin Shi, He Sun†. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2025.
    Satellite Imaging 3D Vision paper website code
  • Single-shot structured light 3D imaging
    Robust Single-shot Structured Light 3D Imaging via Neural Feature Decoding
    Jiaheng Li, Qiyu Dai, Lihan Li, Praneeth Chakravarthula, He Sun, Baoquan Chen, Wenzheng Chen. SIGGRAPH Asia, 2025.
    3D Vision Neural Feature Decoding paper website code
  • Pose-free 3D quantitative phase imaging of cells
    Pose-Free 3D Quantitative Phase Imaging of Flowing Cellular Populations
    Enze Ye, Wei Lin, Shaochi Ren, Yakun Liu, Xiaoping Li, Hao Wang, He Sun†, Feng Pan†. arXiv, 2025.
    Quantitative Phase Imaging 3D Vision paper code
  • OpenBreastUS benchmark
    OpenBreastUS: Benchmarking Neural Operators for Wave Imaging Using Breast Ultrasound Computed Tomography
    Zhijun Zeng, Youjia Zheng, Hao Hu, Zeyuan Dong, Yihang Zheng, Xinliang Liu, Jinzhuo Wang, Zuoqiang Shi, Linfeng Zhang, Yubing Li, He Sun. arXiv, 2025.
    Ultrasound Neural PDE paper website
  • Musculoskeletal USCT
    Ultrasound Tomography of Musculoskeletal Tissues with Generative Neural Physics
    Zhijun Zeng, Youjia Zheng, Chang Su, Qianhang Wu, Hao Hu, Zeyuan Dong, Shan Gao, Yang Lv, Rui Tang, Ligang Cui, Zhiyong Hou, Weijun Lin, Zuoqiang Shi†, Yubing Li†, He Sun†. arXiv, 2025.
    Ultrasound Neural PDE paper website
  • EM diffusion model from noisy measurements
    Learning Diffusion Model from Noisy Measurement using Principled Expectation-Maximization Method
    Weimin Bai, Weiheng Tang, Enze Ye, Siyi Chen, Wenzheng Chen, He Sun†. ICASSP (Oral), 2025.
    Inverse Problems Diffusion Model paper code

2024

  • EM algorithm for clean diffusion from corrupted data
    An Expectation-Maximization Algorithm for Training Clean Diffusion Models from Corrupted Observations
    Weimin Bai, Yifei Wang, Wenzheng Chen, He Sun†. NeurIPS, 2024.
    Inverse Problems Diffusion Model paper code
  • Liquid-phase electron microscopy biomacromolecules
    Imaging Biomacromolecules in Action with Liquid-phase Electron Microscopy
    Jiaye Li, He Sun†, Huan Wang†. Trends in Chemistry, 2024.
    Electron Microscopy Liquid-phase EM paper
  • M87 persistent shadow EHT 2024
    The Persistent Shadow of the Supermassive Black Hole of M87
    The Event Horizon Telescope Collaboration. Astronomy & Astrophysics, 2024.
    Black Hole Imaging Interferometric Imaging paper

2023

  • Discovering structure from corruption
    Discovering Structure From Corruption for Unsupervised Image Reconstruction
    Oscar Leong, Angela F. Gao, He Sun, Katherine L. Bouman. IEEE Transactions on Computational Imaging, 2023.
    Inverse Problems Unsupervised Learning paper website code
  • Image reconstruction without explicit priors
    Image Reconstruction without Explicit Priors
    Oscar Leong, Angela F. Gao, He Sun, Katherine L. Bouman. ICASSP, 2023.
    Inverse Problems Unsupervised Learning paper website
  • Blazar jet filamentary structures EHT
    Filamentary Structures as the Origin of Blazar Jet Radio Variability
    The Event Horizon Telescope Collaboration. Nature Astronomy, 2023.
    Black Hole Imaging Interferometric Imaging paper
  • Molecule 3D dynamics from LP-EM
    Recovering a Molecule's 3D Dynamics from Liquid-phase Electron Microscopy
    Enze Ye, Yuhang Wang, Hong Zhang, Yiqin Gao, Huan Wang, He Sun†. ICCV, 2023.
    Electron Microscopy 3D Vision paper website code
  • Single molecule dynamics LP-EM deep learning
    Deep Learning-Assisted Analysis of Single Molecule Dynamics from Liquid-phase Electron Microscopy
    Bin Cheng, Enze Ye, He Sun†, Huan Wang†. Chemical Communications, 2023.
    Electron Microscopy 3D Vision paper

2022

  • α-DPI black hole and exoplanet inference
    α-Deep Probabilistic Inference (α-DPI): Efficient Uncertainty Quantification from Exoplanet Astrometry to Black Hole Feature Extraction
    He Sun†, Katherine L. Bouman, Paul Tiede, Jason J. Wang, Sarah Blunt, Dimitri Mawet. The Astrophysical Journal, 2022.
    Black Hole Imaging Bayesian Inference paper website code
  • SgrA* EHT results 2022
    First Sagittarius A* Event Horizon Telescope Results. I–VI
    The Event Horizon Telescope Collaboration. The Astrophysical Journal Letters, 2022.
    He Sun led the neural-network-based analysis of SgrA*'s variability and morphology in Paper IV, featured in the Scientific Background to the Nobel Prize in Physics 2024 as a notable AI application in astronomy.
    Black Hole Imaging EHT · SgrA* Paper I Paper II Paper III Paper IV Paper V Paper VI

Before PKU

  • Deep Probabilistic Imaging
    Deep Probabilistic Imaging: Uncertainty Quantification and Multi-modal Solution Characterization for Computational Imaging
    He Sun†, Katherine L. Bouman. AAAI, 2021.
    Uncertainty Quantification Bayesian Inference paper website code
  • Space-based wavefront sensing
    Efficient Wavefront Sensing for Space-based Adaptive Optics
    He Sun†, N. Jeremy Kasdin, Robert Vanderbei. Journal of Astronomical Telescopes, Instruments, and Systems (JATIS), 2020.
    Exoplanet Imaging Adaptive Optics paper
  • High-contrast integral field spectrograph
    High-Contrast Integral Field Spectrograph (HCIFS): Multi-spectral Wavefront Control and Reduced-dimensional System Identification
    He Sun†, Alexei Goun, Susan Redmond, Michael Galvin, Tyler Groff, Maxime Rizzo. Optics Express, 2020.
    Exoplanet Imaging Hyper-spectral Imaging paper
  • Probabilistic sensor selection
    Learning a Probabilistic Strategy for Computational Imaging Sensor Selection
    He Sun†, Adrian V. Dalca, Katherine L. Bouman. ICCP, 2020.
    Computational Imaging Sensor Selection paper website code
  • Modern wavefront control for exoplanet coronagraph
    Modern Wavefront Control for Space-based Exoplanet Coronagraph Imaging
    He Sun†, Jessica Gersh-Range, N. Jeremy Kasdin. IEEE Aerospace Conference, 2019, Best Paper.
    Exoplanet Imaging Adaptive Optics paper
  • Focal plane wavefront control
    Identification and Adaptive Control of a High-contrast Focal Plane Wavefront Correction System
    He Sun†, N. Jeremy Kasdin, Robert Vanderbei. Journal of Astronomical Telescopes, Instruments, and Systems (JATIS), 2018.
    Exoplanet Imaging Adaptive Optics paper

教学