Yujin Chen 陈雨劲

I am a final-year Ph.D. candidate in the Visual Computing Lab at the Technical University of Munich, supervised by Prof. Matthias Nießner. I received my B.Eng and M.Sc from Wuhan University.

My research aims to build intelligent systems that can perceive, understand, and generate the 3D world, empowering next-generation applications with immersive spatial intelligence.

Key Interests:
  • 3D Generative AI: 3D Generation, 3D Appearance Modeling, and Reconstruction
  • Human-Centric AI: 3D Hand/Body Modeling, Digital Humans, and Motion Analysis
  • Embodied AI: Scene Understanding, 3D/4D Representation Learning, and Spatial AI
Profile photo of Yujin Chen

Publications

3D Scene Representation, Understanding, and Generation

PBR-SR paper thumbnail

PBR-SR: Mesh PBR Texture Super Resolution from 2D Image Priors

Yujin Chen, Yinyu Nie, Benjamin Ummenhofer, Reiner Birkl, Michael Paulitsch, Matthias Nießner

Neural Information Processing Systems (NeurIPS), 2025

Mesh2NeRF paper thumbnail

Mesh2NeRF: Direct Mesh Supervision for Neural Radiance Field Representation and Generation

Yujin Chen, Yinyu Nie, Benjamin Ummenhofer, Reiner Birkl, Michael Paulitsch, Matthias Müller, Matthias Nießner

European Conference on Computer Vision (ECCV), 2024

SSR-2D paper thumbnail

SSR-2D: Semantic 3D Scene Reconstruction from 2D Images

Junwen Huang, Alexey Artemov, Yujin Chen, Shuaifeng Zhi, Kai Xu, Matthias Nießner

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2024

4DContrast paper thumbnail

4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding

Yujin Chen, Matthias Nießner, Angela Dai

European Conference on Computer Vision (ECCV), 2022

Human and Hand Pose & Shape Modeling

PHRIT paper thumbnail

PHRIT: Parametric Hand Representation with Implicit Template

Zhisheng Huang*, Yujin Chen*, Di Kang, Jinlu Zhang, Zhigang Tu (* equal contribution)

International Conference on Computer Vision (ICCV), 2023

TPAMI 2023 paper thumbnail

Consistent 3D Hand Reconstruction in Video via Self-supervised Learning

Zhigang Tu*, Zhisheng Huang*, Yujin Chen†, Di Kang, Linchao Bao, Bisheng Yang, Junsong Yuan (* equal contribution)(† senior authorship)

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2023

MixSTE paper thumbnail

MixSTE: Seq2seq Mixed Spatio-Temporal Encoder for 3D Human Pose Estimation in Video

Jinlu Zhang, Zhigang Tu, Jianyu Yang, Yujin Chen, Junsong Yuan

Conference on Computer Vision and Pattern Recognition (CVPR), 2022

SSL-HAND paper thumbnail

Model-based 3D Hand Reconstruction via Self-Supervised Learning

Yujin Chen, Zhigang Tu, Di Kang, Linchao Bao, Ying Zhang, Xuefei Zhe, Ruizhi Chen, Junsong Yuan

Conference on Computer Vision and Pattern Recognition (CVPR), 2021

I2UV-HandNet paper thumbnail

I2UV-HandNet: Image-to-UV Prediction Network for Accurate and High-fidelity 3D Hand Mesh Modeling

Ping Chen, Yujin Chen, Dong Yang, Fangyin Wu, Qin Li, Qingpei Xia, Yong Tan

International Conference on Computer Vision (ICCV), 2021

Joint Hand-Object paper thumbnail

Joint Hand-Object 3D Reconstruction from a Single Image with Cross-branch Feature Fusion

Yujin Chen, Zhigang Tu, Di Kang, Linchao Bao, Ruizhi Chen, Zhengyou Zhang, Junsong Yuan

IEEE Transactions on Image Processing (TIP), 2021

SO-HandNet animation

SO-HandNet: Self-Organizing Network for 3D Hand Pose Estimation with Semi-supervised Learning

Yujin Chen, Zhigang Tu, Liuhao Ge, Dejun Zhang, Ruizhi Chen, Junsong Yuan

International Conference on Computer Vision (ICCV), 2019

Experience

Research Scientist Intern, Meta Reality Labs, Jul. 2025 ~ present

Postgraduate Researcher, TU Munich, Advisors: Prof. Matthias Nießner, Jul. 2021 ~ present

Research Intern, Tencent AI Lab, Dec. 2019 ~ Jun. 2021

Visiting Researcher, State University of New York at Buffalo, Advisor: Prof. Junsong Yuan, Jul. 2019 ~ Nov. 2019

Research Assistant, Wuhan University, Advisor: Prof. Ruizhi Chen and Prof. Zhigang Tu, Sep. 2018 ~ Jun. 2021

Services

Workshops

1st Workshop on Generating Digital Twins from Images and Videos, ICCV 2025 Workshop, Co-organizer

Reviewing

CVPR, ECCV, ICCV, NeurIPS, AAAI, TPAMI, IJCV, TIP

Teaching