Selected Publications

Copyright Notice:
This material is presented to ensure timely dissemination of scholarly and technical work. Copyright and all rights therein are retained by authors or by other copyright holders. All persons copying this information are expected to adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.

You can follow his research work on Google Scholar, and some open source codes on GitHub.

Papers

alt text 

Oblique-MERF: Revisiting and Improving MERF for Oblique Photography
Xiaoyi Zeng, Taiwan Song, Leyuan Yang, Bailin Deng, Juyong Zhang
International Conference on 3D Vision (3DV), 2025.
[paper] [Project Page] [code]

alt text 

Portrait Video Editing Empowered by Multimodal Generative Priors
Xuan Gao, Haiyao Xiao, Chenglai Zhong, Shimin Hu, Yudong Guo, Juyong Zhang
SIGGRAPH Asia, 2024.
[paper] [Project Page] [code]

alt text 

Deformable NeRF using Recursively Subdivided Tetrahedra
Zherui Qiu, Chenqu Ren, Kaiwen Song, Xiaoyi Zeng, Leyuan Yang, Juyong Zhang
ACM Multimedia, 2024.
[paper] [Project Page] [code]

alt text 

City-on-Web: Real-time Neural Rendering of Large-scale Scenes on the Web
Kaiwen Song, Xiaoyi Zeng, Chenqu Ren, Juyong Zhang
European Conference on Computer Vision (ECCV), 2024.
[paper] [Project Page] [code]

alt text 

DynoSurf: Neural Deformation-based Temporally Consistent Dynamic Surface Reconstruction
Yuxin Yao, Siyu Ren, Junhui Hou, Zhi Deng, Juyong Zhang, Wenping Wang
European Conference on Computer Vision (ECCV), 2024.
[paper] [code]

alt text 

L0-Sampler: An L0 Model Guided Volume Sampling for NeRF
Liangchen Li, Juyong Zhang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
[paper] [Project Page] [code]

alt text 

FlashAvatar: High-fidelity Head Avatar with Efficient Gaussian Embedding
Jun Xiang, Xuan Gao, Yudong Guo, Juyong Zhang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024.
[paper] [Project Page] [code]

alt text 

Neural-ABC: Neural Parametric Models for Articulated Body with Clothes
Honghu Chen, Yuxin Yao, Juyong Zhang
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2024.
[Project Page] [code]

alt text 

IntrinsicNGP: Intrinsic Coordinate based Hash Encoding for Human NeRF
Bo Peng, Jun Hu, Jingtao Zhou, Xuan Gao, Juyong Zhang
IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023.
[paper] [Project Page] [code]

alt text 

Fast and Robust Non-Rigid Registration Using Accelerated Majorization-Minimization
Yuxin Yao, Bailin Deng, Weiwei Xu, Juyong Zhang
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.45, No.8, 2023.
[paper] [code]

alt text 

Flattening-Net: Deep Regular 2D Representation for 3D Point Cloud Analysis
Qijian Zhang, Junhui Hou, Yue Qian, Yiming Zeng, Juyong Zhang, Ying He
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.45, No.8, 2023.
[paper] [code]

alt text 

RegGeoNet: Learning Regular Representations for Large-Scale 3D Point Clouds
Qijian Zhang, Junhui Hou, Yue Qian, Antoni B. Chan, Juyong Zhang, Ying He
International Journal of Computer Vision (IJCV), Vol.130, pages 3100–3122, 2023.
[paper] [code]

alt text 

Sketch2PQ: Freeform Planar Quadrilateral Mesh Design via a Single Sketch
Zhi Deng, Yang Liu, Hao Pan, Wassim Jabi, Juyong Zhang, Bailin Deng
IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.29, No.9, 2023.
[paper]

alt text 

Neural Surface Reconstruction of Dynamic Scenes with Monocular RGB-D Camera
Hongrui Cai, Wanquan Feng, Xuetao Feng, Yan Wang, Juyong Zhang
Thirty-Sixth Conference on Neural Information Processing Systems (NeurIPS), 2022.
[paper] [Project Page] [Code]

alt text 

Reconstructing Personalized Semantic Facial NeRF Models From Monocular Video
Xuan Gao, Chenglai Zhong, Jun Xiang, Yang Hong, Yudong Guo, Juyong Zhang
ACM Transactions on Graphics (SIGGRAPH ASIA), Vol.41, No.6, 2022.
[paper] [Project Page] [Code]

alt text 

SelfRecon: Self Reconstruction Your Digital Avatar from Monocular Video
Boyi Jiang, Yang Hong, Hujun Bao, Juyong Zhang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR, Oral Presentation), 2022.
[paper] [Project Page] [Code]

alt text 

HeadNeRF: A Real-time NeRF-based Parametric Head Model
Yang Hong, Bo Peng, Haiyao Xiao, Ligang Liu, Juyong Zhang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[paper] [Project Page] [Code]

alt text 

Neural Points: Point Cloud Representation with Neural Fields for Arbitrary Upsampling
Wanquan Feng, Jin Li, Hongrui Cai, Xiaonan Luo, Juyong Zhang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[paper] [Project Page] [Code]

alt text 

A Survey of Non-Rigid 3D Registration
Bailin Deng, Yuxin Yao, Roberto M. Dyke, Juyong Zhang
Computer Graphics Forum (Eurographics State-of-the-Art Reports), Vol.41, No.2, pages 559-589, 2022.
[paper] [Project Page]

alt text 

Fast and Robust Iterative Closest Point
Juyong Zhang, Yuxin Yao, Bailin Deng
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.44, Issue 7, pages 3450-3466, 2022.
[paper] [code]

alt text 

Facial Expression Retargeting from Human to Avatar Made Easy
Juyong Zhang, Keyu Chen, Jianmin Zheng
IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.28, No.2, pages 1274-1287, 2022.
[paper] [code]

alt text 

GeodesicEmbedding (GE): A High-Dimensional Embedding Approach for Fast Geodesic Distance Queries
Qianwei Xia, Juyong Zhang, Zheng Fang, Jin Li, Mingyue Zhang, Bailin Deng, Ying He
IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol. 28, No.12, pages 4930-4939, 2022.
[paper]

alt text 

GDR-Net: A Geometric Detail Recovering Network for 3D Scanned Objects
Wanquan Feng, Juyong Zhang, Yuanfeng Zhou, Shiqing Xin
IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.28, No.12, pages 3959-3973, 2022.

alt text 

Prior-Guided Multi-View 3D Head Reconstruction
Xueying Wang, Yudong Guo, Zhongqi Yang, Juyong Zhang
IEEE Transactions on Multimedia (TMM), Vol.24, pages 4028-4040, 2021.
[paper] [results]

alt text 

AD-NeRF: Audio Driven Neural Radiance Fields for Talking Head Synthesis
Yudong Guo, Keyu Chen, Sen Liang, Yong-Jin Liu, Hujun Bao, Juyong Zhang
IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
[paper] [Project Page] [code]

alt text 

A Robust Loss for Point Cloud Registration
Zhi Deng, Yuxin Yao, Bailin Deng, Juyong Zhang
IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
[paper] [code]

alt text 

High-Resolution Optical Flow from 1D Attention and Correlation
Haofei Xu, Jiaolong Yang, Jianfei Cai, Juyong Zhang, Xin Tong
IEEE/CVF International Conference on Computer Vision (ICCV, Oral Presentation), 2021.
[paper] [code]

alt text 

3D Face From X: Learning Face Shape from Diverse Sources
Yudong Guo, Lin Cai, Juyong Zhang
IEEE Transactions on Image Processing (TIP), Vol.30, pages 3815-3827, 2021.
[paper]

alt text 

Recurrent Multi-view Alignment Network for Unsupervised Surface Registration
Wanquan Feng, Juyong Zhang, Hongrui Cai, Haofei Xu, Junhui Hou, Hujun Bao
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[paper] [Project Page]

alt text 

StereoPIFu: Depth Aware Clothed Human Digitization via Stereo Vision
Yang Hong, Juyong Zhang, Boyi Jiang, Yudong Guo, Ligang Liu, Hujun Bao
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[paper] [Project Page]

alt text 

Landmark Detection and 3D Face Reconstruction for Caricature using a Nonlinear Parametric Model
Hongrui Cai, Yudong Guo, Zhuang Peng, Juyong Zhang
Graphical Models, 2021.
[paper] [code]

alt text 

Real-Time Face View Correction for Front-Facing Cameras
Yudong Guo, Juyong Zhang, Yihua Chen, Hongrui Cai, Zhangjin Huang, Bailin Deng
Computational Visual Media, Vol.7, pages 437–452, 2021.

alt text 

Deformation Representation based Convolutional Mesh Autoencoder for 3D Hand Generation
Xinqian Zheng, Boyi Jiang, Juyong Zhang
Neurocomputing, Vol.444, pages 356-365, 2021.
[paper] [code]

alt text 

Parallel and Scalable Heat Methods for Geodesic Distance Computation
Jiong Tao, Juyong Zhang, Bailin Deng, Zheng Fang, Yue Peng, Ying He
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.43, No.2, pages 579-594, 2021.
[paper] [code]

alt text 

Learning Local Neighboring Structure for Robust 3D Shape Representation
Zhongpai Gao, Junchi Yan, Guangtao Zhai, Juyong Zhang, Yiyan Yang, Xiaokang Yang
Proceedings of the 35th AAAI Conference on Artificial Intelligence (AAAI), 2021.

alt text 

Robust RGB-D Face Recognition Using Attribute-Aware Loss
Luo Jiang, Juyong Zhang, Bailin Deng
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.42, No.10, Pages 2552-2566, 2020.
[paper] [dataset]

alt text 

Modeling Caricature Expressions by 3D Blendshape and Dynamic Texture
Keyu Chen, Jianmin Zheng, Jianfei Cai, Juyong Zhang
ACM International Conference on Multimedia (ACM MM), 2020.
[paper]

alt text 

BCNet: Learning Body and Cloth Shape from A Single Image
Boyi Jiang, Juyong Zhang, Yang Hong, Jinhao Luo, Ligang Liu, Hujun Bao
European Conference on Computer Vision (ECCV), 2020.
[paper] [code]

alt text 

Disentangled Human Body Embedding Based on Deep Hierarchical Neural Network
Boyi Jiang, Juyong Zhang, Jianfei Cai, Jianmin Zheng
IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.26, No.8, Pages 2560-2575, 2020.
[paper] [code]

alt text 

Semi-Supervised 3D Face Representation Learning From Unconstrained Photo Collections
Zhongpai Gao, Juyong Zhang, Yudong Guo, Chao Ma, Guangtao Zhai, Xiaokang Yang
IEEE Conference on Computer Vision and Pattern Recognition Workshop on DYNAVIS (CVPRW, Best Paper Award), 2020.
[paper]

alt text 

Anderson Acceleration for Nonconvex ADMM Based on Douglas-Rachford Splitting
Wenqing Ouyang, Yue Peng, Yuxin Yao, Juyong Zhang, Bailin Deng
Computer Graphics Forum (Symposium on Geometry Processing), 39(5), 2020.
[paper] [code]

alt text 

Quasi-Newton Solver for Robust Non-Rigid Registration
Yuxin Yao, Bailin Deng, Weiwei Xu, Juyong Zhang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR, Oral Presentation), 2020.
[paper] [code]

alt text 

Lightweight Photometric Stereo for Facial Details Recovery
Xueying Wang, Yudong Guo, Bailin Deng, Juyong Zhang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[paper] [code]

alt text 

AANet: Adaptive Aggregation Network for Efficient Stereo Matching
Haofei Xu, Juyong Zhang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[paper] [code]

alt text 

Vehicle global 6-DoF pose estimation under traffic surveillance camera
Shanxin Zhang, Cheng Wang, Zijian He, QingLi, Xiuhong Lin, Xin Li, Juyong Zhang, Chenhui Yang, Jonathan Li,
ISPRS Journal of Photogrammetry and Remote Sensing, Vol.159, pages 114-128, 2020.
[paper]

alt text 

Accelerating ADMM for Efficient Simulation and Optimization
Juyong Zhang, Yue Peng, Wenqing Ouyang, Bailin Deng
ACM Transactions on Graphics (SIGGRAPH ASIA), Vol.38, No.6, 2019.
[paper] [code]

alt text 

Real-time Head Pose Estimation and Face Modeling From a Depth Image
Changwei Luo, Juyong Zhang, Jun Yu, Chang Wen Chen, Shengjin Wang
IEEE Transactions on Multimedia (TMM), Vol.21, No.10, Pages 2473-2481, 2019.
[paper]

alt text 

Region Deformer Networks for Unsupervised Depth Estimation from Unconstrained Monocular Videos
Haofei Xu, Jianmin Zheng, Jianfei Cai, Juyong Zhang
International Joint Conference on Artificial Intelligence (IJCAI), 2019.
[paper] [code]

alt text 

A Fast Numerical Solver for Local Barycentric Coordinates
Jiong Tao, Bailin Deng, Juyong Zhang
Computer Aided Geometric Design (GMP, Best Paper Award), Vol.70, Pages 46-58, 2019.
[paper]

alt text 

Disentangled Representation Learning for 3D Face Shape
Zi-Hang Jiang, Qianyi Wu, Keyu Chen, Juyong Zhang
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
[paper] [training code & trained model]

alt text 

Static/Dynamic Filtering for Mesh Geometry
Juyong Zhang, Bailin Deng, Yang Hong, Yue Peng, Wenjie Qin, Ligang Liu
IEEE Transactions on Visualization and Computer Graphics (TVCG), Vol.25, No.4, pages 1774-1787, 2019.
[paper] [supp] [code]

alt text 

CNN-based Real-time Dense Face Reconstruction with Inverse-rendered Photo-realistic Face Images
Yudong Guo, Juyong Zhang, Jianfei Cai, Boyi Jiang, Jianmin Zheng
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.41, No.6, pages 1294-1307, 2019.
[paper] [demo] [dataset&results]

alt text 

Real-time 3D Face-Eye Performance Capture of a PersonWearing VR Headset
Guoxian Song, Jianfei Cai, Tat-Jen Cham, Jianmin Zheng, Juyong Zhang, Henry Fuchs
ACM Multimedia (ACM MM) 2018.
[paper] [dataset]

alt text 

Anderson Acceleration for Geometry Optimization and Physics Simulation
Yue Peng, Bailin Deng, Juyong Zhang, Fanyu Geng, Wenjie Qin, Ligang liu
ACM Transactions on Graphics (SIGGRAPH), Vol.37, No.4, 2018.
[paper] [code]

alt text 

3D Face Reconstruction with Geometry Details from a Single Image
Luo Jiang, Juyong Zhang, Bailin Deng, Hao Li, Ligang Liu
IEEE Transactions on Image Processing (TIP), Vol.27, No.10, pages 4756-4770, 2018.
[paper] [results]

alt text 

Alive Caricature from 2D to 3D
Qianyi Wu, Juyong Zhang, Yu-Kun Lai, Jianmin Zheng, Jianfei Cai
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Spotlight Presentation, 2018.
[paper] [The Best of the Physics arXiv by MIT Tech/] [dataset&results]

alt text 

Shading-based Surface Detail Recovery under General Unknown Illumination
Di Xu, Qi Duan, Jianmin Zheng, Juyong Zhang, Jianfei Cai, Tat-Jen Cham
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Vol.40, No.2, pages 423-436, 2018.
[paper]

alt text 

Joint Head Pose and Face Landmarks Regression from Depth Images
Jie Wang, Juyong Zhang, Changwei Luo, Falai Chen
Computational Visual Media (Honorable Mention Award), Vol.3, No.3. pages 229-241, 2017.
[paper]

alt text 

Pixel Level Guided Face Editing with Fully Convolution Networks
Zhenxi Li, Juyong Zhang
IEEE International Conference on Multimedia and Expo, 2017.
[paper]

alt text 

FrameFab: Robotic Fabrication of Frame Shapes
Yijiang Huang, Juyong Zhang, Xin Hu, Guoxian Song, Zhongyuan Liu, Lei Yu, Ligang Liu
ACM Transactions on Graphics (SIGGRAPH Asia), 35(6), 2016.
[webpage] [paper] [supp] [video] [code]

alt text 

Hand Pose Regression via A Classification-guided Approach
Hongwei Yang, Juyong Zhang
Asian Conference on Computer Vision (ACCV), 2016.
[paper] [video]

alt text 

Euclidean and Hamming Embedding for Image Patch Description with Convolutional Networks
Zishun Liu, Zhenxi Li, Juyong Zhang, Ligang Liu
IEEE Conference on Computer Vision and Pattern Recognition Workshops, 2016.
[paper]

alt text 

Upright Orientation of 3D Shapes with Convolutional Networks
Zishun Liu, Juyong Zhang, Ligang Liu
Graphical Models (Computational Visual Media), 2016.
[paper] [code]

alt text 

Locating Facial Landmarks Using Probabilistic Random Forest
Changwei Luo, Zengfu Wang, Shaobiao Wang, Juyong Zhang, Jun Yu
IEEE Signal Processing Letters, 22(12), 2015.
[paper]

alt text 

Guided Mesh Normal Filtering
Wangyu Zhang, Bailin Deng, Juyong Zhang, Sofien Bouaziz, Ligang Liu
Computer Graphics Forum (Proc. Pacific Graphics), 34(7), 2015.
[webpage] [paper] [supp] [slides] [video] [code]

alt text 

Survey on sparsity in geometric modeling and processing
Linlin Xu, Ruimin Wang, Juyong Zhang, Zhouwang Yang, Jiansong Deng, Falai Chen, Ligang Liu
Graphical Models, Vol.82, pages 160-180, 2015.
[paper]

alt text 

Variational Mesh Denoising using Total Variation and Piecewise Constant Function Space
Huayan Zhang, Chunlin Wu, Juyong Zhang, Jiansong Deng
IEEE Transactions on Visualization and Computer Graphics (TVCG), 21(7), 2015.
[paper]

alt text 

Robust Surface Reconstruction via Dictionary Learning
Shiyao Xiong, Juyong Zhang, Jianmin Zheng, Jianfei Cai, Ligang Liu
ACM Transactions on Graphics (SIGGRAPH ASIA), 33(6), 2014.
[webpage] [paper] [slides] [video]

alt text 

Local Barycentric Coordinates
Juyong Zhang^, Balin Deng^, Zishun Liu, Giuseppe Patanè, Sofien Bouaziz, Kai Hormann, Ligang Liu (^ joint first authors)
ACM Transactions on Graphics (SIGGRAPH ASIA), 33(6), 2014.
[webpage] [paper] [slides] [video] [code]

alt text 

L1-Regression Based Subdivision Schemes For Noisy Data
Ghulam Mustafa, Hao Li, Juyong Zhang, Jiansong Deng
Computer Aided Design (SPM 2014)
[paper] [slides] [code]

alt text 

Robust Interactive Image Segmentation via Iterative Refinement
Yao Peng, Juyong Zhang, Yancheng Yuan, Shuyuan Zhu, Lu Fang
ICIP, 2014.
[paper]

alt text 

Iso-level Tool Path Planning for Free-form Surfaces
Qiang Zou, Juyong Zhang, Bailin Deng, Jibin Zhao
Computer-Aided Design, Vol. 53: 117-125, 2014.
[paper]

alt text 

Recovering Surface Details under General Unknown Illumination Using Shading and Coarse Multi-view Stereo
Di Xu, Qi Duan, Jianming Zheng, Juyong Zhang, Jianfei Cai, Tat-Jen Cham
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014.
[paper]

alt text 

Exploring Local Modifications for Constrained Meshes
Bailin Deng, Sofien Bouaziz, Mario Deuss, Juyong Zhang, Yuliy Schwartzburg, Mark Pauly
Computer Graphics Forum 32(2), (Eurographics, Best Paper Honourable Mention), 2013.
[webpage]

alt text 

Variational Mesh Decomposition
Juyong Zhang, Jianmin Zheng, Chunlin Wu, Jianfei Cai
ACM Transactions on Graphics (Presented at SIGGRAPH 2012), 31(3), 2012.
[paper]

alt text 

Robust Interactive Image Segmentation Using Convex Active Contours
Nguyen Thi Nhat Anh, Jianfei Cai, Juyong Zhang, Jianmin Zheng
IEEE Transactions on Image Processing (TIP), 21(8), 2012.
[paper] [software]

alt text 

Augmented Lagrangian Method for Total Variation Based Image Restoration and Segmentation Over Triangulated Surfaces
Chunlin Wu, Juyong Zhang, Yuping Duan, Xue-Cheng Tai
Journal of Scientific Computing, 50(1), 2012.
[paper]

alt text 

Augmented Lagrangian Method for Total Variation Restoration with Non-quadratic Fidelity
Chunlin Wu, Juyong Zhang, Xue-Cheng Tai
Inverse Problems and Imaging, 5(1), 2011.
[paper]

alt text 

Interactive Mesh Cutting Using Constrained Random Walks
Juyong Zhang, Jianmin Zheng, Jianfei Cai
IEEE Transactions on Visualization and Computer Graphics (TVCG), 17(3), 2011.
[paper]

alt text 

Fast Optimization for Multichannel Total Variation Minimization with Non-quadratic Fidelity
Juyong Zhang, Chunlin Wu
Signal Processing, 91(8), 2011.
[paper] [code]

alt text 

A Diffusion Approach to Seeded Image Segmentation
Juyong Zhang, Jianmin Zheng, Jianfei Cai
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010.
[paper]

alt text 

Mesh Snapping: Robust Interactive Mesh Cutting Using Fast Geodesic Curvature Flow
Juyong Zhang, Chunlin Wu, Jianfei Cai, Jianmin Zheng, Xue-Cheng Tai
Computer Graphics Forum (Proc. Eurographics), 29(2), 2010.
[paper]

alt text 

Progressive Coding and Illumination and View DependentTransmission of 3-D Meshes Using R-D Optimization
Wei Guan, Jianfei Cai, Juyong Zhang, Jianmin Zheng
IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 20(4), 2010.
[paper]

Technical Reports

alt text 

Fast K-Means Clustering with Anderson Acceleration
Juyong Zhang, Yuxin Yao, Yue Peng, Hao Yu, Bailin Deng
Technical report, May. 2018.
[paper]

alt text 

Deep Face Feature for Face Alignment
Boyi Jiang, Juyong Zhang, Bailin Deng, Yudong Guo, Ligang Liu
Technical report, Aug. 2017.
[arXiv] [code]