Iโm currently a Postdoctoral Research Fellow at The Institute for Experiential AI (EAI) at Northeastern Unversity. I do research on computer vision and machine learning with applications for healthcare, working closely with Dr. Agata Lapedriza, Dr. Sarah Ostadabbas, and Dr. Eugene Tunik. Prior to joining to EAI, I received my Ph.D in Computer Science from The State University of New York at Buffalo (UB), working on human activity analysis with Dr. David Doermann. Before joining UB, I obtained my MS and BS degrees (both with honors) from Huazhong University of Science and Technology (HUST), advised by Dr. Zhiguo Cao. I enjoy hiking, skiing, playing ping-pong, and exploring towns with my camera.
Research Interests: Human Action/Motion Analytics, Video Understanding, Human-Centric AI for Health; Multimodal Learning, Time Series Modeling, Sequence Generation
For NU students: feel free to send me an email if you are interested in working with me.๐ฅ News
- [2025.02] I was invited to serve as a mentor for the WACV 2025 Doctoral Consortium.
- [2024.12] Two papers on Human Motion Prediction and Affective Computing accepted by WACVW 2025.
- [2024.11] We are organizing Elderly Action Recognition Challenge with Voxel51.
- [2024.10] We are organizing CV4Smalls Workshop in WACV 2025.
- [2024.08] One paper on Human Attention Interruption Analysis accepted by ICPR 2024.
- [2024.05] One patent on Human Motion Prediction approved.
- [2023.09] One paper on defending against Data-Free Model Extraction (DFME) accepted by NeurIPS 2023.
- [2023.09] I joined The Institute for Experiential AI (EAI) at Northeastern Unversity as a Postdoctoral Research Fellow, working with Dr. Agata Lapedriza, Dr. Sarah Ostadabbas.
- [2023.08] I graduated from UB! ๐๐
- [2023.02] One paper on Continual Learning accepted by CVPR 2023.
- [2023.01] I successfully defended my dissertation proposal.
- [2022.07] One paper on Human Action Recognition accepted by Neurocomputing.
- [2022.06] One paper on Human Motion Prediction accepted by IROS 2022 and IEEE Robotics and Automation Letters.
- [2022.02] I joined XPENG Motors as a Research Intern working with Dr. Chen Bai and Dr. Cheng Lu.
- [2021.05] I joined OPPO US Research Center as a Research Intern working with Dr. Zhong Li and Dr. Yi Xu.
- [2021.01] One paper on Sign Language Recognition accepted by IMWUT 2021.
- [2020.10] One paper on Human Action Prediction accepted by ICPR 2020.
- [2020.04] One paper on Neural Architecture Search accepted by IJCAI 2020.
- [2019.05] I joined Fuji Xerox Palo Alto Lab (FXPAL) as a Research Intern working with Dr. Yanxia Zhang and Dr. Qiong Liu.
- [2018.10] One paper on Human Action Prediction accepted by ICIP 2018.
- [2018.08] I started my PhD in Computer Science at UB.
Selected Publications

UniMotion: Bridging 2D and 3D Representations for Human Motion Prediction
Yanjun Zhu, Chen Bai, Cheng Lu, David Doermann, and Agata Lapedriza
IEEE/CVF Winter Conference on Applications of Computer Vision Workshop (WACVW), 2025

Multimodal Drivers of Attention Interruption to Baby Product Video Ads
Wen Xie, Lingfei Luan, Yanjun Zhu, Yakov Bart, and Sarah Ostadabbas
International Conference on Pattern Recognition (ICPR), 2024

Defending against Data-Free Model Extraction by Distributionally Robust Defensive Training
Zhenyi Wang, Li Shen, Tongliang Liu, Tiehang Duan, Yanjun Zhu, Donglin Zhan, David Doermann, Mingchen Gao
Annual Conference on Neural Information Processing Systems (NeurIPS), 2023

MetaMix: Towards Corruption-Robust Continual Learning with Temporally Self-Adaptive Data Transformation
Zhenyi Wang, Li Shen, Donglin Zhan, Qiuling Suo, Yanjun Zhu, Tiehang Duan, Mingchen Gao
Computer Vision and Pattern Recognition (CVPR), 2023

PIMNet: Physics-infused Neural Network for Human Motion Prediction
Zhibo Zhang*, Yanjun Zhu*, Rahul Rai, and David Doermann
IEEE Robotics and Automation Letters, 7, No.4(2022): 8949-8955. IROS, 2022. (Oral)
(* equal contribution)

PB-GCN: Progressive Binary Graph Convolutional Networks for Skeleton-based Action Recognition
Mengyi Zhao, Shuling Dai, Yanjun Zhu, Hao Tang, Pan Xie, Yue Li, Chunlei Liu, and Baochang Zhang
Neurocomputing 501 (2022): 640-649.

SonicASL: An Acoustic-based Sign Language Gesture Recognizer using Earphones
Yincheng Jin, Yang Gao, Yanjun Zhu, Wei Wang, Jiyang Li, Seokmin Choi, Zhangyu Li, Jagmohan Chauhan, Anind K. Dey, and Zhanpeng Jin
ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 5, no. 2 (2021): 1-30.

What and How? Jointly Forecasting Human Action and Pose
Yanjun Zhu, Yanxia Zhang, Qiong Liu, Andreas Girgensohn, and David Doermann
International Conference on Pattern Recognition (ICPR), 2020.

CP-NAS: Child-Parent Neural Architecture Search for 1-bit CNNs
Liโan Zhuo, Baochang Zhang, Hanlin Chen, Linlin Yang, Chen Chen, Yanjun Zhu, David Doermann
International Joint Conference on Artificial Intelligence (IJCAI), 2020.

Selecting Informative Frames for Action Recognition with Partial Observations
Yanjun Zhu, Gang Yu, Junsong Yuan, and Kai-Kuang Ma
International Conference on Image Processing (ICIP), 2018. (Oral)

Sequential Optimization for Efficient High-Quality Object Proposal Generation
Ziming Zhang, Yun Liu, Xi Chen, Yanjun Zhu. Ming-Ming Cheng, Venkatesh Saligrama, and Philip H.S. Torr
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 40(5), pp.1209-1223, 2017.

In-field automatic observation of wheat heading stage using computer vision
Yanjun Zhu, Zhiguo Cao, Hao Lu, Yanan Li, and Yang Xiao
Biosystems Engineering, 143, pp.28-41, 2016. (Outstanding Paper Award)
Teaching
- [2023 Spring] Computer Vision and Image Processing
- [2022 Fall] Information Retrieval
- [2020 Fall] Blockchain Application Development
- [2020 Spring, 2019 Fall] Introduction to Machine Learning
Honors and Awards
- [2021.09] Best Presentation Award, OPPO US Research Center
- [2018.07] European Society of Agricultural Engineers Outstanding Paper Award (1 per year)
- [2016.10] National Scholarship for Graduate Students (< 1%)
- [2014.12] Excellent Bachelor Thesis Award in Hubei Province, China (< 1%)
Services
- Workshop Chair: CV4Smalls with WACV 2025
- Challenge Organizer: Elderly Action Recognition Challenge with Voxel51
- Journal Guest Editor: Multimodal Tools and Applications (Special Issue, 2024)
- Journal Reviewer: Springer Plant Methods, IEEE TCSVT, Elsevier JVCIR, Multimodal Tools and Applications
- Conference Reviewer: ICIP, ICPR, ICCV, ECCV, CVPR, ACCV, WACV, NeurIPS, ICLR, ICML, ACM Multimedia, ICDAR, AAAI, MICCAI