Iโ€™m currently a Postdoctoral Research Fellow at The Institute for Experiential AI (EAI) at Northeastern Unversity. I do research on computer vision and machine learning with applications for healthcare, working closely with Dr. Agata Lapedriza, Dr. Sarah Ostadabbas, and Dr. Eugene Tunik. Prior to joining to EAI, I received my Ph.D in Computer Science from The State University of New York at Buffalo (UB), working on human activity analysis with Dr. David Doermann. Before joining UB, I obtained my MS and BS degrees (both with honors) from Huazhong University of Science and Technology (HUST), advised by Dr. Zhiguo Cao. I enjoy hiking, skiing, playing ping-pong, and exploring towns with my camera.

Research Interests: Human Action/Motion Analytics, Video Understanding, Human-Centric AI for Health; Multimodal Learning, Time Series Modeling, Sequence Generation

For NU students: feel free to send me an email if you are interested in working with me.

๐Ÿ”ฅ News

  • [2025.02] I was invited to serve as a mentor for the WACV 2025 Doctoral Consortium.
  • [2024.12] Two papers on Human Motion Prediction and Affective Computing accepted by WACVW 2025.
  • [2024.11] We are organizing Elderly Action Recognition Challenge with Voxel51.
  • [2024.10] We are organizing CV4Smalls Workshop in WACV 2025.
  • [2024.08] One paper on Human Attention Interruption Analysis accepted by ICPR 2024.
  • [2024.05] One patent on Human Motion Prediction approved.
  • [2023.09] One paper on defending against Data-Free Model Extraction (DFME) accepted by NeurIPS 2023.
  • [2023.09] I joined The Institute for Experiential AI (EAI) at Northeastern Unversity as a Postdoctoral Research Fellow, working with Dr. Agata Lapedriza, Dr. Sarah Ostadabbas.
  • [2023.08] I graduated from UB! ๐ŸŽ‰๐ŸŽ‰
  • [2023.02] One paper on Continual Learning accepted by CVPR 2023.
  • [2023.01] I successfully defended my dissertation proposal.
  • [2022.07] One paper on Human Action Recognition accepted by Neurocomputing.
  • [2022.06] One paper on Human Motion Prediction accepted by IROS 2022 and IEEE Robotics and Automation Letters.
  • [2022.02] I joined XPENG Motors as a Research Intern working with Dr. Chen Bai and Dr. Cheng Lu.
  • [2021.05] I joined OPPO US Research Center as a Research Intern working with Dr. Zhong Li and Dr. Yi Xu.
  • [2021.01] One paper on Sign Language Recognition accepted by IMWUT 2021.
  • [2020.10] One paper on Human Action Prediction accepted by ICPR 2020.
  • [2020.04] One paper on Neural Architecture Search accepted by IJCAI 2020.
  • [2019.05] I joined Fuji Xerox Palo Alto Lab (FXPAL) as a Research Intern working with Dr. Yanxia Zhang and Dr. Qiong Liu.
  • [2018.10] One paper on Human Action Prediction accepted by ICIP 2018.
  • [2018.08] I started my PhD in Computer Science at UB.

Selected Publications

WACVW 2025
sym

UniMotion: Bridging 2D and 3D Representations for Human Motion Prediction

Yanjun Zhu, Chen Bai, Cheng Lu, David Doermann, and Agata Lapedriza

IEEE/CVF Winter Conference on Applications of Computer Vision Workshop (WACVW), 2025

ICPR 2024
sym

Multimodal Drivers of Attention Interruption to Baby Product Video Ads

Wen Xie, Lingfei Luan, Yanjun Zhu, Yakov Bart, and Sarah Ostadabbas

International Conference on Pattern Recognition (ICPR), 2024

NeurIPS 2023
sym

Defending against Data-Free Model Extraction by Distributionally Robust Defensive Training

Zhenyi Wang, Li Shen, Tongliang Liu, Tiehang Duan, Yanjun Zhu, Donglin Zhan, David Doermann, Mingchen Gao

Annual Conference on Neural Information Processing Systems (NeurIPS), 2023

CVPR 2023
sym

MetaMix: Towards Corruption-Robust Continual Learning with Temporally Self-Adaptive Data Transformation

Zhenyi Wang, Li Shen, Donglin Zhan, Qiuling Suo, Yanjun Zhu, Tiehang Duan, Mingchen Gao

Computer Vision and Pattern Recognition (CVPR), 2023

RA-L
sym

PIMNet: Physics-infused Neural Network for Human Motion Prediction

Zhibo Zhang*, Yanjun Zhu*, Rahul Rai, and David Doermann

IEEE Robotics and Automation Letters, 7, No.4(2022): 8949-8955. IROS, 2022. (Oral)

(* equal contribution)

Neurocomputing
sym

PB-GCN: Progressive Binary Graph Convolutional Networks for Skeleton-based Action Recognition

Mengyi Zhao, Shuling Dai, Yanjun Zhu, Hao Tang, Pan Xie, Yue Li, Chunlei Liu, and Baochang Zhang

Neurocomputing 501 (2022): 640-649.

IMWUT 2021
sym

SonicASL: An Acoustic-based Sign Language Gesture Recognizer using Earphones

Yincheng Jin, Yang Gao, Yanjun Zhu, Wei Wang, Jiyang Li, Seokmin Choi, Zhangyu Li, Jagmohan Chauhan, Anind K. Dey, and Zhanpeng Jin

ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT) 5, no. 2 (2021): 1-30.

ICPR 2020
sym

What and How? Jointly Forecasting Human Action and Pose

Yanjun Zhu, Yanxia Zhang, Qiong Liu, Andreas Girgensohn, and David Doermann

International Conference on Pattern Recognition (ICPR), 2020.

IJCAI 2020
sym

CP-NAS: Child-Parent Neural Architecture Search for 1-bit CNNs

Liโ€™an Zhuo, Baochang Zhang, Hanlin Chen, Linlin Yang, Chen Chen, Yanjun Zhu, David Doermann

International Joint Conference on Artificial Intelligence (IJCAI), 2020.

ICIP 2018
sym

Selecting Informative Frames for Action Recognition with Partial Observations

Yanjun Zhu, Gang Yu, Junsong Yuan, and Kai-Kuang Ma

International Conference on Image Processing (ICIP), 2018. (Oral)

TPAMI
sym

Sequential Optimization for Efficient High-Quality Object Proposal Generation

Ziming Zhang, Yun Liu, Xi Chen, Yanjun Zhu. Ming-Ming Cheng, Venkatesh Saligrama, and Philip H.S. Torr

IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 40(5), pp.1209-1223, 2017.

Biosystems Engineering
sym

In-field automatic observation of wheat heading stage using computer vision

Yanjun Zhu, Zhiguo Cao, Hao Lu, Yanan Li, and Yang Xiao

Biosystems Engineering, 143, pp.28-41, 2016. (Outstanding Paper Award)

Teaching

  • [2023 Spring] Computer Vision and Image Processing
  • [2022 Fall] Information Retrieval
  • [2020 Fall] Blockchain Application Development
  • [2020 Spring, 2019 Fall] Introduction to Machine Learning

Honors and Awards

  • [2021.09] Best Presentation Award, OPPO US Research Center
  • [2018.07] European Society of Agricultural Engineers Outstanding Paper Award (1 per year)
  • [2016.10] National Scholarship for Graduate Students (< 1%)
  • [2014.12] Excellent Bachelor Thesis Award in Hubei Province, China (< 1%)

Services

  • Workshop Chair: CV4Smalls with WACV 2025
  • Challenge Organizer: Elderly Action Recognition Challenge with Voxel51
  • Journal Guest Editor: Multimodal Tools and Applications (Special Issue, 2024)
  • Journal Reviewer: Springer Plant Methods, IEEE TCSVT, Elsevier JVCIR, Multimodal Tools and Applications
  • Conference Reviewer: ICIP, ICPR, ICCV, ECCV, CVPR, ACCV, WACV, NeurIPS, ICLR, ICML, ACM Multimedia, ICDAR, AAAI, MICCAI

ย