Bin Zhu

Assistant Professor of Computer Science
School of Computing and Information Systems, Singapore Management University (SMU)
80 Stamford Road, Singapore 178902

My research interest lies in Human Centered Multimedia Analysis, including Cross-modal Search and Creation, Egocentric Video Understanding, Multi‐modal Large Language Model and AI for Healthcare. Specifically, the objective is to conduct frontier research and develop cutting-edge technologies for processing, modeling, analyzing, and understanding multimedia content, that facilitate natural and immersive human experience and exert positive impact for our society.

Before joining SMU, I was a Postdoctoral Researcher working with Prof. Dima Damen at the University of Bristol, as part of the EPSRC Visual AI Program Grant. Previously, I received my Ph.D. degree from Department of Computer Science, City University of Hong Kong in 2021, under the supervision of Prof. Chong-Wah Ngo and Dr. Wing-Kwong Chan. Prior to CityU, I obtained my master and bachelor degrees from Zhejiang University and Southeast University respectively.

🔥🔥🔥Openings: I am actively looking for self-motivated Ph.D. students, CSC visiting students, and (remote) interns. If you are interested in working with me, please feel free to drop me an email with your CV and other supporting documents (if any).

News

Mar, 2025 One paper on Ingredient Recognition is accepted by ICME 2025.
Feb, 2025 One paper on Egocentric Video Understanding is accepted by CVPR 2025.
Feb, 2025 One paper on Recipe Following in Cooking Video is accepted by CHI (LBW) 2025.
Jan, 2025 One paper on Large Multimodal Model in Food Domain is accepted by IEEE TMM.
Dec, 2024 Two papers on Grasp Generation and Text-to-Hand-Image Generation are accepted by AAAI 2025.
Dec, 2024 We are excited to announce our Special Session on Multimedia for Cooking and Eating Activities at ICME 2025. We warmly invite you to submit your papers!
Oct, 2024 One paper on Recipe Generation is accepted by WACV 2025.
Jul, 2024 One paper on Time-series Weight Prediction is accepted by ACM MM 2024 and is further selected as an Oral presentation (3.97%).
Jul, 2024 One paper on Cross-modal Recipe Retrieval is accepted by ECCV 2024.
Jun, 2024 One paper on Text-driven Video Prediction is accepted by TOMM.
Feb, 2024 Two papers on Unsupervised Video Hashing and Generalizable Food Recognition are accepted by IEEE TMM.
Jan, 2024 I joined Singapore Management University as an Assistant Professor of Computer Science.

Selected Publications

  1. CVPR
    HD-EPIC: A Highly-Detailed Egocentric Video Dataset
    Toby Perrett, Ahmad Darkhalil, Saptarshi Sinha, Omar Emara, Sam Pollard, Kranti Parida, Kaiting Liu, Prajwal Gatti, Siddhant Bansal, Kevin Flanagan, Jacob Chalk, Zhifan Zhu, Rhodri Guerrier, Fahd Abdelazim, Bin Zhu, Davide Moltisanti, Michael Wray, Hazel Doughty, Dima Damen
    IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) , 2025
    PDF Website
  2. CHI
    OSCAR: Object Status and Contextual Awareness for Recipes to Support Non-Visual Cooking
    Franklin Mingzhe Li, Kaitlyn Ng, Bin Zhu, Patrick Carrington
    ACM Conference on Human Factors in Computing Systems (Late Breaking Work) (CHI-LBW) , 2025
    PDF Code
  3. TMM
    FoodLMM: A Versatile Food Assistant Using Large Multi-modal Model
    Yuehao Yin, Huiyan Qi, Bin Zhu, Jingjing Chen, Yu-Gang Jiang, Chong-Wah Ngo
    IEEE Transactions on Multimedia (TMM) , 2025
    PDF Code
  4. AAAI
    Hand1000: Generating Realistic Hands from Text with Only 1,000 Images
    Haozhuo Zhang, Bin Zhu, Yu Cao, Yanbin Hao
    The 39th Annual AAAI Conference on Artificial Intelligence (AAAI) , 2025
    PDF Website
  5. AAAI
    RAGG: Retrieval-Augmented Grasp Generation Model
    Zhenhua Tang, Bin Zhu, Yanbin Hao, Chong-Wah Ngo, Richang Hong
    The 39th Annual AAAI Conference on Artificial Intelligence (AAAI) , 2025
    PDF Website
  6. WACV
    Retrieval Augmented Recipe Generation
    Guoshan Liu, Hailong Yin, Bin Zhu, Jingjing Chen, Chong-Wah Ngo, Yu-Gang Jiang
    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , 2025
    PDF
  7. ACM MM
    Navigating Weight Prediction with Diet Diary
    Yinxuan Gui, Bin Zhu, Jingjing Chen, Chong Wah Ngo, and Yu-Gang Jiang
    Proceedings of the 32st ACM International Conference on Multimedia (Oral) (ACM MM) , 2024
    PDF Website
  8. ECCV
    Enhancing Recipe Retrieval with Foundation Models: A Data Augmentation Perspective
    Fangzhou Song, Bin Zhu, Yanbin Hao and Shuo Wang
    European Conference on Computer Vision (ECCV) , 2024
    PDF Code