Faculty Members
Dr. Hui Ye
Assistant Professor
| Ph.D. in Creative Media (CityUHK) B.A. in Communication (USTC) |
|
| - | |
| huiyehy@hkbu.edu.hk | |
| - |
Dr. Hui Ye’s research interests lie in the intersection of Human-Computer Interaction (HCI) and Computer Graphics (CG). Specifically, she focuses on exploring novel interactive techniques, tools, interfaces, and systems for content creation, interaction design, creativity support, and end-user development, using emerging technologies (e.g, AR/VR, Generative AI). Her research covers various practical and creative applications such as 3D sketching, animation creation, game design and development, interaction prototyping, and artistic expression. She aims to lower the barriers to use emerging technologies for both novice and expert users. As an interdisciplinary researcher with a background in science and technology communication and computer science, She approaches this goal from a problem-understanding perspective, using human-centred approaches, to problem solving through technical means.
Her interdisciplinary research has led to publications in top-tier HCI and CG venues, including ACM CHI, ACM SIGGRAPH/TOG, IEEE TVCG, and IEEE ISMAR. She has received several honors, such as SIGGRAPH PhD Thesis Fast Forward, Shidi CAD&CG Excellent Student Award, as well as prestigious recognitions like the Third Prize of the Science and Technology Progress Award of Anhui Province and National Outstanding Popular Science Works Award.
She actively engages in community service through roles such as conference Organization Co-chair (CVM 2025), Organizer of the 1st HKUST AI Film Festival, and Web Chair (CGI 2025). She has also served as Associate Chair (CSCW 2023 and 2024, CHI 2023 and 2024 LBW), Session Chair (CHI 2024), and Technical/International Program Committees member (SIGGRAPH Asia 2024 and 2025 E-Tech, Pacific Graphics 2024, UbiComp/ISWC 2024 and 2025 Notes and Briefs, and Expressive 2025), as well review boards for top HCI and graphics conferences and journals, including CHI, CSCW, UIST, SIGGRAPH (Asia), PG, MobileHCI, IEEE VR, ACM TOG, IEEE TVCG, and IEEE TMC.
Personal Webpage: https://huiye19.github.io/
Google Scholar: https://scholar.google.com/citations?user=PjU4fS4AAAAJ&hl=zh-CN
Research interests
AR/VR/XR
Generative AI
Game and Animation
Interaction Design
Creativity Support Tools
Publications
Journal articles
Hui Ye, Chufeng Xiao, Jiaye Leng, Pengfei Xu, and Hongbo Fu†. MoGraphGPT: Creating Interactive Scenes Using Modular LLM and Graphical Control. (arXiv preprint)
Hui Ye*, Jiaye Leng*, Pengfei Xu, Karan Singh, and Hongbo Fu†. ProInterAR: A Visual Programming Platform for Creating Immersive AR Interactions. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems. ACM, 2024. (CHI 2024)
Hui Ye, Jiaye Leng, Chufeng Xiao, Lili Wang, and Hongbo Fu†. ProObjAR: Prototyping Spatially-aware Interactions of Smart Objects with AR-HMD. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. ACM, 2023. (CHI 2023)
Hui Ye and Hongbo Fu†. ProGesAR: Mobile AR Prototyping for Proxemic and Gestural Interactions with Real-world IoT Enhanced Spaces. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems. ACM, 2022. (CHI 2022)
Hui Ye*, Kin Chung Kwan*, Wanchao Su, and Hongbo Fu†. ARAnimator: In-situ Character Animation in Mobile AR with User-defined Motion Gestures. ACM Transactions on Graphics (TOG): Special Issue for ACM SIGGRAPH 2020. ACM, 2020. (SIGGRAPH 2020)
Hui Ye, Kin Chung Kwan, and Hongbo Fu†. 3D Curve Creation on and around Physical Objects with Mobile AR. IEEE Transactions on Visualization and Computer Graphics. IEEE, 2021. (TVCG)
Wanchao Su, Hui Ye, Shuyu Chen, Lin Gao, and Hongbo Fu†. DrawingInStyles: Portrait Image Generation and Editing with Spatially Conditioned StyleGAN. IEEE Transactions on Visualization and Computer Graphics. IEEE, 2022. (TVCG)
Xuanyu Wang, Hui Ye, Christian Sandor, Weizhan Zhang, and Hongbo Fu†. Predict-and-Drive: Avatar Motion Adaption in Room-Scale Augmented Reality Telepresence with Heterogeneous Spaces. IEEE Transactions on Visualization and Computer Graphics: Special Issue for IEEE ISMAR 2022. IEEE, 2022. (TVCG)
Linzi Qu, Jiaxiang Shang, Hui Ye, Xiaoguang Han, and Hongbo Fu†. Sketch2Human: Deep Human Generation with Disentangled Geometry and Appearance Control. IEEE Transactions on Visualization and Computer Graphics. IEEE, 2024. (TVCG)
Book Sections
Yanxiang Zhang, Hui Ye, et al. Press Time to Sit Flight: Exploring the Secrets of Nature Science Tour. University of Science and Technology of China Press. 2018.
Key Publication Planning Project during the 13th Five-Year Plan
2022 National Outstanding Popular Science Works
2019 National Excellent Publication Recommended to the Elderly
Yanxiang Zhang, Hui Ye, et al. Introduction to New Media for Science Popularization. China Science and Technology Press. 2017.
Chapter 14: Interactive Science Popularization based on Natural Interaction
* indicates equal contribution
† indicates corresponding author
Patents
Hongbo Fu, Hui Ye, and Chufeng Xiao. Prototyping Applications of Spatially Aware Smart Objects using Augmented Reality. U.S. Patent 18/335,559, 2023.
Hongbo Fu and Hui Ye. Mobile AR Prototyping for Proxemic and Gestural Interactions with Real-world IoT Enhanced Spaces. U.S. Patent 17/810,714, 2022.
Awards/Grants/Honors
RGC Postdoctoral Fellowship (HKD 1,219,650, 2022-2025)
National Outstanding Popular Science Works (2022)
SIGGRAPH PhD Thesis Fast Forward (7 Globally, 2021)
Shidi CAD&CG Excellent Student Award (6 in China, RMB 30,000, 2021)
Outstanding Publication Recommended to the Elderly in China (2018)