Jiahao Nick LI 李嘉昊

I am a researcher in HCI and a software engineer at Apple .

My research area lies in Human-AI Interaction, focusing on Wearable AI Assistance. Specifically, I build interactive systems to provide proactive assistance for individual users including (1) action prediction, (2) personal memory augmentation and (3) context-aware reminders.

I earned my Ph.D. from UCLA in HCI under the supervision of Prof. Xiang ‘Anthony’ Chen and B.E. from Shanghai Jiao Tong University.

I interned at Meta Reality Lab, Adobe Research and Palo Alto Research Center (PARC). I was also a visiting Ph.D. student at University of Tokyo working with Dr. Takeo Igarashi.

📢 I am actively seeking a full-time industrial position. If you know of any opportunity, please feel free to reach out!

news

Sep 12, 2024 Check out the preprint of OmniQuery (Project website)! OmniQuery enables answering complex questions on your personal captured memories, such as “What parties did I attend during CHI 2024?”.
Aug 2, 2024 One poster accepted to UIST 2024 (OmniQuery)! Invited as a Proceedings Co-chair for UIST 2025.
Apr 13, 2024 Invited as a PC member and Proceedings Co-chair for UIST 2024!
Jan 19, 2024 Two papers (OmniActions & Human I/O) got accepted by CHI 2024 :tada:. OmniActions is from my Meta internship on user intent prediction in pervasive AR scenarios leveraging LLMs and VLMs. Human I/O is on identifying situational impairments using egocentric videos leveraging reasonings of LLMs.

selected publications

  1. omniquery_poster_preview.png
    OmniQuery: Contextually Augmenting Captured Multimodal Memories to Enable Personal Question Answering.
    Jiahao Nick Li, Zhuohao (Jerry) Zhang, and Jiaju Ma
    In Full paper in submission. (UIST 2024 Poster), 2024
  2. omniactions.gif
    OmniActions: Predicting Digital Actions in Response to Real-World Multimodal Sensory Inputs with LLMs
    Jiahao Nick Li, Yan Xu, Tovi Grossman, and 2 more authors
    In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI ’24), 2024
  3. humanio_thumbnail.gif
    Human I/O: Towards a Unified Approach to Detecting Situational Impairments in Everyday Activities
    Xingyu Bruce Liu, Jiahao Nick Li, David Kim, and 2 more authors
    In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI ’24), 2024
  4. roman.gif
    Roman: Making Everyday Objects Robotically Manipulable with 3D-Printable Add-on Mechanisms
    Jiahao Li, Alexis Samoylov, Jeeeun Kim, and 1 more author
    In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI ’22), 2022
  5. romeo.gif
    Romeo: A Design Tool for Embedding Transformable Parts in 3D Models to Robotically Augment Default Functionalities
    Jiahao Li, Meilin Cui, Jeeeun Kim, and 1 more author
    In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technolog (UIST ’20), 2020
  6. robiot.gif
    Robiot: A Design Tool for Actuating Everyday Objects with Automatically Generated 3D Printable Mechanisms
    Jiahao Li, Jeeeun Kim, and Xiang ’Anthony’ Chen
    In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (UIST ’19), 2019